Quantcast
Channel: DDL – Cloud Data Architect
Browsing latest articles
Browse All 275 View Live

Vitess Operator for Kubernetes

Feed: Planet MySQL; Author: Vitess; Introduction In this blog, I would like to explore Vitess Operator for Kubernetes. This post demonstrates the sample implementation of Vitess in Kubernetes topology....

View Article


Image may be NSFW.
Clik here to view.

Auditing, inspecting, and visualizing Amazon Athena usage and cost

Feed: AWS Big Data Blog. Amazon Athena is an interactive query service that makes it easy to analyze data directly in Amazon Simple Storage Service (Amazon S3) using standard SQL. It’s a serverless...

View Article


Image may be NSFW.
Clik here to view.

Keeping your data lake clean and compliant with Amazon Athena

Feed: AWS Big Data Blog. With the introduction of CTAS support for Amazon Athena (see Use CTAS statements with Amazon Athena to reduce cost and improve performance), you can not only query but also...

View Article

Brandur Leach: Feature Casualties of Large Databases

Feed: Planet PostgreSQL. Big data has an unfortunate tendency to get messy. A few years in, a growing database that use to be small, lean, and well-designed, has better odds than not of becoming...

View Article

Image may be NSFW.
Clik here to view.

Optimizing tables in Amazon Redshift using Automatic Table Optimization

Feed: AWS Big Data Blog. Amazon Redshift is the most popular and fastest cloud data warehouse that lets you easily gain insights from all your data using standard SQL and your existing business...

View Article


Image may be NSFW.
Clik here to view.

How Etleap Integrates with Amazon Redshift Data Sharing to Provide Isolation...

Feed: AWS Partner Network (APN) Blog. Author: Christian Romming. By Christian Romming, Founder and CEO at EtleapBy Neeraja Rentachintala, Principal Product Manager with Amazon RedshiftBy Jobin George,...

View Article

Logical Database Backups Using MySQL Shell

Feed: Planet MySQL; Author: Severalnines; Mysqldump is a popular logical backup tool for MySQL which was originally written by Igor Romanenko. Mysqldump performs logical backups (set of SQL...

View Article

Image may be NSFW.
Clik here to view.

Steven Pousty: Using Pl/pgSQL to Calculate New Postgres Columns

Feed: Planet PostgreSQL. In our last blog post on using Postgres for statistics, I covered some of the decisions on how to handle calculated columns in PostgreSQL. I chose to go with adding extra...

View Article


Image may be NSFW.
Clik here to view.

Working with timestamp with time zone in your Amazon S3-based data lake

Feed: AWS Big Data Blog. With a data lake built on Amazon Simple Storage Service (Amazon S3), you can use the purpose-built analytics services for a range of use cases, from analyzing petabyte-scale...

View Article


Image may be NSFW.
Clik here to view.

Performance Testing Using MySQLdump and the MySQL Shell Utility

Feed: Planet MySQL; Author: Severalnines; In my previous post I explained how to take a logical backup using the mysql shell utilities. In this post, we shall compare the speed of the backup and...

View Article

SingleStore DB 7.3 is Now Generally Available

Feed: SingleStore Blog – MemSQL is Now SingleStore. Author: Rick Negrin. SingleStore is proud to announce the general availability of SingleStore DB 7.3 for immediate download. SingleStore DB 7.3 is...

View Article

Image may be NSFW.
Clik here to view.

Boosting your data lake insights using the Amazon Athena Query Federation SDK

Feed: AWS Big Data Blog. Today’s modern applications use multiple purpose-built database engines, including relational, key-value, document, and in-memory databases. This purpose-built approach...

View Article

Robert Haas: CVE-2019-9193

Feed: Planet PostgreSQL. There’s a new article out in Computer Weekly talking about CVE-2019-9193. The PostgreSQL project has issued a statement saying that this is not a security vulnerability, and...

View Article


Lætitia AVROT: Replica identity for logical replication

Feed: Planet PostgreSQL. I was browsing through the logical replication restrictions when I noticed that a primary key was not mandatory to be able to perform logical replication. (see Postgres...

View Article

Image may be NSFW.
Clik here to view.

MySQL Cluster a 5 9s (99.999%) Database

Feed: Planet MySQL; Author: Saroj Tripathy; MySQL Cluster: MySQL Cluster is a real time, ACID-compliant transactional database. It is a combination of MySQL server and the NDB storage engine. Data is...

View Article


Image may be NSFW.
Clik here to view.

How FanDuel Group secures personally identifiable information in a data lake...

Feed: AWS Big Data Blog. This post is co-written with Damian Grech from FanDuel FanDuel Group is an innovative sports-tech entertainment company that is changing the way consumers engage with their...

View Article

MariaDB Xpand for Distributed SQL Now GA

Feed: Clustrix Blog. Author: Max Mether. MariaDB Xpand, MariaDB’s new distributed SQL smart engine, has now been released as GA! With the GA release of Xpand, included with MariaDB Enterprise Server...

View Article


Image may be NSFW.
Clik here to view.

Redesign of –lock-ddl-per-table in Percona XtraBackup

Feed: Planet MySQL; Author: Marcelo Altmann; MySQL 5.7, alongside other many improvements, brought bulk load for creating an index (WL#7277 to be specific), which made ADD INDEX operations much faster...

View Article

Image may be NSFW.
Clik here to view.

Loading SaaS Application Data into Snowflake Using Amazon AppFlow and AWS...

Feed: AWS Partner Network (APN) Blog. Author: Srinivas Kesanapally. By Andries Engelbrecht, Solution Architect at Snowflake ComputingBy Srinivas Kesanapally, Principal Partner Solution Architect at AWS...

View Article

Image may be NSFW.
Clik here to view.

Robins Tharakan: What Postgres SQL causes a Table Rewrite?

Feed: Planet PostgreSQL. While developing SQL based applications, it is commonplace to stumble on these 2 questions: What DDLs would block concurrent workload? Whether a DDL is going to rewrite the...

View Article

Image may be NSFW.
Clik here to view.

ETL vs ELT – What is the Difference?

Feed: Matillion. Author: Richard Thelwell; ELT? Is that a typing mistake? That’s a typical reaction from many data professionals familiar with the acronym ‘ETL’ when they first encounter the...

View Article


Image may be NSFW.
Clik here to view.

Multi-tenant processing pipelines with AWS DMS, AWS Step Functions, and...

Feed: AWS Big Data Blog. Large enterprises often provide software offerings to multiple customers by providing each customer a dedicated and isolated environment (a software offering composed of...

View Article


Image may be NSFW.
Clik here to view.

Building a cost efficient, petabyte-scale lake house with Amazon S3 lifecycle...

Feed: AWS Big Data Blog. The continuous growth of data volumes combined with requirements to implement long-term retention (typically due to specific industry regulations) puts pressure on the storage...

View Article

Announcing Vitess 9

Feed: Planet MySQL; Author: Vitess; On behalf of the Vitess maintainers team, I am pleased to announce the general availability of Vitess 9. In this release, we have focused on making Vitess more...

View Article

Image may be NSFW.
Clik here to view.

Percona XtraBackup 8 Enables –lock-ddl by Default

Feed: Planet MySQL; Author: MySQL Performance Blog; Percona XtraBackup 8.0.23 enables the “lock-ddl” option by default to ensure any DDL events do not corrupt the backups. Any DML events continue to...

View Article


Image may be NSFW.
Clik here to view.

Bo Peng: Various Ways to Retrieve Pgpool-II’s Statistics

Feed: Planet PostgreSQL.   Pgpool-II is a PostgreSQL cluster management tool. In this post I will explain how to retrieve the cluster statistics from Pgpool-II. There are 3 ways to retrieve cluster...

View Article

Dan Langille: Changing how we record ports which need cache clearing

Feed: Planet PostgreSQL. In this post I’ll talk about how the code intially took the easy way out and how recent changes have tightened that up. In short, the code would raise N messages when just a...

View Article

Image may be NSFW.
Clik here to view.

Building AWS Data Lake visualizations with Amazon Athena and Tableau

Feed: AWS Big Data Blog. Amazon Athena is an interactive query service that makes it easy to analyze data in a data lake using standard SQL. One of the key elements of Athena is that you only pay for...

View Article

What is Teradata Unity and Why Do You Need It?

Feed: Teradata Blog. A data warehouse is a centralized repository of business data coming from varied sources. It’s a process of collecting and managing huge amounts of data into one comprehensive...

View Article



Ryan Lambert: Partition OpenStreetMap data in PostGIS

Feed: Planet PostgreSQL. By Ryan Lambert — Published February 16, 2021 This post continues my quest to explore Postgres native partitioning and determine if it is a good fit for my OpenStreetMap data...

View Article

Image may be NSFW.
Clik here to view.

Online DDL in Vitess

Feed: Planet MySQL; Author: Vitess; Vitess introduces a new way to run schema migrations: non-blocking, asynchronous, scheduled online DDL. With online DDL Vitess simplifies the schema migration...

View Article

Image may be NSFW.
Clik here to view.

Make way for the High Performance Parallel Dump & Load Utilities + How to use...

Feed: Planet MySQL; Author: Andrew Grimo; MySQL-Shell has had a set of “Util” object functions for almost a year as of this post. It is this added functionality that negates any reason someone would...

View Article

Lætitia AVROT: Simply auditing your database changes

Feed: Planet PostgreSQL. This is something a lot of people want: being able to track changes happening on their database when and who ordered them. Well, I have good news, my friends, there is a native...

View Article


Image may be NSFW.
Clik here to view.

Analyzing Freshdesk data using Amazon EventBridge and Amazon Athena

Feed: AWS Compute Blog. Author: Benjamin Smith. This post is written by Shashi Shankar, Application Architect, Shared Delivery Teams Freshdesk is an omnichannel customer service platform by Freshworks....

View Article

Image may be NSFW.
Clik here to view.

Build a data lake using Amazon Kinesis Data Streams for Amazon DynamoDB and...

Feed: AWS Big Data Blog. Amazon DynamoDB helps you capture high-velocity data such as clickstream data to form customized user profiles and online order transaction data to develop customer order...

View Article

Marco Slot: Citus 10: Columnar for Postgres, rebalancer, single-node, & more

Feed: Planet PostgreSQL. Development on Citus first started around a decade ago and once a year we release a major new Citus open source version. We wanted to make number 10 something special, but I...

View Article


Image may be NSFW.
Clik here to view.

How to Get Real-Time SAP Data into Amazon Redshift with HVR

Feed: AWS Partner Network (APN) Blog. Author: Ganesh Suryanarayanan. By Ganesh Suryanarayanan, Sr. Partner Solutions Architect – SAP at AWSBy Andre Reiger, Director, Field and Marketing at HVRBy Josh...

View Article


Image may be NSFW.
Clik here to view.

Archiving Amazon MSK Data to Amazon S3 with the Lenses.io S3 Kafka Connect...

Feed: AWS Partner Network (APN) Blog. Author: Darragh O’Flanagan. By Darragh O’Flanagan, Sr. Partner Solutions Architect at AWSBy Guillaume Aymé, Director Marketing, at Lenses.io As a stream processing...

View Article

MySQL Transaction Scope

Feed: Planet MySQL; Author: Michael McLaughlin; The idea of ACID transactions are a basic feature of SQL’s individual Data Manipulation Language (DML) commands, like the INSERT, UPDATE, and DELETE...

View Article

Image may be NSFW.
Clik here to view.

How to migrate your data from the MySQL Database Service (MDS) to MDS High...

Feed: Planet MySQL; Author: Tony Darnell; How to migrate your data from the MySQL Database Service (MDS) to MDS High Availability March 31, 2021 Leave a comment On March 31st, 2021, MySQL introduced a...

View Article

Image may be NSFW.
Clik here to view.

Avinash Vallarapu: Setting up Streaming Replication in PostgreSQL 13 and...

Feed: Planet PostgreSQL. While migrating to PostgreSQL, some of the users may be curious about the type of replication offered by PostgreSQL. Some might want to know if they have to pay any additional...

View Article


Image may be NSFW.
Clik here to view.

Real-Time Big Data Analytics: How to Replicate from MySQL to Hadoop

Feed: Planet MySQL; Author: Continuent; First off: Happy 15th birthday, Hadoop! It wasn’t an April Fool’s joke then, and it isn’t today either: Hadoop’s initial release was on the 1st of April 2006 As...

View Article

Image may be NSFW.
Clik here to view.

Online DDL with Group Replication In Percona Server for MySQL 8.0.22 (and...

Feed: Planet MySQL; Author: Marco Tusa; While I was working on my grFailOver POC, I have also done some additional parallel testing. One of them was to see how online DDL is executed inside a Group...

View Article


Image may be NSFW.
Clik here to view.

Online DDL with Group Replication Percona Server 8.0.22 (and MySQL 8.0.23)

Feed: Planet MySQL; Author: Marco Tusa; While I was working on my grFailOver POC, I have also done some additional parallel testing. One of them was to see how online DDL are executed inside a Group...

View Article

Atomic DDL

Feed: MariaDB Knowledge Base Article Feed. Author: . In MariaDB 10.6.1 we have improved readability for DDL (Data Definition Language) operations to make most of them atomic, and the rest crash-safe,...

View Article


Image may be NSFW.
Clik here to view.

Online DDL: why FOREIGN KEYs are not supported

Feed: Planet MySQL; Author: Vitess; This post explains the inherent problem of running online schema changes in MySQL, on tables participating in a foreign key relationship. We’ll lay some ground rules...

View Article

David Christensen: Devious SQL: Dynamic DDL in PostgreSQL

Feed: Planet PostgreSQL. Supporting PostgreSQL DBAs is an important part of daily life here at Crunchy Data. I’ve recently run across a few use cases where utility queries based on the current state of...

View Article

Image may be NSFW.
Clik here to view.

MySQL Table DDL file with phpMyAdmin

Feed: Planet MySQL; Author: Joshua Otwell; If you need a structure only .sql file of a MySQL tables’ Data Definition Language (DDL), phpMyAdmin makes this super-easy with just a few clicks. Continue...

View Article

Nikolay Samokhvalov: Three Cases Against IF NOT EXISTS / IF EXISTS in...

Feed: Planet PostgreSQL. What is this about?# Many DDL statements in PostgreSQL support modifiers IF EXISTS / IF NOT EXISTS. For example: test=# create table if not exists mytable();CREATE TABLEtest=#...

View Article


Online DDL with Group Replication In MySQL 8.0.27

Feed: Planet MySQL; Author: Marco Tusa; Last April 2021 I wrote an article about Online DDL and Group Replication. At that time we were dealing with MySQL 8.0.23 and also opened a bug report which did...

View Article

Browsing latest articles
Browse All 275 View Live