Category Archives: Data Engineering

Data Engineering on Google Cloud – Automated Data replication approach from Cloud SQL to Big Query using Python

Google Cloud has some rich features and products w.r.t SQL when your apps are built on MySQL or PostgreSQL. But If you have a requirement to replicate the data and schema from Cloud SQL(SQL Server) to Big Query then the options are limited. Reasons: Google Cloud Data Flows doesn’t support Cloud SQL(SQL Server) as Source as per official docs Big

Read more