Category Archives: Google Cloud

Data Engineering on Google Cloud – Automated Data replication approach from Cloud SQL to Big Query using Python

Google Cloud has some rich features and products w.r.t SQL when your apps are built on MySQL or PostgreSQL. But If you have a requirement to replicate the data and schema from Cloud SQL(SQL Server) to Big Query then the options are limited. Reasons: Google Cloud Data Flows doesn’t support Cloud SQL(SQL Server) as Source as per official docs Big

Read more

Data Engineering on Google Cloud- python docker cloud SQL for sqlserver

Feeling good to be back blogging again!! I was recently fortunate to have got a chance to work on Google cloud and i found it super interesting!!! Hence the urge to start writing again. Hope this is useful for anyone looking for a serverles data engineering solution on GCP. Google cloud offers 3 flavors of SQL PostgreSQL, MySQL and SQL

Read more