Building Modern Data Platform in Azure - Useful Resources

software

The official Azure documentation often takes a siloed approach and misses out more advanced Big Data / Machine Learning end-to-end scenarios. Here is a collection of awesome blog posts on Azure Databricks, Azure Data Factory, Azure Data Lake and other related topics. Understand the bigger picture, build configurable end-to-end pipelines, automate deployment, set up accesses and permissions.

Contributions welcome. Anything missing? Send in a pull request. Thanks!

Understand the Bigger Picture

Intro to Data Lake and Modern Data Platform

Build Pipelines with Azure Data Factory

Azure Databricks - Clean and Transform Data

Azure Databricks - Monitor and Track Data Lineage

Azure Databricks - Delta Lake in Action

Real-Time - Build Event-Based Pipelines

DevOps - Deploy End-To-End Data Pipelines

Security - Users & Accesses

Security - Setup Secure Environment


Interested in Microsoft’s Data & AI? Subscribe to the below blogs!


Interested in posts like this?

I'm Valdas Maksimavicius. I write about data, cloud technologies, personal development and space exploration. Self-reflective content primarily.

Subscribe to get notifications over email. I don't spam - you'll receive about 2 emails per month.