Building Modern Data Platform in Azure - Useful Resources


The official Azure documentation often takes a siloed approach and misses out more advanced Big Data / Machine Learning end-to-end scenarios. Here is a collection of awesome blog posts on Azure Databricks, Azure Data Factory, Azure Data Lake and other related topics. Understand the bigger picture, build configurable end-to-end pipelines, automate deployment, set up accesses and permissions.

Contributions welcome. Anything missing? Send in a pull request. Thanks!

Understand the Bigger Picture

Intro to Data Lake and Modern Data Platform

Build Pipelines with Azure Data Factory

Azure Databricks - Clean and Transform Data

Azure Databricks - Monitor and Track Data Lineage

Azure Databricks - Delta Lake in Action

Real-Time - Build Event-Based Pipelines

DevOps - Deploy End-To-End Data Pipelines

Security - Users & Accesses

Security - Setup Secure Environment

Interested in Microsoft’s Data & AI? Subscribe to the below blogs!

I'm Valdas Maksimavicius. I write about data, cloud technologies and personal development. You can find more about me here.