Open in app

Sign In

Write

Sign In

Piethein Strengholt
Piethein Strengholt

2.3K Followers

Home

About

Published in Towards Data Science

·Pinned

Data Mesh: Topologies and domain granularity

The past year at Microsoft has been interesting to say the least! I’ve participated countless customer conversations, workshops and architecture design sessions. During these customer interactions, Data Mesh has often been a central subject of debate. What I’ve learned is that data mesh is relatively a new subject. It’s a…

Data

10 min read

Data Mesh: Topologies and domain granularity
Data Mesh: Topologies and domain granularity
Data

10 min read


Published in Towards Data Science

·Pinned

Implementing Data Mesh on Azure

Data mesh is an exciting new approach to designing and developing data architectures. After my first series of articles and more recent materials on data products and data domains, I received queries on explaining what a practical implementation on Azure could look like. I’ll try to answer this question in…

Data

8 min read

Implementing Data Mesh on Azure
Implementing Data Mesh on Azure
Data

8 min read


Published in Towards Data Science

·Pinned

Data Domains and Data Products

Data mesh in practice — All clients I work with are either interested in or planning their next generation of a modern data platform. In this transition, data mesh architecture is gaining a lot of traction. At the same time there are concerns about interpreting this concept: practical guidance is missing. About data mesh Data mesh advocates treating…

Data Mesh

13 min read

Data domains and data products
Data domains and data products
Data Mesh

13 min read


Published in Towards Data Science

·Pinned

Data Domains — Where do I start?

Strategic path towards designing an enterprise-scale data mesh — In all data mesh discussions I have with enterprises the subject of data domains draws most attention. Customers find domain-oriented data ownership the hardest part of data mesh. Often, there is a fundamental lack of understanding of Domain-Driven Design (DDD). Other data practitioners find the conceptual notions of DDD too…

Data Mesh

14 min read

Data Domains — Where do I start?
Data Domains — Where do I start?
Data Mesh

14 min read


Published in Towards Data Science

·Pinned

Data Mesh topologies

Design considerations for building a data mesh architecture — All organizations I work with understand the importance of data and are either interested in or planning their next generation of a modern data platform. Their aim is to move away from tightly coupled data interfaces and varying data flows towards an architecture that allows eco-system connectivity: a cloud distributed…

Data

6 min read

Data Mesh topologies
Data Mesh topologies
Data

6 min read


Jan 13

Medallion architecture: best practices for managing Bronze, Silver and Gold

Numerous customers I work with use a Medallion architecture in which they logically organize data in a Lakehouse. As data flows in, they process data through several stages or layers. The most well-known design, as seen below, uses a Bronze, Silver, and Gold layer. Hence, the word “medallion”. Although the…

Data

8 min read

Medallion architecture: best practices for managing Bronze, Silver and Gold
Medallion architecture: best practices for managing Bronze, Silver and Gold
Data

8 min read


Nov 11, 2022

Using DBT for building a Medallion Lakehouse architecture (Azure Databricks + Delta + DBT)

There’s a lot of fuzz going around the data build tool (DBT). It gains a lot of traction from the data community. I’ve seen several customers and projects, where DBT is already chosen as the tool to be used. But what it is? Where can you position DBT in your…

Databricks

17 min read

Using DBT for building a Medallion Lakehouse architecture (Azure Databricks + Delta + DBT)
Using DBT for building a Medallion Lakehouse architecture (Azure Databricks + Delta + DBT)
Databricks

17 min read


Oct 18, 2022

Best practices for Purview and a federated way of working

Many organizations consult me about how I see Microsoft Purview in relation to data mesh or a federated way of working. They ask me about sharing best practices for establishing a domain-oriented architecture. Let’s explorer in this blogpost how Purview can support your data governance ambitions. Introduction Purview is Microsoft’s unified…

Azure

10 min read

Best practices for Purview and a federated way of working
Best practices for Purview and a federated way of working
Azure

10 min read


Jun 11, 2022

Feature stores and data mesh

One of my customers asked me a question: what is your view on features stores? And how to position them in the data mesh paradigm? My view: I’m no big fan of centralized or shared feature stores. They add unnecessary complexity to your architecture. Each individual analytical use case is…

Data Mesh

1 min read

Data Mesh

1 min read


Apr 1, 2022

Designing a metadata-driven processing framework for Azure Synapse and Azure Purview

In the blogpost Modern Data Pipelines, you learned about data pipelines and some of their difficulties. You also read up on an approach by binding Azure Synapse Analytics and Azure Purview in order to build a framework for intelligently processing data. In this article I want to take the data…

Azure

9 min read

Designing a metadata-driven processing framework for Azure Synapse and Azure Purview
Designing a metadata-driven processing framework for Azure Synapse and Azure Purview
Azure

9 min read

Piethein Strengholt

Piethein Strengholt

2.3K Followers

Hands-on data management professional. Working @Microsoft.

Following
  • Netflix Technology Blog

    Netflix Technology Blog

  • Natan Silnitsky

    Natan Silnitsky

  • David Luecke

    David Luecke

  • Lionel Martin

    Lionel Martin

  • Hao Yi Ong

    Hao Yi Ong

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech