In my other posts you learned how ABN AMRO makes data available in a data mesh style architecture. In this blogpost you will learn about how to break big data monoliths apart.
Data-driven decision-making shift
In the years since data warehouses became a commodity, much has changed. Distributed systems have gained great popularity, data is larger and more diverse, new database designs have popped up, and the advent of cloud has separated compute and storage for increased scalability and elasticity. …
With this blogpost it’s my pleasure to offer you the chance to have a look at the cool initiatives that we do at ABN AMRO. I want to emphasize that our Data Integration Architecture pertains to a common problem area. The ideas that are discussed in this article are not restricted to only ABN AMRO and are non-industry specific. The audience is anyone with an interest in data: data architects, data engineers, solution designers, data professionals, etc.
The architecture that we have developed helps our architects, engineers and solution designers to pick the right building blocks for delivering value for…
At ABN AMRO, we are quite familiar with a data mesh. As a matter of fact, we’ve been working on this new type of architecture for quite some time. 4 years ago, our data journey started. With this blogpost it is my pleasure to let you peek deeper inside.
The term data mesh was originally coined by Zhamak Dehghani. It describes a paradigm shift from traditional data architectures, like enterprise data warehouses and data lakes, towards a modern distributed architecture, using concepts like Domain-Driven Design, platform- and self-service thinking, and treating data as products.
One of the biggest problems many…
This article consolidates a large amount of content from the book Data Management at Scale. This content didn’t make it to the final book, because various external reviewers found it unchallenging. So, if you believe you have a good understanding of data management already, the content discussed in this article might sound familiar. However, I have noticed that less mature data professionals find the data integration part and context perspectives, difficult to digest. Therefore I decided to make this content freely available to all of my followers.
Data Integration is considered to be part of data management, but since data…
The content of this blogpost builds up on my previous article: Data Integration and Data Modelling demystified and consolidates a large amount of content from the book Data Management at Scale. This content didn’t make it to the final book, because various external reviewers found it unchallenging. So, if you believe you have a good understanding of data and database management already, the content discussed in this article might sound familiar.
A crucial application component that I haven’t dived deep into the previous article is the application data layer, or database layer, of the application. The values or data of…
Data warehousing and business intelligence play an important role in many, if not, all of the large sized organizations working on turning data into insights that drive meaningful business value. Data warehousing is process for collecting and managing data from varied sources to provide meaningful business insights. Business intelligence comprises the strategies and technologies used for providing these insights. Both areas can be considered part of data management. They are heavily intertwined with the other data management areas and depend a lot on data integration.
Data warehousing became popular during the nineties and started as a common practice to collect…
When I published the ABN AMRO’s Integration Architecture article, I quickly mentioned ‘Service Orientation’ as one of the three integration patterns of our DIAL integration architecture. Spending only 10 lines about this pattern isn’t fair, since within ABN AMRO we have an entire program running named ‘SOA 2.0’. With this blogpost I want to dive a little bit deeper into our vision at how ABN AMRO sees the future ‘Service Oriented Architecture’.
Since SOA is a widely used concept, let’s start with my understanding of Service Oriented Architecture (SOA) first:
- SOA is about exposing ‘functionality’ through web services. Some people…
Kubernetes is an open-source system for automating deployments, scaling, and management of containerized applications, which are written in languages such as PHP, NodeJS, Python or any other. This tutorial is a personal attempt to package and run Laravel (PHP Framework) using Docker and deploy it on Kubernetes. In this tutorial I’m using Minikube, which is a tool that makes it easy to run Kubernetes locally. Minikube runs a single-node Kubernetes cluster inside a Virtual Machine on your laptop or computer. It is intended for users who are looking to try out Kubernetes or develop with it day-to-day. In this tutorial…
I’m a huge fan of Laravel and like to code whenever I have some spare time. More recently I also started with VueJS, which is definitely making more sense when you want to offer a very rich and dynamic user experience. One of my biggest challenges has been to combine both the VueJS Router and Laravel routing concepts. I wanted to use the Laravel back-end and authentication methods provided, but I also wanted to use VueJS for some more dynamic parts. We can of course add the VueJS template and script elements to every blade we create, but the result…
