Название: Practical Data Mesh: Building Decentralized Data Architectures with Event Streams
Автор: Adam Bellemare
Издательство: Confluent, Inc.
Год: 2022
Язык: английский
Формат: pdf (true)
Размер: 10.9 MB
What Is Data Mesh? Data mesh is a concept that ensures data access, governance, federation, and interoperability across distributed teams and systems. It is a new approach for designing modern data architectures, based on four principles. The software industry has always been susceptible to trends. Some stick, some pass, but all vie for the limelight in one way or another. Agile, SOA, cloud, data lakes, microservices, DevOps, and event streaming have all had a fundamental effect on the software we build today. Data mesh may well be the next innovation we can add to this list. I see it as a kind of microservices for data architecture. Part technology and part practice, this socio-technical theory aims to let large, interconnected organizations avoid putting all their data into one single place: a pattern that can lead to paralysis. In a data mesh, different applications, pipelines, databases, storage layers, etc., are instead connected through self-service data products, creating a network, or “mesh,” of data that has no central point where teams are forced to wait in line or step on each other’s toes. Such problems plague the monolithic application and the monolithic data warehouse alike.