Engineering Data Mesh in Azure Cloud Implement Data Mesh Using Microsoft Azure's Cloud Adoption Framework
Prior knowledge of managing centralized analytical systems, as well as experience with building data lakes, data warehouses, data pipelines, data integrations, and transformations is needed to get the most out of this book
| Main Author: | |
|---|---|
| Format: | eBook |
| Language: | English |
| Published: |
Birmingham
Packt Publishing, Limited
2024
|
| Edition: | 1st edition |
| Subjects: | |
| Online Access: | |
| Collection: | O'Reilly - Collection details see MPG.ReNa |
Table of Contents:
- Landing zone deployment
- Self-service portal
- Customized templates
- Summary
- Chapter 7: Building a Self-Service Portal for Common Data Mesh Operations
- Why do we need a self-service portal?
- Gathering requirements for the self-service portal
- Requesting a data product zone
- Browse and reuse pipeline
- Data discovery
- Access management
- Requesting landing zones or data products
- Data catalog
- Hosting common data pipeline templates
- Azure Data Factory
- Azure Data Factory instance
- Integration runtime
- Creating linked services
- Create a sequence of activities
- Streamlining deployment through DevOps
- Summary
- Chapter 4: Building the Data Mesh Governance Framework Using Microsoft Azure Services
- Data mesh governance requirements
- Data catalog
- Collecting and managing metadata
- Step 1
- ensure accuracy and completeness
- Step 2
- verify data classification
- Step 3
- add a business glossary
- Step 4
- add lineage information
- Monitoring and managing data quality
- Implementing data observability
- Summary
- Chapter 5: Security Architecture for Data Meshes
- Understanding the security requirements of data mesh architecture
- Building the technology stack
- The analytics team
- Data governance
- Approaches to building your data mesh
- Summary
- Chapter 3: Deploying a Data Mesh Using the Azure Cloud-Scale Analytics Framework
- Introduction to Azure CSA
- Understanding landing zones
- Organizing resources
- Designing a cloud management structure
- Hierarchical policies
- Diving deeper into landing zones in CSA
- Data management landing zone
- Data landing zone
- Automating landing zone deployment
- IaC
- Organizing resources in a landing zone
- Networking topologies
- Security and access control
- Cover
- Title Page
- Copyright
- Dedication
- Contributors
- Table of Contents
- Preface
- Part 1: Rolling Out the Data Mesh in the Azure Cloud
- Chapter 1: Introducing Data Meshes
- Exploring the evolution of modern data analytics
- Discovering the challenges of modern-day enterprises
- DaaP
- Data domains
- The data mesh solution
- Summary
- Chapter 2: Building a Data Mesh Strategy
- Is a data mesh for everybody?
- Aligning your analytics strategy with your business strategy
- Understanding data maturity models
- Stage 1
- Stage 2
- Stage 3
- Stage 4
- Understanding authentication and authorization in Azure
- Managing data access
- SQL Database
- Data lakes
- Data lake structure
- Managing data privacy
- Data masking
- Data retention
- Summary
- Chapter 6: Automating Deployment through Azure Resource Manager and Azure DevOps
- Azure Resource Manager templates for landing zones
- Understanding the ARM template structure
- Source code control for ARM templates
- Azure DevOps pipelines for deploying infrastructure
- Base data product templates
- T-shirt sizing
- Landing zone requests
- Landing zone approval