Data Engineering Design Patterns: Scalable data engineering for efficient data systems and workflows (English Edition)
Format:
Paperback
En stock
0.78 kg
Sí
Nuevo
Amazon
USA
- Data engineering has gained even more relevance than before, and data engineering patterns are key to the successful implementation of data engineering projects. This book enables a data engineer to not only become familiar with data engineering patterns but also understand their application in real world use cases.This book presents a comprehensive collection of data engineering patterns, each illustrated with relevant enterprise use cases to highlight their value and simplicity. It showcases both open-source and cloud technologies, guiding readers in building data systems for on-premise and cloud environments. The book covers patterns for data ingestion, transformation, storage, and serving, while also offering insights into performance engineering for data pipelines. Once we understand fundamental data engineering patterns, we then shift focus to patterns that help us build high-performance low latency data systems. We cover data caching, partitioning, replication, and how to select the technology stack for building out the patterns in this book.By the end of the book, readers will have a deep understanding of various data engineering use cases and will be able to map the appropriate patterns to address them. They will also be equipped to choose the right technical stack for implementing these patterns, enabling them to create robust and efficient data systems in a secure and a cost-effective manner.What you will learn● Key data engineering patterns.● Data ingestion and processing patterns.● Modern architectures like Lambda.● Explore time-tested data patterns of ETL and ELT.● Modern data systems like data lake and medallion architectures.● Domain-specific patterns and also on data orchestration, observability, and security.● Overcoming performance challenges in building complex data systems.Who this book is forThis book is designed for data engineers with beginner to intermediate experience in building enterprise-grade data systems. ETL developers transitioning into data engineering roles will also find this book valuable for understanding essential data engineering patterns. The code snippets provided throughout the book are written in Python or Scala, so a basic understanding of either language will help readers more easily grasp the concepts presented.Table of Contents1. Understanding Data Engineering2. Data Engineering Patterns, Terminologies, and Technical Stack3. Batch Ingestion and Processing4. Real-time Ingestion and Processing5. Micro-batching6. Lambda Architecture7. ETL and ELT8. Data Fundamentals9. Databases and Transactional Data10. Data Warehouse and Data Analytics11. Data Lake and Medallion Architecture12. Data Replication and Partitioning13. Hot Versus Cold Data Storage14. Data Caching and Low Latency Serving15. Data Search Patterns16. Domain Specific Patterns17. Data Security Patterns18. Data Observability and Monitoring Patterns19. Idempotency and Deduplication Patterns20. Data Orchestration Patterns21. Common Performance Pitfalls22. Technology and Infrastructure Selection23. Recap and Next Steps
IMPORTÁ FACIL
Comprando este producto podrás descontar el IVA con tu número de RUT
NO CONSUME FRANQUICIA
Si tu carrito tiene solo libros o CD’s, no consume franquicia y podés comprar hasta U$S 1000 al año.