Название: Azure Data Engineering: Real-time, streaming, and batch analytics (MEAP Version 8)Автор: Richard L. Nuckolls
Издательство: Manning Publications
Год: 2020
Формат: true pdf/epub
Страниц: 326
Размер: 24.2 Mb
Язык: English
Azure Data Engineering teaches you to build high-capacity data analytics systems using Azure cloud services for storing, collecting, and analyzing data. In it, seasoned IT professional and author Richard Nuckolls starts you off with an overview of core data engineering tasks and the Azure tools that support them. Then, you’ll dive right into building your analytics system, starting with Data Lake Store for data retention, Azure Event Hubs for high-throughput ingestion, and Stream Analytics for real-time query processing.
For batch scheduling and aggregate data movement, you’ll add Data Factory and Data Lake Analytics, along with SQL Data Warehouse for interactive queries. With Azure Active Directory, you’ll manage security by applying permissions and access roles. And because your design is based on the Lambda architecture, you can be sure it will handle large volumes of data beautifully and with lightning speed!
what's inside
Azure cloud services architecture
Building a data warehouse in Azure
How to choose the right Azure technology for your task
Calculating fixed and variable costs
Hot and cold path analytics
Stream processing with Azure Stream Analytics and Event Hub integration
Giving structure to distributed storage
Practical examples leading up to a fully functioning analytics system