Azure Data Lake Storage Gen2 Architecture

Azure data lake storage gen2 also known as adls gen2 is a next generation data lake solution for big data analytics.

Azure data lake storage gen2 architecture.

Azure data lake storage gen1 is an enterprise wide hyper scale repository for big data analytic workloads. Azure data lake storage gen2. Load data into azure data lake storage gen2 with azure data factory. Data lake is a key part of cortana intelligence meaning that it works with azure synapse analytics power bi and data factory for a complete cloud big data and advanced analytics platform that helps you with everything from data preparation to doing interactive analytics on large scale datasets.

9 minutes to read. Azure data lake storage lifecycle management is now generally available. Data lake analytics gives you power to act on. 4 minutes to read 5.

Azure data factory azure synapse analytics preview azure data lake storage gen2 is a set of capabilities dedicated to big data analytics built into azure blob storage it allows you to interface with your data using both file system and object storage paradigms. We recommend that you start using it today. The diagram above shows a reference architecture for the modern data warehouse pipeline built on azure data lake storage gen2 and azure serverless components. Azure data lake storage gen2 builds azure data lake storage gen1 capabilities file system semantics file level security and scale into azure blob storage with its low cost tiered storage high.

For more information see the product page. Azure data lake storage gen2. While there are many benefits in leveraging existing platform components of blobs to create and operate data lakes for analytics it does lead to multiple concepts describing the same shared things. Data from various sources lands in azure data lake storage gen2 via azure data factory and other data movement tools.

Built on azure blob the azure data lake storage gen2 offers capabilities like file system semantics directory file level security low cost tiered storage high availability disaster recovery and scalability. Azure data lake storage gen2 is now generally available. It combines the power of a hadoop compatible file system with integrated hierarchical namespace with the massive scale and economy of azure blob storage to help speed your transition from proof of concept to production. Azure data lake storage gen2 is the world s most productive data lake.

Data lake storage gen2 is an additional capability for big data analytics built on top of azure blob storage. Azure data lake storage immutable storage is now in preview. Azure data lake storage gen2 access control list recursive update in public preview.