Azure DataLake

Azure DataLake 

Azure DataLake is microsoft's big data platform and is very similar to other distributed processing and storage system like hadoop or google bigquery. 

DataLake has two different part 

• DataLake Store - Platform that provides unstructured storage (file storage, any format)
• DataLake Analytics - This can have the structure storage which is ready for running structured query like SQL. We use USQL to query DataLake.

Steps to create DataLake Store

• Login to Azure Portal
• Click on +new from left top menu.
• Select Data+Analytics and you will get list.
• Click on Azure Data Lake Store
• Fill in all the required details in the new window as shown below and click on create.

Setting up user permission for DataLakeStore

From all resource menu click on the newly created DataLake store.

On the menu click on Access control and select user and group from AD to provide necessary access as shown below.

To provide access to users to upload files and data follow the below step

• Once you click on the given datalake store on the menu click on the Data Explorer option.
• You will get a new window where click on Access and add required users provide different types of accesses like read, write, execute etc.

You can use the web URL and ADL URI to upload files and data using web interface or any application or ETL package like SSIS.