Job Description
Dear Candidate,
Greetings from talent21!!!
We have an urgent opportunity for a Azure Data Engineer (Azure Data Bricks) .
Roles and Responsibilities :
Mandatory - Azure Data Factory , Data Bricks , Data Lake , SQL DW , SQL DB,
- Minimum of 6 to 8 years of overall IT experience
- Working knowledge of Data Warehousing concepts and design (incl. ETL, data modelling & visualization)
- Should have executed at least one end to end azure data lake project (preferably with 1 to 2 years of exp in Azure data platform)
- Experience working with Azure cloud-based environment mainly with delta data lake implementation
- Hands on experience working on SQLDW and SQL DB - Write, modify, tune and debug queries, stored procedures, views, indexes, user-defined functions, and other database entities. Creation of external tables using polybase.
- Azure Data Factory V2 - datasets & linked services, pipeline development, execution & triggers and integration runtimes.
- Azure Databricks (Spark SQL, Python, PySpark - Setting up Databricks Cluster and automation of on demand clusters, Scaling Databricks workflows, Integration of ADF data pipelines with ADB
- Working knowledge of Azure DevOps / VSTS /GitHub, CLI, Storage Explorer and SSMS (sql server management studio)
- Azure Storage Services (Blob & ADLS Gen1/Gen2) - creation use of azure storage, access policies and associated keys, encryption techniques for sharing etc.
Experience : 6 - 8 Years
Notice Period : Immediate to 30 days.
Location : Bhubaneswar, Bangalore, Chennai, Noida, Hyderabad, Pune, Mumbai, Kolkata