Sr. Azure Data Engineer- 5yrs(Australian Shift)
Hi,We are hiring Azure Data EngineerExperience:- 3.5yrs relevant in DELocation:- Hyderabad and Bangalore and PuneSkills:- Azure, ADF, ADL, ADB, SQL, Pyspark, Python, PLSQL, Data Warehouse, API Development.If interested kindly share your updated resume on ms00883967@techmahindra.comBelow is the Job Description:· Designed Azure ADF pipelines to move data from Open hubs to Azure Data Lake Gen2 and then to Azure Data Warehouse.Developing notebooks and applying transformation using spark SQL in Azure data bricks.Testing the notebook and validating the scripts using SQL.Implemented activities Copy activity, Execute Pipeline, Get Meta data, If Condition, Lookup, Set Variable, Filter, For Each pipeline Activities for On-cloud ETL processing.Load the files to stage tables and then to data warehouse tables in dedicated SQL pool in synapse. Writing views, stored procedures for transformations.Converting views to external tables for direct query for faster retrieval.
