Senior Data Engineer - Azure Data Factory/DataLake (5-7 yrs)

About the job :

Position : Data Engineer (Urgent)

Location : Koramangala, Bangalore

Role Type : Contract

Years of Experience : 5 to 7 Years

Job Description :

Must Have :

- In-depth skills with Azure Data Factory, Data Lake, Procedures & Complex functions with the ability to configure and administrate all aspects of MySQL.

- Expert level knowledge Data bricks.

- Expert level knowledge of SQL DB & Data warehouse.

- Expert-level knowledge of Azure Data Factory.

- Experience in Architecture understanding, Azure Storage, Azure SQL DB/DW, Data Factory, Databricks

- Analyze and understand complex data and flow across the system.

- Architect and design solutions to meet functional and non-functional requirements.

- Design of Pipeline to migrate data from source to target system - for full & incremental load.

- Creating/Designing stored procedures, functions to meet the ad-hoc requirements.

- Design and implementation of modern data solutions( like Data Lake, Data warehouse, Real-time data ingestion, and analytics).

Plus Points :

- Proficiency in Python : Strong proficiency in Python programming language with a focus on data manipulation, transformation, and extraction.

- Ability to write efficient, clean, and well-documented code.

- Data Transformation : Proficiency in data transformation techniques using Python libraries like pandas, NumPy, or PySpark.

- Ability to clean, normalize, aggregate, and enrich data to meet business requirements.

- Evaluate and recommend tools, technologies, and processes to be used by the engineering team, to meet both functional non-functional requirements in the product