Azure Data Engineer ( Sr Engineer, Module Lead, Tech Lead )

Requirements:

We are seeking an experienced Azure Data Engineer with over 4 to 13 years of proven expertise in Data lakes, Lake house, Synapse Analytic, Data bricks, Tsql, sql server, Synapse Db, Data warehouse and should have work exp in ETL, Data catalogs, Meta data, DWH, mpp systems, OLTP, and OLAP systems with strong communication skills.

The ideal candidate should have:

Key Responsibilities:

• Create Data lakes from scratch, configure existing systems and provide user support
• Understand different datasets and Storage elements to bring data
• Have good knowledge and work experience in ADF, Synapse Data pipelines
• Have good knowledge in python, Py spark and spark sql
• Implement Data security at DB and data movement layers
• Should have experience in ci/cd data pipelines
• Work with internal teams to design, develop and maintain software Qualifications & Key skills required:
• Expertise in Datalakes, Lakehouse, Synapse Analytics, Data bricks, Tsql, sql server, Synapse Db, Data warehouse
• Hands-on experience in ETL, ELT, handling large volume of data and files.
• Working knowledge in json, parquet, csv, xl, structured, unstructured data and other data sets
• Exposure to any Source Control Management, like TFS/Git/SVN
• Understanding of non-functional requirements
• Should be proficient in Data catalogs, Meta data, DWH, mpp systems, OLTP, and OLAP systems
• Experience in Azure Data Fabric, MS Purview, MDM tools is an added advantage
• A good team player and excellent communicator