Lead Data Engineer

[Temporary Remote work]

Job Highlights 

• Lead the design, development, and implementation of data pipelines using Python/PySpark, ensuring scalability, reliability, and efficiency. 
• Provide technical leadership in architecting and implementing Azure ETL solutions utilizing Azure services like Blob Storage, Data Lake, Data Factory, and Synapse. 
• Collaborate with cross-functional teams to gather and understand business requirements, translating them into technical specifications. 
• Mentor and guide junior team members in best practices for building and maintaining data pipelines on the Azure platform. 
• Proven ability to work effectively in a collaborative team environment and communicate technical concepts to non-technical stakeholders. 

Job description 

• 8+ years of experience with Data Warehousing for different domains and projects. 
• 5+ years of experience in building data pipelines with Python/PySpark. 
• Professional experience in Azure ETL stack, including Blob Storage, Data Lake, Data Factory, Synapse, Azure Functions, Logic Apps, Azure DevOps, Virtual Machine, etc. 
• 8+ years of experience with SQL, including proficiency in writing complex queries, stored procedures, and functions. 
• Strong understanding of code versioning tools such as GIT and project management tools like Azure DevOps, Jira. 
• Excellent problem-solving and analytical skills with attention to detail. 
• Ensure adherence to coding standards, documentation, and best practices in data engineering. 
• Azure certifications (e.g., Azure Data Engineer Associate) are a plus. 

Role: Lead Data Engineer 

Functional Area: Data 

Employment Type: Full Time, Permanent 

Role Category: Data Engineer 

Education 

UG: B.Sc in Any Specialization, BCA in Any Specialization, B.Tech/B.E. in Any Specialization 

PG: Any Postgraduate