Lead Data Engineer

Lead Data Engineer

Job Highlights

• Lead the design, development, and implementation of data pipelines using Python/PySpark, ensuring scalability, reliability, and efficiency.
• Provide technical leadership in architecting and implementing Azure ETL solutions utilizing Azure services like Blob Storage, Data Lake, Data Factory, and Synapse.
• Collaborate with cross-functional teams to gather and understand business requirements, translating them into technical specifications.
• Mentor and guide junior team members in best practices for building and maintaining data pipelines on the Azure platform.
• Proven ability to work effectively in a collaborative team environment and communicate technical concepts to non-technical stakeholders.

Job description

• 8+ years of experience with Data Warehousing for different domains and projects.
• 5+ years of experience in building data pipelines with Python/PySpark.
• Professional experience in Azure ETL stack, including Blob Storage, Data Lake, Data Factory, Synapse, Azure Functions, Logic Apps, Azure DevOps, Virtual Machine, etc.
• 8+ years of experience with SQL, including proficiency in writing complex queries, stored procedures, and functions.
• Strong understanding of code versioning tools such as GIT and project management tools like Azure DevOps, Jira.
• Excellent problem-solving and analytical skills with attention to detail.
• Ensure adherence to coding standards , documentation , and best practices in data engineering.
• Azure certifications (e.g., Azure Data Engineer Associate) are a plus.

Role: Lead Data Engineer

Functional Area: Data

Employment Type: Full Time, Permanent

Role Category: Data Engineer

Education

UG: B.Sc in Any Specialization, BCA in Any Specialization, B.Tech/B.E. in Any Specialization

PG: Any Postgraduate