Lead Data Engineer

Job Summary

The Lead Data Engineerplays a critical role in designing and delivering scalable data solutions while leading and mentoring team members to grow the Data practice. This position requires a balance of technical expertise, leadership, and a strong focus on collaboration with onsite teams.

The ideal candidate will inspire and guide team members, foster a culture of learning, and drive the adoption of best practices to elevate the capabilities of the Data practice. This role also includes ensuring timely handoffs and maintaining strong relationships with global stakeholders.

Responsibilities

Implement large size, complex data engineering projects.

Define and execute the data engineering strategy for the organization.

Collaborate with leadership to align data initiatives with business goals.

Evaluate and implement new technologies and methodologies.

Ensure the scalability, reliability, and security of data solutions.

Lead the design and development of scalable and robust data architectures.

Collaborate with cross-functional teams to define data strategy and requirements.

Optimize and tune data pipelines for performance and efficiency.

Recommend and deploy data models and solutions for existing data systems.

• Lead and mentor team members to enhance their technical skills and achieve their professional goals.
• Establish and promote best practices in data engineering, fostering a culture of excellence and continuous improvement and continuous improvement
• Drive the development of the Data practice by upskilling team members and creating knowledge-sharing initiatives.

Minimum and Preferred Qualifications

Education

• Bachelors degree in Computer Science, Information Technology, or related fields.
• Masters degree or PhD in Computer Science or Software Engineering preferred.

Experience

• 810 years of experience in data engineering or related fields.
• Strong background in programming languages like Python, Java, or Scala, T-SQL. C#experience is desirable.
• Hands-on experience with big data technologies such as Spark, Hadoop, and Kafka.
• Expertise in data modeling, ETL processes, and data integration workflows.
• Advanced knowledge of Azure data solutions ( Azure Synapse, Datalake,Azure Synapse Analytics, Data Factory, Logic Apps)
• Working knowledge of data models of ERP or CRM. ( e.g: D365, Salesforce, SAP, Oracle etc)
• Expertise in Master Data Management: understanding Design Patterns, Data management and Governance principles
• Experience developing Meta data driven solutions
• Experience working with APIs, On-prem databases, File Systems, SharePoint.
• Power BI experience is desirable