S&C Global Network - AI - CG&S - Data Engineer Consultant

Job Title:Industry & Function AI Data Engineer + S&C GN

Management Level:09 - Consultant

Location:Primary - Bengaluru, Secondary - Gurugram

Must-Have Skills:Data Engineering expertise, Cloud platforms:AWS, Azure, GCP, Proficiency in Python, SQL, PySpark and ETL frameworks

Good-to-Have Skills:LLM Architecture, Containerization tools:Docker, Kubernetes, Real-time data processing tools:Kafka, Flink, Certifications like AWS Certified Data Analytics Specialty, Google Professional Data Engineer,Snowflake,DBT,etc.

Job

Summary:

As a Data Engineer, you will play a critical role in designing, implementing, and optimizing data infrastructure to power analytics, machine learning, and enterprise decision-making. Your work will ensure high-quality, reliable data is accessible for actionable insights. This involves leveraging technical expertise, collaborating with stakeholders, and staying updated with the latest tools and technologies to deliver scalable and efficient data solutions.

Roles & Responsibilities:

Build and Maintain Data Infrastructure:Design, implement, and optimize scalable data pipelines and systems for seamless ingestion, transformation, and storage of data.

Collaborate with Stakeholders:Work closely with business teams, data analysts, and data scientists to understand data requirements and deliver actionable solutions.

Leverage Tools and Technologies:Utilize Python, SQL, PySpark, and ETL frameworks to manage large datasets efficiently.

Cloud Integration:Develop secure, scalable, and cost-efficient solutions using cloud platforms such as Azure, AWS, and GCP.

Ensure Data Quality:Focus on data reliability, consistency, and quality using automation and monitoring techniques.

Document and Share Best Practices:Create detailed documentation, share best practices, and mentor team members to promote a strong data culture.

Continuous Learning:Stay updated with the latest tools and technologies in data engineering through professional development opportunities.

Professional & Technical Skills:

Strong proficiency in programming languages such as Python, SQL, and PySpark

Experience with cloud platforms (AWS, Azure, GCP) and their data services

Familiarity with ETL frameworks and data pipeline design

Strong knowledge of traditional statistical methods, basic machine learning techniques.

Knowledge of containerization tools (Docker, Kubernetes)

Knowing LLM, RAG & Agentic AI architecture

Certification in Data Science or related fields (e.g., AWS Certified Data Analytics Specialty, Google Professional Data Engineer)

Additional Information:

The ideal candidate has a robust educational background in data engineering or a related field and a proven track record of building scalable, high-quality data solutions in the Consumer Goods sector.

This position offers opportunities to design and implement cutting-edge data systems that drive business transformation, collaborate with global teams to solve complex data challenges and deliver measurable business outcomes and enhance your expertise by working on innovative projects utilizing the latest technologies in cloud, data engineering, and AI.


Qualifications

Experience:Minimum 3-7 years in data engineering or related fields, with a focus on the Consumer Goods Industry


Educational Qualification:Bachelors or Masters degree in Computer Science, Information Systems, Engineering, or a related field