Senior Data Engineer- AWS & Snowflake

Position: Senior Data Engineer (AWS+Snowflake)

Purpose of the Position: We are seeking a highly skilled Data Engineer to join our AI team. As a Data Engineer, the candidate will be responsible for ensuring the reliability, efficiency, and scalability of the client’s data systems, supporting both real-time and batch processing needs, and collaborating with cross-functional teams to provide actionable insights from our data and supporting various Data Science initiatives.

Location: Bangalore

Type of Employment: Full-time

Key Result Areas and Activities:

• Delivery Support – Work on integrating data from various sources, both internal and external, into a centralized data platform. Develop ETL/ELT processes to cleanse, transform, and load data into the desired formats and structures. Manage data infrastructure, optimize data systems, establish data governance policies, and ensure compliance with data privacy regulations.
• Collaboration – Collaborate with cross-functional teams such as analysts, data scientists, scrum master, platform team, and business stakeholders. Provide technical guidance and ensure effective communication to deliver successful data engineering/data science projects.
• Generic Reusable Components – Support the development of generic template-based components with a view to make them reusable across the organization for different customers and solutions.
• Share and Build Expertise – Play an active role in COEs by delivering on different initiatives such as POCs, and POVs. Share expertise through Yammer posts and training sessions. Provide recruitment support by taking interviews.
• Continuous Improvement – Keep up with the latest trends and technologies in the data engineering field. Focus on continuous learning, and evaluating new tools, frameworks, and techniques to enhance the organization's data engineering capabilities.

Essential Skills:

• Good expertise on AWS tech stack and Snowflake
• Proficiency in Python, and SparkSQL
• Experience in creating data pipeline and performance optimization
• Design, build, and maintain robust and scalable data pipelines

Desirable Skills:

• Familiarity with AI
• Knowledge of sensor data and event stream processing technologies
• Experience with Dataiku and other AI tools
• Experience with or knowledge of Agile Software Development methodologies
• Familiarity with continuous integration/continuous deployment (CI/CD) practices

Qualifications:

• At least 7 years of IT experience; minimum 5 years of relevant experience on Data Engineering projects
• Bachelor's degree in computer science, engineering, or a related field (Master’s degree is a plus)
• Certifications on AWS, Snowflake, and Dataiku will be an added advantage

Qualities:

• Can influence and implement change; demonstrates confidence, strength of conviction and sound decisions
• Able to consult, write, and present persuasively
• Able to work in a self-organized and cross-functional team
• Able to iterate based on new information, peer reviews, and feedback
• Able to work seamlessly with clients across multiple geographies
• Research-focused mindset