Data Engineer

Lead the design, development, and deployment of data engineering, cloud, and DevOps solutions.

Collaborate closely with AI engineers to ensure seamless integration between AI models and data pipelines.

Manage cloud infrastructure and services (primarily AWS) to ensure high availability, scalability, and cost-efficiency.

Lead data transformation and analytics initiatives using tools like DBT, SnapLogic, and Fivetran.

Drive continuous integration and continuous delivery (CI/CD) processes through AWS, CloudFormation, and Terraform.

Ensure data processing workflows are optimized and maintainable.

Apply best practices in software engineering to ensure code quality and system stability.

Manage, support, and maintain the cloud infrastructure setup (AWS S3, ECS, ECR, Lambda, Airflow, SNS, SQS, etc).

Actively participate in scaling Agile/Scrum development practices within the team.

Serve as the technical escalation point and mentor for junior engineers and team members.

Essential Skills/Experience8+ years of experience in Data Engineering and Software Engineering.

Significant hands-on experience with Snowflake and AWS services, includingAWS S3, AWS ECS, AWS ECR, AWS Managed Airflow, AWS Lambda, AWS SNS, AWS SQS.

Strong background in CloudOps and DevOps, including infrastructure provisioning, orchestration, and maintenance.

Extensive experience in CI/CD pipelines and automation, using tools like CloudFormation and Terraform.

Proficiency in data transformation and analytics tools, such as DBT, SnapLogic, and Fivetran.

Experience with SQL and NoSQL databases.

Knowledge of Agile and Scrum methodologies.

Proficiency in coding languages such as Java and Python.

Proven track record of hands-on leadership and technical expertise in driving large-scale data and cloud projects.

Preferred SkillsExperience in AI/ML integration into data pipelines.

Advanced problem-solving and troubleshooting skills in a cloud environment.

Ability to work effectively in a collaborative and cross-functional team.

Note Hands-on experience with the above-mentioned tools and technologies is mandatory.