BPMLinks - Data Engineer (3-4 yrs)

Job Overview :

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience working with modern data tools and cloud platforms, ensuring data integrity, efficiency, and security.

Key Responsibilities :

- Design, develop, and maintain data pipelines using DBT, Snowflake, and AWS Glue

- Build and optimize ETL/ELT workflows for efficient data processing.

- Develop and maintain real-time data streaming solutions using Kafka.

- Work with AWS services such as Lambda, S3, Glue, and Redshift for cloud-based data integration.

- Implement data governance, security, and best practices to ensure compliance and efficiency.

- Write efficient, scalable, and maintainable Python code for data transformations and automation.

- Optimize Snowflake performance, including warehouse sizing, query tuning, and cost management.

- Collaborate with data analysts, scientists, and stakeholders to ensure data accessibility and usability.

Required Qualifications :

- Bachelor's/Master's degree in Computer Science, Data Engineering, or a related field

- Strong expertise in Snowflake, DBT, and Kafka for data processing and analytics.

- Experience with AWS services including Glue, Lambda, S3, and IAM.

- Proficiency in Python for data manipulation, automation, and pipeline development..

- Experience with SQL and performance optimization techniques.

- Familiarity with CI/CD pipelines and version control (Git).

- Strong understanding of data warehousing, modeling, and governance best practices.

Preferred Qualifications :

- AWS certifications such as AWS Certified Data Analytics

- Specialty or AWS Certified Solutions Architect/ SnowPro Certification.

- Experience with orchestration tools like Apache Airflow.

- Exposure to Terraform or CloudFormation for infrastructure automation.