Data Engineer - Python/SQL (4-8 yrs)

Job Description :

Roles and Responsibilities :

- Expertise in Python and SQL, with a strong emphasis on writing highly efficient, optimized queries and scalable scripts.

- Extensive experience with Google Cloud Platform (GCP) services, particularly BigQuery, Cloud Composer (Apache Airflow), Dataproc, and Google Cloud Storage (GCS) for large-scale data processing and orchestration.

- Proven expertise in data migration, specifically transitioning from Teradata to modern cloud data warehouses like BigQuery, ensuring seamless data transformation, validation, and high-performance loading processes.

- Comprehensive understanding of ETL/ELT workflows and data modeling principles, with a strong focus on designing efficient and scalable cloud-based data architectures.

- Proficiency in CI/CD tools such as Jenkins and GitLab, facilitating automated deployments, continuous integration, and robust version control.

- Fundamental knowledge of distributed computing frameworks, including Apache Spark, to support large-scale data processing.

- Strong analytical and problem-solving skills, with the ability to troubleshoot complex data pipeline challenges while working effectively in a collaborative, cross-functional team environment.