Data Engineer - Python/SQL (3-6 yrs)

Job Description :

We are seeking a talented Data Engineer to join our dynamic team in Bangalore or Chennai. The ideal candidate will have a strong background in data engineering, particularly in Google Cloud Platform (GCP), and will be responsible for designing and implementing data solutions that enable data-driven decision-making across the organization.

Key Responsibilities :

- Data Pipeline Development: Design, develop, and maintain robust data pipelines using GCP services such as Dataflow, Dataproc, and BigQuery to ensure efficient data processing and transformation.

- ETL Processes: Implement ETL processes to extract, transform, and load data from various sources into data warehouses, ensuring data integrity and quality.

- Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.

- Performance Optimization: Monitor and optimize data workflows and queries for performance and efficiency, ensuring scalability and reliability of data systems.

- Documentation: Create and maintain comprehensive documentation for data pipelines, processes, and data models to ensure clarity and facilitate knowledge sharing within the team.

- Data Governance: Ensure compliance with data governance policies and best practices, including data security and privacy considerations.

Key Skills :

- Proficiency in Google Cloud Platform (GCP) services, specifically BigQuery, Dataflow, and Dataproc.

- Strong programming skills in Python for data processing and automation tasks.

- Solid experience in writing complex SQL queries for data manipulation and analysis.

- Familiarity with data modeling and data warehousing concepts.

- Understanding of ETL processes and tools, with experience in building and optimizing ETL workflows.

- Excellent analytical and problem-solving skills, with a keen attention to detail.

- Strong communication skills to collaborate effectively with cross-functional teams.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 3+ years of experience as a Data Engineer or in a similar role.

Benefits :

- Competitive salary and performance-based bonuses.

- Opportunities for continuous learning and professional development.

- A collaborative and innovative work environment.