Data Engineer - PySpark / Hadoop

We are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team.

The ideal candidate will have a strong background in data engineering, with specific expertise in Oracle to BigQuery data warehouse migration and modernization. This role requires proficiency in various data engineering tools and technologies, including BigQuery, DataProc, GCS, PySpark, Airflow, and the Hadoop ecosystem.

Key Responsibilities :

- Oracle to BigQuery Migration: Lead the migration and modernization of data warehouses from Oracle to BigQuery, ensuring seamless data transfer and integration.

- Data Engineering: Utilize BigQuery, DataProc, GCS, PySpark, Airflow, and Hadoop ecosystem to design, develop, and maintain scalable data pipelines and workflows.

- Data Management: Ensure data integrity, accuracy, and consistency across various systems and platforms.

- SQL Writing: Write and optimize complex SQL queries to extract, transform, and load data efficiently.

- Collaboration: Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions that meet business needs.

- Performance Optimization: Monitor and optimize data processing performance to ensure efficient and reliable data operations.

Skills and Qualifications :

- Proven experience as a Data Engineer or similar role.

- Strong knowledge of Oracle to BigQuery data warehouse migration and modernization.

- Proficiency in BigQuery, DataProc, GCS, PySpark, Airflow, and the Hadoop ecosystem.

- In-depth knowledge of Oracle DB and PL/SQL.

- Excellent SQL writing skills.

- Strong analytical and problem-solving abilities.

- Ability to work collaboratively with cross-functional teams.

- Excellent communication and interpersonal skills.

Preferred Qualifications :

- Experience with other data management tools and technologies.

- Knowledge of cloud-based data solutions.

- Certification in data engineering or related fields.

Location - Pune,Noida.