Data Engineer - DWH, PySpark, Python, RESTful API & AWS Service.

We are Hiring Data Engineers at Coforge.

Job Type: Full-time

Job Location: Bangalore.

Please share your CV to Gaurav.2.Kumar@coforge.com or WhatsApp 9667427662 for any queries.

About the Role:-

We are seeking a highly skilled and experienced Data Engineer to join our team in Bangalore or Noida. The ideal candidate will have a strong background in developing ETL pipelines, building data processing analytics applications, and working with cloud-based data solutions, specifically AWS. This role requires a minimum of 5 years of professional software engineering experience, with a focus on big data and distributed systems.

Experience Required:- 5 to 8 Years

JD:-

Key Responsibilities:-

* Design, develop, and maintain robust and scalable ETL pipelines for large datasets.
* Develop data processing and analytics applications using PySpark and Python.
* Build and deploy applications on AWS, utilizing services related to storage, compute, ETL, Data Warehousing (DWH), analytics, and streaming.
* Implement and maintain distributed storage and processing solutions.
* Work with both SQL and NoSQL databases, writing and optimizing queries (SQL, HQL, etc.).
* Develop applications that consume RESTful APIs.
* Ensure data quality and integrity throughout the data lifecycle.
* Collaborate with data scientists and other stakeholders to understand data requirements.

Required Skills and Qualifications:-

* 6+ years of professional software engineering experience, with a focus on data engineering.
* Extensive experience in developing ETL pipelines for big data.
* Strong proficiency in PySpark and Python for distributed data processing.
* Hands-on experience with AWS services for storage, compute, ETL, DWH, analytics, and streaming.
* Solid understanding of distributed storage, processing, and scalable applications.
* Experience with SQL and NoSQL databases and query languages (SQL, HQL).
* Experience with RESTful API consumption.

Preferred Skills (Special Consideration Given For):-

* Experience with container orchestration systems (e.g., Kubernetes).
* Experience with enterprise-grade ETL tools.
* Experience with Adobe Experience Cloud solutions.
* Knowledge of Web Analytics or Digital Marketing.
* Experience with Google Cloud Platform (GCP).
* Experience with Data Science, Machine Learning (ML), Artificial Intelligence (AI), R, or Jupyter notebooks.