Data Engineer - Adobe Experience Platform (6-9 yrs)

Duration : 6 months

Location : Remote

Timings : Full Time (As per company timings)

Notice Period : Immediate Joiners Only

Experience : 6-9 Years

Role Overview:

We are looking for an experienced AEP Data Engineer to develop and optimize big data processing solutions. The ideal candidate will have expertise in building scalable ETL pipelines, working with cloud-based architectures, and handling large-scale data processing using PySpark and related technologies.

Key Responsibilities :

- Develop and maintain ETL pipelines for large-scale data processing.

- Design and implement scalable data processing applications using PySpark.

- Work with AWS services related to storage, computing, ETL, data warehousing, analytics, and streaming.

- Develop distributed storage and processing systems that ensure high availability and scalability.

- Work with SQL and NoSQL databases, writing and optimizing queries.

- Develop applications that integrate with ReST APIs for seamless data exchange.

Required Skills :

- 6+ years of professional experience in software engineering with a focus on big data processing.

- Strong expertise in PySpark, Python, and data processing libraries.

- Experience working with AWS cloud-based data solutions.

- Strong understanding of distributed computing and scalable architecture principles.

- Hands-on experience with SQL and NoSQL databases.

- Proficiency in writing and optimizing SQL, HQL, and NoSQL queries.

- Experience in integrating data applications with ReST APIs.

Preferred Skills :

- Experience with Kubernetes or container orchestration systems.

- Hands-on experience with enterprise-grade ETL tools.

- Familiarity with Adobe Experience Cloud solutions.

- Knowledge of web analytics or digital marketing platforms.

- Experience with Google Cloud Platform (GCP).

- Exposure to data science, machine learning, AI, R, or Jupyter Notebooks.

Additional Qualities :

- Ability to work independently as well as collaborate effectively within a team.

- Proactive problem solver with strong analytical skills.

- Comfortable working in a dynamic and fast-paced environment.

- Adaptability to changing project requirements and business needs.

- Strong communication skills and attention to detail.