AEP - Data Engineer

Role & responsibilities

AEP - Data Engineer

Job Location Bangalore

Skills:

6+ years of professional software engineering mostly focused on the following:

Developing ETL pipelines involving big data.

Developing data processing\analytics applications primarily using PySpark.

Experience of developing applications on cloud(AWS) mostly using services related to storage, compute, ETL, DWH, Analytics and streaming.

Clear understanding and ability to implement distributed storage, processing and scalable applications.

Experience of working with SQL and NoSQL database.

Ability to write and analyze SQL, HQL and other query languages for NoSQL databases.

Proficiency is writing disitributed & scalable data processing code using PySpark, Python and related libraries.

Experience of developing applications that consume the services exposed as ReST APIs. Special Consideration given for:

Experience of working with Container-orchestration systems like Kubernetes.

Experience of working with any enterprise grade ETL tools.

Experience & knowledge with Adobe Experience Cloud solutions.

Experience & knowledge with Web Analytics or Digital Marketing.

Experience & knowledge with Google Cloud platforms.

Experience & knowledge with Data Science, ML/AI, R or Jupyter.

Job Description:

Develop low level design as per approved Tech Specification or equivalent inputs provided.

Build and deliver technology deliverables as per Tech Specifications/low level design or equivalent inputs.

Build and delivery technology deliverables compliant with functional requirements.

Build and deliver technology deliverables in accordance with the best practices to ensure compliance with non-functional aspects like scalability, maintainability, performance etc.

Process technology deliverables through full development lifecycle.

Maintain and support existing solutions and technology frameworks.

Attend regular scrum events of equivalent and provide update on the deliverables.

Work independently with none or minimum supervision.

Preferred candidate profile

Perks and benefits