Senior Data Engineer - Python/Spark (6-10 yrs)

Data Engineer

Mode : Work from Home

Experience : 6+year

Shift Timing : 2PM to 10PM

Must have : Python, Spark, React, AWS

Job Description :

- I would like to request a new resource for the data Engineering team who will be aligned with the human capital analytics team.

I would like to have the resource with following skill sets :

- Previous experience as a data engineer or in a similar role

- Technical expertise with data models, data mining, segmentation techniques. Preferred DBT experience.

- Experience into programming languages (e.g. Java and Python) is preferred.

- Experience into React.

- Proficient in SQL with Prior experience working with data exploration and data drill down.

- Data engineering certification in AWS cloud practitioner is preferred.

Roles and Responsibilities :

- Design, develop, maintain, and deploy data and ETL pipeline solutions using Apache Airflow, Kubernetes, Python (RESTful server side APIs) stacks and cloud services (AWS)

- Build algorithms and prototypes

- Contribute to the implementation of data architecture(s) and data model design

- Develop solutions that leverage existing frameworks and libraries, align with the overall company architecture and vision

- Participate in architecture discussions and help shape the overall direction of Terminus platforms

- Work in a team environment using Agile project approaches

- Maintain documentation related to data architecture standards, protocols, frameworks, technique, and opportunities for documentation improvement

- Explore ways to enhance data quality and reliability

- Actively develops skills, knowledge, and abilities to maintain currency with new developments in data architecture, as well as related areas such as data integration, application programming interfaces, and data management