Data Engineer

Roles & Responsibilities:

• Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions.
• Work closely with the Enterprise Data Lake delivery and platform teams to ensure that the applications are aligned with the overall architectural and development guidelines
• Ensure data quality and integrity through rigorous testing and monitoring.
• Leverage cloud platforms (AWS, Databricks preferred) to build scalable and efficient data solutions.

• Develop basic understanding of core business problems and find opportunities to use advanced analytics

• Assist in reviewing 3rd party providers for new feature/function/technical fit with EEA's data management needs.

• Work with platform collaborators to ensure effective cost observability and control mechanisms are in place for all aspects of data platform management.
• Familiarity with code versioning using GIT, Jenkins and code migration tools.
• Keen on adopting new responsibilities, facing challenges, and mastering new technologies
• Stay up to date with the latest data technologies and trends.

Basic Qualifications and Experience:

• Masters degree in computer science or engineering field and 0 to 1 years of relevant experience OR
• Bachelors degree in computer science or engineering field and 1 to 3 years of relevant experience OR
• Diploma and Minimum of 5+ years of relevant work experience

Must-Have Skills:

• Experience with common data processing libraries: Pandas, PySpark, SQL Alchemy.
• Experience in UI frameworks (Angular.js or React.js)
• Experience with data lake, data fabric and data mesh concepts
• Experience with data modeling, performance tuning, and experience on relational databases
• Experience building ETL or ELT pipelines; Hands-on experience with SQL/NoSQL

• Program skills in one or more computer languages SQL, Python

• Experience in Cloud technologies AWS preferred.

• Cloud Certifications -AWS, Databricks, Microsoft
• Experienced with software engineering best-practices, including but not limited to version control (Git, GitLab.), CI/CD (GitLab, Jenkins etc.), automated unit testing, and Dev Ops
• Exposure to Jira or Jira Align.
• Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies.

• Knowledge on R language will be considered an advantage

• Experience in Cloud technologies AWS preferred.

• Cloud Certifications -AWS, Databricks, Microsoft

• Familiarity with the use of AI for development productivity, such as GitHub Copilot, Databricks Assistant, Amazon Q Developer
• Knowledge of Agile and DevOps practices.
• Skills in disaster recovery planning.
• Familiarity with load testing tools (JMeter, Gatling).
• Basic understanding of AI/ML for monitoring.
• Knowledge of distributed systems and microservices.
• Data visualization skills (Tableau, Power BI).
• Understanding of compliance and auditing requirements.

Soft Skills:

• Excellent analytical and solve skills
• Excellent written and verbal communications skills
• Ability to work effectively with global teams
• High degree of initiative and self-motivation
• Ability to manage multiple priorities successfully
• Team-oriented, with a focus on achieving team goals
• Strong problem-solving and analytical skills.
• Strong time and task leadership skills to estimate and optimally meet project timeline with ability to bring consistency and quality assurance across various projects.