Data Engineer - Python/Scala (4-7 yrs)

Knowledge/Qualifications/ Technical Competencies :

Knowledge, Skills & Abilities :

- Develop and maintain automated test suites, using Python/Scala/C#

- Hands-on experience in writing scripts in Python/Scala/C#

- Simulate E2E scenarios Data factory, Databricks and SQL Database

- Experience in ETL Testing, Database Testing, Data Quality, System Testing, Test Procedures

- Proficient in SQL, Python, Azure Data Factory and Databricks

- Proficient on CI / CD integration

- Familiar with different data formats Parquet / Json / Delimited Files

- Familiar with Data modeling and Data pipelines concept

- Excellent hands-on experience in test management and defect management with tools like Azure Devops

- Perform manual testing and run automated test cases to verify results.

Good to have exposure on Power BI Report Testing

Job Responsibilities :

- Resource must have good oral and written communication skills and be able to work both independently and within a team framework

- Understand Business requirement and actively provide inputs from Data perspective

- Understand the underlying data and flow of data

- Perform E2E test activities, working closely with data engineers and data scientists on complex and innovative analytics applications.

- Design and perform test plans for testing system back-end components, ensuring product quality and coverage.

Knowledge/Qualifications/ Competency - Desirable :

Bachelor's Degree in Engineering / Computer Science or equivalent experience (Required)