Add office photos
Engaged Employer
i
This company page is being actively managed by
Encora Team. If you also belong to the team, you
can get access from
here
Encora
Compare
All Filters
203 Encora Jobs
Data Engineer (Test & Scale)
Encora
posted 14d ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
The Data Engineer will play a vital role in ensuring the integrity, performance, and scalability of data pipelines and platforms in the data modernization project. This role focuses on building testing frameworks, automating data validation processes, and optimizing system performance using tools like Apache Spark. The engineer will collaborate closely with the QA Lead, DBA/DB Migration Specialist, and ETL Specialist to maintain high-quality data workflows while contributing to the scalability of the data platform
Responsibilities and Duties
- Testing Framework Development & Data Validation:
- Design and implement automated testing frameworks for validating data pipelines and transformations.
- Integrate tools like Great Expectations to enforce data quality standards and ensure consistency across systems.
- Conduct performance and validation tests for migrated data to identify discrepancies and maintain integrity.
- Performance Optimization & Scalability:
- Use Apache Spark to optimize data transformation workflows for scalability and efficiency.
- Monitor and enhance pipeline performance to meet system throughput and latency benchmarks.
- Collaborate with the Data Architect to implement strategies for scaling the data platform to handle future growth.
- Collaboration & Alignment:
- Work closely with the QA Lead to align testing frameworks with project quality assurance processes.
- Collaborate with the DBA/DB Migration Specialist to validate database performance and identify opportunities for optimization.
- Support the ETL Specialist by providing insights on performance bottlenecks and scalability improvements.
- Monitoring & Issue Resolution:
- Develop and implement monitoring solutions to proactively identify and resolve data processing issues.
- Support ongoing system performance analysis and make recommendations for resource optimization.
- Documentation & Knowledge Sharing:
- Create comprehensive documentation for testing frameworks, validation procedures, and scalability improvements.
- Share best practices and lessons learned with the team to enhance overall project execution.
Qualifications and Skills
- 8+ years of experience in data engineering with a focus on testing frameworks, performance optimization, and scalability.
- Hands-on expertise with Apache Spark for scalable data processing and transformation.
- Experience with data validation tools like Great Expectations and data monitoring frameworks.
- Strong understanding of data architecture principles, particularly within Snowflake and PostgreSQL environments.
- Proven track record of implementing scalable solutions in cloud-native environments, particularly AWS.
- Exceptional attention to detail and commitment to maintaining data integrity and quality.
- Strong collaboration and communication skills to align with cross-functional teams.
- Ability to work independently and manage multiple priorities in a fast-paced environment.
Additional Requirements
- Familiarity with ETL tools like AWS Glue and dbt for data workflows.
- Experience working with orchestration tools like Apache Airflow.
- Knowledge of advanced performance testing techniques for distributed data platforms.
- Strong analytical and problem-solving skills for identifying and resolving data quality issues
Employment Type: Full Time, Permanent
Read full job descriptionEncora Interview Questions & Tips
Prepare for Encora Data Engineer roles with real interview advice
What people at Encora are saying
Rating based on 6 Data Engineer
reviews
Anonymous · Data Science & Analytics
Likes
Company offers permanent wfh
Dislikes
Hikes, employee benefits and work culture
- Skill development - Poor+3 more
Data Engineer salary at Encora
reported by
23
employees
with 2-5
years exp.
₹4
L/yr - ₹15.4
L/yr
13%
less
than the average Data Engineer Salary in India
View more details
What Encora employees are saying about work life
based on 692 employees
Flexible timing
Monday to Friday
No travel
Day Shift
Encora Benefits
Submitted by Company
Job Training Health Insurance Soft Skill Training 
Cafeteria
Submitted by Employees
View more benefits 
Compare Encora with
TCS
Compare
Infosys
Compare
Wipro
Compare
HCLTech
Compare
Tech Mahindra
Compare
LTIMindtree
Compare
Mphasis
Compare
Hexaware Technologies
Compare
Persistent Systems
Compare
Xoriant
Compare
CitiusTech
Compare
HERE Technologies
Compare
BT Business
Compare
HTC Global Services
Compare
Tietoevry
Compare
Unisys
Compare
Slk Software Services
Compare
Altimetrik
Compare
Apexon
Compare
TEKsystems
Compare
Similar Jobs for you
Encora Chennai Office Locations
Chennai Office
2nd floor, Module 7, North Block, Phase 2, IG3 Infra Ltd. IT SEZ, Pallavaram, Thoraipakkam
Chennai
600097
600097
Chennai Office
No. 11, Doxa Business Center, Rattha Tek Tower, OMR Road Thoraipakkam
Chennai 600097, India
Chennai
Support Engineer
3-5 Yrs
Hyderabad / Secunderabad, Pune, Bangalore / Bengaluru
MySQL/MariaDB Administrator
6-11 Yrs
Hyderabad / Secunderabad, Pune, Bangalore / Bengaluru
Share an Interview