AmbitionBox
Search
Jobs
- Reviews
- Salaries
- Interview Questions
- About Company
- Benefits
- Jobs
- Office Photos
- Community
Add office photos
Engaged Employer
i
This company page is being actively managed by
ProLegion Team. If you also belong to the team, you
can get access from
here
ProLegion
Compare
All Filters
14 ProLegion Jobs
Data engineering Lead
ProLegion
posted 2d ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
Job Summary
The Data Engineering Lead role requires a highly skilled individual with deep technical expertise in building and optimizing scalable data solutions, leading teams, and driving innovation. The candidate will work on designing data pipelines, managing cloud infrastructure, optimizing performance, and collaborating with cross-functional teams to deliver data-driven insights
Key Skills Required
Technical Expertise
Proficiency in Apache Spark (Core, SQL, Streaming) for large-scale data processing.
Strong experience with Hive for querying and managing structured data.
Expertise in Trino (Presto) for federated queries and SQL execution.
Programming skills in Python, especially with PySpark and Pandas.
Hands-on knowledge of AWS Glue (ETL jobs, Data Catalog, Crawlers).
Familiarity with data formats like Parquet, ORC, and Avro.
Cloud & Infrastructure
Experience with AWS services: S3, Redshift, Athena, EMR, DynamoDB, and Lambda.
Ability to design cost-efficient and scalable cloud-based solutions.
Performance Optimization
Optimizing Spark jobs, Hive queries, and Trino workloads.
Advanced techniques like partitioning, bucketing, and query tuning.
Leadership & Collaboration
Proven ability to lead and mentor teams.
Strong communication skills for working with technical and non-technical stakeholders.
Preferred Skills
Experience with Kafka or Kinesis for real-time streaming.
Familiarity with Docker and Kubernetes for containerization.
Knowledge of CI/CD pipelines and DevOps practices.
Experience with data lake architectures and ML workflow integration.
Certifications & Experience
8+ years of data engineering experience, with 2+ years in a leadership role.
Bachelors/Masters degree in Computer Science, Data Engineering, or related fields.
AWS certifications like AWS Certified Data Analytics or AWS Certified Solutions Architect are a plus.
Role Focus Areas
Build scalable ETL/ELT pipelines.
Manage cloud infrastructure and optimize performance.
Ensure data quality, security, and compliance.
Stay updated on industry trends and implement innovations.
This role demands a balance of hands-on technical skills and leadership to drive high-impact data engineering solutions.
MANDATORY WFO IN BENGALURU.
, Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Data Engineering Lead roles with real interview advice
What people at ProLegion are saying
What ProLegion employees are saying about work life
based on 6 employees
Flexible timing
Monday to Friday
No travel
Day Shift
ProLegion Benefits
View more benefits
Compare ProLegion with
TCS
Compare
Accenture
Compare
Wipro
Compare
Cognizant
Compare
Capgemini
Compare
HDFC Bank
Compare
Infosys
Compare
ICICI Bank
Compare
HCLTech
Compare
Tech Mahindra
Compare
Genpact
Compare
Teleperformance
Compare
Concentrix Corporation
Compare
Axis Bank
Compare
Amazon
Compare
Jio
Compare
iEnergizer
Compare
Reliance Retail
Compare
IBM
Compare
LTIMindtree
Compare
Similar Jobs for you
Share an Interview