AmbitionBox
Jobs
- Reviews
- Salaries
- Interview Questions
- About Company
- Benefits
- Jobs
- Office Photos
- Community
Add office photos
All Filters
823 Luxoft Jobs
Lead BigData Lead Engineer
Luxoft
posted 13hr ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
Were looking for a Big Data Lead Engineer to:
Engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using cloud (Azure) data platform infrastructure effectively.
Transform data into valuable insights that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques.
Develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems.
Ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements.
Build observability into our solutions, monitor production health, help to resolve incidents, and remediate the root cause of risks and issues.
Understand, represent, and advocate for client needs.
Codify best practices, methodology and share knowledge with other engineers in UBS
Shape the Data and Distribution architecture and technology stack within our new cloud-based datalake-house.be a hands-on contributor, senior lead in the big data and data lake space, capable to collaborate and influence architectural and design principles across batch and real time flows
Have a continuous improvement mindset, who is always on the look out for ways to automate and reduce time to market for deliveries
Must have
Your Expertise
Experience in building Data Processing pipeline using various ETL/ELT design patterns and methodologies to Azure data solution, building solutions using ADLSv2, Azure Data factory, Databricks, Python and PySpark.
Experience with at least one of the following technologies: Scala/Java or Python
Deep understanding of the software development craft, with focus on cloud based (Azure), event driven solutions and architectures, with key focus on Apache Spark batch and streaming, Datalakehouses using medallion architecture. Knowledge of DataMesh principles is added plus.
Ability to debug using tools Ganglia UI, expertise in Optimizing Spark Jobs
The ability to work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate datasets.
Expert in creating data structures optimized for storage and various query patterns for e.g. Parquet and Delta Lake
Experience in traditional data warehousing concepts (Kimball Methodology, Star Schema, SCD) / ETL tools (Azure Data factory, Informatica)
Experience in data modelling atleast one database technology such as:
Traditional RDBMS (MS SQL Server, Oracle, PostgreSQL)
NoSQL (MongoDB, Cassandra, Neo4J, CosmosDB, Gremlin)
Understanding of Information Security principles to ensure compliant handling and management of data
Nice to have
Ability to clearly communicate complex solutions.
Strong problem solving and analytical skills.
Working experience in Agile methodologies (SCRUM)
Languages
English: C1 Advanced
Seniority
Lead
Positive work environments and stellar reputations attract and retain top talent. Find out why Luxoft stands apart from the rest.
Recommend a friendBigData Development
India
Remote India
BigData Development
India
Bengaluru
BigData Development
India
Gurugram
Pune, India
Req. VR-111909
BigData Development
BCM Industry
20/02/2025
Req. VR-111909
Apply for Lead BigData Lead Engineer in Pune
*
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Lead Engineer roles with real interview advice
What people at Luxoft are saying
Rating based on 16 Lead Engineer
reviews
Anonymous · Engineering - Software & QA
in Bangalore / Bengaluru
No cons as of now
- Salary - Good
No dislikes it's pure client centric
- Work satisfaction - Poor
Lead Engineer salary at Luxoft
What Luxoft employees are saying about work life
Luxoft Benefits
Friendly Environment Global Relocation Luxoft Training Center Recognition and Evaluation Mentoring Program 
Health Insurance 
Work From Home 
Soft Skill Training 
International Relocation 
Job Training 
Compare Luxoft with
Accenture
EPAM Systems
GlobalLogic
LTIMindtree
Mphasis
Persistent Systems
TCS
Wipro
Synechron
Movate
Sopra Steria
SS&C TECHNOLOGIES
HTC Global Services
Unisys
Tietoevry
TEKsystems
Collabera Technologies
Wipro Digital
Allianz Technology
ThoughtWorks
Similar Jobs for you
Luxoft Pune Office Location
411057
