Add office photos
i
Cynosure Corporate Solutions
Compare
All Filters
77 Cynosure Corporate Solutions Jobs
Lead Data Engineer
3-10 years
Kolkata, Mumbai, New Delhi + 4 more
1 vacancy
Lead Data Engineer
Cynosure Corporate Solutions
posted 1d ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
- Working with clients to understand their data.
- Based on the understanding you will be building the data structures and pipelines.
- You will be working on the application from end to end collaborating with UI and other development teams.
- You will be working with various cloud providers such as Azure & AWS.
- You will be engineering data using the Hadoop/Spark ecosystem.
- You will be responsible for designing, building, optimizing and supporting new and existing data pipelines.
- Orchestrating jobs using various tools such Oozie, Airflow, etc.
- Developing programs for cleaning and processing data.
- You will be responsible for building the data pipelines to migrate and load the data into the HDFS either on-prem or in the cloud.
- Developing Data ingestion/process/integration pipelines effectively.
- Creating Hive data structures, metadata and loading the data into data lakes / Bigdata warehouse environments.
- Optimized (Performance tuning) many data pipelines effectively to minimize cost.
- Code versioning control and git repository is up to date.
- You should be able to explain the data pipeline to internal and external stakeholders.
- You will be responsible for building and maintaining CI/CD of the data pipelines.
RequirementsPreferred Qualifications:
- Bachelor\u2019s degree in computer science or related field.
- Minimum of 5+ years working experience with Spark, Hadoop eco systems.
- Minimum of 4+ years working experience on designing data streaming pipelines
- Minimum experience of 3+ years on NoSQL and Spark Streaming.
- Proven experience with big data ecosystem tools such as Sqoop, Spark, SQL, API, Hive, Oozie, Airflow, etc..
- Solid experience in all phases of SDLC with 10+ years of experience (plan, design, develop, test, release, maintain and support)
- Hands-on experience using Azure\u2019s data engineering stack.
- Should have implemented projects using programming languages such as Scala or Python.
- Working experience on SQL complex data merging techniques such as windowing functions etc..
- Hands-on experience with on-prem distribution tools such as Cloud-era/Horton Works/MapR.
- Bachelor\u2019s degree in computer science or related field.
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Lead Data Engineer roles with real interview advice
What people at Cynosure Corporate Solutions are saying
What Cynosure Corporate Solutions employees are saying about work life
Cynosure Corporate Solutions Benefits
View more benefits
Compare Cynosure Corporate Solutions with
Team Lease
Quess
Randstad
ManpowerGroup
Kelly Services
Adecco Group
Allegis Group
Gi Group
Iksula
Mafoi Randstad
Canam Consultants
S.M. Consultants
Cheers Interactive
Milliman
Lodha & Company
Brandscapes Worldwide
RedSeer Consulting
BIS Research
Novus Professional Services
RF Managed Services
Similar Jobs for you
Cynosure Corporate Solutions Chennai Office Location
600032
Principle Data Engineer - pyspark
10-14 Yrs
Kolkata, Mumbai, New Delhi +4 more
