Home
Communities
Companies
- Companies
  
  Discover best places to work
- Compare Companies
  
  Compare & find best workplace
- Add Office Photos
  
  Bring your workplace to life
- Add Company Benefits
  
  Highlight your company's perks
Reviews
- Company reviews
  
  Read reviews for 6L+ companies
- Write a review
  
  Rate your former or current company
Salaries
- Browse salaries
  
  Discover salaries for 6L+ companies
- Salary calculator
  
  Calculate your take home salary
- Are you paid fairly?
  
  Check your market value
- Share your salary
  
  Help other jobseekers
Interviews
- Company interviews
  
  Read interviews for 40K+ companies
- Campus placements
  
  Interviews questions for 1K+ colleges
- Share interview questions
  
  Contribute your interview questions
Jobs
Awards

RATE NOW!
- ABECA 2025
  
  RATE NOW!
  
  AmbitionBox Employee Choice Awards - 4th Edition
- ABECA 2024
  
  AmbitionBox Employee Choice Awards - 3rd Edition
- AmbitionBox Best Places to Work 2022
  
  2nd Edition
- AmbitionBox Best Places to Work 2021
  
  1st Edition

Add office photos

Engaged Employer

Synechron

Compare

3.6

based on 2.7k Reviews

130 Synechron Jobs

Big Data Engineer

Synechron

3.6

based on 2.7k Reviews

3-8 years

Pune

1 vacancy

Big Data Engineer

Synechron

posted 2d ago

Job Role Insights

Flexible timing

Key skills for the job

Computer Science Data Analytics Automation Testing Operations Information Technology Analytical Chemistry

+ 4 more

Job Description

We are seeking an experienced Big Data Engineer to spearhead the design, development, and implementation of robust big data solutions. The ideal candidate will have extensive experience with HDFS, Spark, Scala, and related technologies, along with a strong understanding of data processing frameworks and architectures.

Architecture & Design: Lead the design and architecture of big data solutions using HDFS, Spark with Scala, and other technologies to meet business requirements.
Team Leadership: Mentor and guide a team of data engineers, providing technical direction and ensuring successful project delivery.
Data Processing: Develop and optimize data processing workflows using Apache Spark and Scala, ensuring high performance and scalability.
Database Management: Utilize HBase and SQL for efficient data storage, retrieval, and management, and manage data ingestion using Sqoop.
Automation & Scripting: Write shell scripts and Java code for automation tasks and data processing.
Collaboration: Work closely with cross-functional teams, including data scientists and analysts, to understand data requirements and translate them into effective solutions.
Documentation: Create and maintain clear technical documentation, including architecture diagrams, data flow diagrams, and operational procedures.
Performance Tuning: Evaluate existing big data infrastructures and identify opportunities for optimization and cost reduction.
Optional Technologies: Integrate optional technologies such as Apache Kafka, Akka HTTP, TeamCity, and Autosys as needed.

Technical Skills:

Primary Skills:

HDFS: Proficient in Hadoop Distributed File System for data storage and processing.
Spark with Scala: Strong experience in using Apache Spark with Scala for big data processing.
Scala (Functional Programming): In-depth understanding of functional programming concepts in Scala.
HBase: Experience with HBase for NoSQL database solutions.
SQL: Proficient in writing SQL queries for data manipulation and analysis.
Sqoop: Familiarity with Sqoop for data ingestion from relational databases.
Shell Scripting: Ability to write shell scripts for automation and data processing.
Java (Core): Solid understanding of core Java concepts for data manipulation tasks.

Optional Skills:

Apache Kafka: Experience with Kafka for real-time data streaming.
Akka HTTP: Knowledge of Akka HTTP for building RESTful APIs.
TeamCity: Familiarity with TeamCity for continuous integration and deployment.
U-deploy: Knowledge of U-deploy for deployment automation.
Autosys: Experience with Autosys for job scheduling and automation.
SBT: Familiarity with Scala Build Tool (SBT) for building Scala projects.

Good to Have:

Pivotal Gemfire: Experience with Pivotal Gemfire for in-memory data grid solutions.

Experience:

At least 5+ years of experience in big data engineering, with a focus on data processing and analytics.
Proven track record of designing and implementing big data solutions in a production environment.
Experience leading technical teams and mentoring junior engineers.

Day-to-Day Activities:

Lead daily stand-up meetings and project planning sessions.
Develop, test, and maintain data processing workflows and pipelines.
Collaborate with data scientists and product managers to define data requirements and objectives.
Monitor data processing jobs and troubleshoot issues as they arise.
Review code from team members and provide constructive feedback to ensure adherence to best practices.
Stay current with emerging technologies and trends in big data and analytics.

Qualifications:

Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
Relevant certifications in big data technologies are a plus.

Soft Skills: