Senior Data Engineer (3-5 yrs)

Experience : 3-5Y+

Skills :

- 2Y+ exp in Spark, Scala & Big data Frameworks.

- 1Y+ exp in Redshift AWS.

- Version GIT / JIRA.

Location : Bangalore.

Preferred Location : Bangalore.

Job Mode : Hybrid (1day wfo).

Notice : 30 days.

Responsibilities :

- Design, develop, and implement scalable and efficient big data solutions using Spark, Scala, and other relevant frameworks.

- Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.

- Develop and maintain data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse.

- Optimize data processing performance and ensure data quality and integrity.

- Troubleshoot and resolve technical issues related to big data systems and applications.

- Stay updated on the latest advancements in big data technologies and best practices.

Required Skills and Qualifications :

- 3 to 5 years of experience in big data engineering with a strong foundation in Spark, Scala, and other big data frameworks.

- At least 2 years of hands-on experience with Spark and Scala for data processing and analysis.

- 1 year of experience working with Redshift on AWS.

- Proficiency in version control systems like Git and project management tools like Jira.

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration skills.

- Ability to work independently and as part of a team.

- Passion for learning new technologies and staying up-to-date with industry trends.

Preferred Skills :

- Experience with cloud platforms like AWS, GCP, or Azure.

- Knowledge of SQL and data warehousing concepts.

- Familiarity with machine learning and data science techniques.

- Experience with real-time data processing and streaming technologies.