Data Engineer

Job Title: Junior Data Engineer (Python, Spark, Scala)

Location: Hyderabad

Experience: 0-2 Years

Industry: IT Services / Data Engineering / Software Development

Job Description:

We are looking for a passionate and motivated Junior Data Engineer with a strong foundation in Python, Spark, and Scala. As part of our growing team, you will contribute to the design, development, and deployment of data processing systems that scale to meet the needs of our clients.

If you are eager to apply your skills in a dynamic environment and work with cutting-edge technologies, this role is perfect for you!

Key Responsibilities:

• Collaborate with cross-functional teams to understand data requirements and design data solutions.
• Write and optimize high-performance Spark applications using Python and Scala for data processing tasks.
• Develop and maintain scalable data pipelines for large-scale data ingestion and transformation.
• Perform data profiling and data quality checks to ensure the integrity of the data.
• Troubleshoot and resolve data processing issues and optimize workflows.
• Stay up-to-date with emerging technologies and best practices in data engineering.

Required Skills:

• Strong programming skills in Python and Scala.
• Hands-on experience with Apache Spark for large-scale data processing.
• Good understanding of data structures, algorithms, and problem-solving.
• Ability to work with large datasets and experience in data wrangling.
• Strong communication skills and the ability to work in a collaborative environment.
• Enthusiasm for learning new technologies and methodologies in data engineering.

Preferred Skills (Nice to Have):

• Exposure to cloud platforms like AWS, Azure, or Google Cloud.
• Knowledge of SQL and relational databases.
• Experience with Hadoop ecosystem tools (Hive, HBase, etc.) is a plus.

Educational Qualifications:

• Bachelors degree in Computer Science, Engineering, or related field.
• Freshers or candidates with 0-2 years of relevant experience are welcome to apply.