Zimetrics Technologies - Scala & Big Data Engineer - Spark/Hadoop (4-6 yrs)

Job Summary :

We are seeking a skilled Scala & Big Data Engineer to join our team in Pune. The ideal candidate will have expertise in Scala programming and Big Data technologies, with hands-on experience in designing and implementing data processing pipelines. This role offers an exciting opportunity to work with cutting-edge technologies in a dynamic environment.

Key Responsibilities :

- Develop and maintain scalable data processing pipelines using Scala.

- Work with Big Data frameworks such as Spark, Hadoop, or similar to manage large-scale data processing.

- Collaborate with data scientists and analysts to optimize data workflows and models.

- Implement best practices for data ingestion, transformation, and storage.

- Ensure data quality, security, and compliance across all data solutions.

- Troubleshoot and resolve performance bottlenecks in data processing pipelines.

- Stay updated on emerging technologies in the Big Data and Scala ecosystem.

Required Skills and Qualifications :

- Strong programming skills in Scala.

- Hands-on experience with Big Data frameworks such as Apache Spark, Hadoop, HDFS, etc.

- Proficient in working with distributed systems and data processing workflows.

- Experience with SQL and NoSQL databases (e.g., Cassandra, MongoDB, or HBase).

- Knowledge of cloud platforms such as AWS, GCP, or Azure is a plus.

- Familiarity with data streaming tools like Kafka or Flink.

- Strong problem-solving and debugging skills.

- Excellent communication and team collaboration skills.

Preferred Qualifications :

- Experience with data warehousing tools such as Snowflake, Redshift, or BigQuery.

- Knowledge of DevOps tools and CI/CD pipelines for data solutions.

- Familiarity with Agile development methodologies.