Big Data Engineer - ETL/HDFS/Hive (6-8 yrs)

Scala Big data Engineer.

Experience : 6-8 Years

Location : Chennai

Job Summary :

We are looking for an experienced Scala Big Data Engineer to develop and optimize data solutions. You will write ETL processes and Spark jobs using Scala or Java, work with GCP services, and implement real-time streaming with Kafka and Spark Streaming. Strong experience with SQL, Hadoop, and Apache Airflow is required.

Key Responsibilities :

- Develop ETL processes and Spark jobs in Scala/Java.

- Work with Apache Spark, Kafka, and Spark Streaming for data processing.

- Manage data workflows using Apache Airflow and Cloud Composer.

- Use GCP tools like BigQuery and DataProc for big data solutions.

- Write optimized SQL queries for data management

Required Skills :

- 6-8 years of experience with Scala, Java, and Apache Spark.

- Strong knowledge of SQL, ETL processes, and Kafka.

- Experience with Hadoop tools (e.g., HDFS, Hive, Sqoop).

- Familiarity with GCP, Airflow, and Cloud Composer.