DataTech India - Senior Data Engineer - Spark/Hadoop (5-9 yrs)

As a Data Engineer, you will be responsible for developing applications and systems that utilize AI tools and Cloud AI services.

Roles & Responsibilities :

- Design, develop, and maintain data pipelines and ETL processes to support data science and machine learning workflows.

- Implement and maintain data storage solutions, including data lakes, data warehouses, and NoSQL databases.

- Collaborate with data scientists and machine learning engineers to understand their requirements and provide scalable solutions.

- Create and maintain documentation for data pipelines, ETL processes, and data storage solutions. Professional & Technical Skills:

Must To Have Skills :

- Experience with data engineering tools and technologies such as Apache Spark, Hadoop, and SQL.

Must To Have Skills :

- Experience with cloud-based data storage and processing services such as AWS S3, Redshift, and EMR.

Good To Have Skills :

- Experience with AI tools and technologies such as TensorFlow, Keras, and Pyspark, SSIS, Python , Big data

- Strong understanding of data modeling, data warehousing, and data governance principles.

- Experience with data visualization tools such as Tableau or Power BI.

- Candidate should have a minimum of 6 years of experience in Data Engineering.

- The ideal candidate will possess a strong educational background in computer science, data science, or a related field, along with a proven track record of delivering impactful data-driven solutions.