Senior Data Engineer - Python/Hadoop (2-4 yrs)

Job Title : Data Engineer (2-4 Years Experience)

Location : Indore, Madhya Pradesh

Company : Golden Eagle IT Technologies Pvt. Ltd.

Job Description :

Golden Eagle IT Technologies Pvt. Ltd. is seeking a skilled Data Engineer with 2 to 4 years of experience to join our team in Indore. The ideal candidate will have a strong background in data engineering, big data technologies, and cloud platforms. You will work on designing, building, and maintaining efficient, scalable, and reliable data pipelines.

Key Responsibilities :

- Develop and maintain ETL pipelines using tools like Apache Airflow, Spark, and Hadoop.

- Design and implement data solutions on AWS, including services such as DynamoDB, Athena, Glue Data Catalog, and SageMaker.

- Work with messaging systems like Kafka to manage data streaming and real-time data processing.

- Utilize Python and Scala for data processing, transformation, and automation.

- Ensure data quality and integrity across multiple sources and formats.

- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.

- Optimize and tune data systems for performance and scalability.

- Implement best practices for data security and compliance.

Preferred Skills (Plus Points) :

- Experience with infrastructure as code tools like Pulumi.

- Familiarity with GraphQL for API development.

- Experience with machine learning and data science workflows, especially using SageMaker.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 2-4 years of experience in data engineering or a similar role.

- Proficiency in AWS cloud services and big data technologies.

- Strong programming skills in Python and Scala.

- Knowledge of data warehousing concepts and tools.

- Excellent problem-solving and communication skills.