Data Engineer-On premise

Responsibilities:

• Develop data pipelines to move and transform data from various sources to data warehouses

• Ensure the quality, reliability, and scalability of the organization's data infrastructure

• Optimize data processing and storage for performance and cost-effectiveness

• Collaborate with data scientists, analysts, and other stakeholders to understand their requirements and develop solutions to meet their needs
• Continuously monitor and troubleshoot data pipelines to ensure their reliability and availability • Stay up-to-date with the latest trends and technologies in data engineering and apply them to improve our data capabilities

Requirements

• Bachelors degree in computer science, Software Engineering, or a related field

• 6+ years of experience in data engineering or a related field

• Strong programming skills in Python

• Expert SQL skills and a good understanding of existing SQL warehouses

• Familiarity with big data technologies like Hadoop, Spark, or Hive

• Experience with Orchestration Airflow or Azkaban

• Experience with Build System Gradle or Maven

• Strong problem-solving and communication skills