Senior Data Engineer (6-10 yrs)

Job Description : You will be a part of our Data Engineering team and will be focused on delivering exceptional results for our clients. A large portion of your time will be in the weeds working alongside your team architecture, designing, implementing, and optimizing data solutions. You'll work with the team to deliver, migrate and/or scale cloud data solutions; build pipelines and scalable analytic tools using leading technologies including AWS, Azure, GCP, Spark, Hadoop, etc.

Responsibilities :

- Develop data pipelines to move and transform data from various sources to data warehouses.

- Ensure the quality, reliability, and scalability of the organization's data infrastructure.

- Optimize data processing and storage for performance and cost-effectiveness.

- Collaborate with data scientists, analysts, and other stakeholders to understand their requirements and develop solutions to meet their needs.

- Continuously monitor and troubleshoot data pipelines to ensure their reliability and availability.

- Stay up-to-date with the latest trends and technologies in data engineering and apply them to improve our data capabilities.

Requirements :

- Bachelor's degree in computer science, Software Engineering, or a related field.

- 6+ years of experience in data engineering or a related field.

- Strong programming skills in Python.

- Expert SQL skills and a good understanding of existing SQL warehouses.

- Familiarity with big data technologies like Hadoop, Spark, or Hive.

- Experience with Orchestration Airflow or Azkaban.

- Experience with Build System Gradle or Maven.

- Strong problem-solving and communication skills.