5 Hunarstreet Senior Data Engineer Jobs

Responsibilities :

- Design, develop, and maintain scalable and efficient data pipelines using Databricks, Spark (Scala and Python), and SQL.

- Implement and manage Lakehouse architectures to support data warehousing and data lake functionalities.

- Utilize AWS or Azure cloud services for data storage, processing, and deployment.

- Integrate and leverage OpenSearch for search and analytics capabilities.

- Optimize data pipelines and queries for performance and efficiency.

- Design and implement data models that support business requirements.

- Implement and enforce coding standards and best practices for data engineering.

- Identify and resolve data pipeline and infrastructure issues.

- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

- Provide technical guidance and mentorship to junior engineers (as needed).

- Create and maintain comprehensive documentation for data pipelines and infrastructure.

Required Skills and Experience :

- 10+ years of experience in data engineering.

- Strong proficiency in Databricks, Spark (Scala and Python), and SQL.

- Deep understanding of Lakehouse architectures.

- Hands-on experience with AWS or Azure cloud services.

- Experience with OpenSearch.

- Solid understanding of data modeling, data warehousing, and ETL/ELT processes.

- Excellent problem-solving and troubleshooting skills.

- Strong communication and collaboration skills.

- Ability to work independently and as part of a team.

- Bachelor's degree in Computer Science, Engineering, or a related field.

Preferred Qualifications :

- Experience with data governance and data quality tools.

- Experience with CI/CD pipelines for data engineering.

- Experience leading small teams