Data Engineer

Role Description:
Data engineers design, build, and optimize systems for data collection, storage, access, and analytics at scale. They create data pipelines used by data scientists, data-centric applications, and other data consumers.

Job Responsibilities:

• Application Software Development 6: Develop existing applications and contribute to development of new applications by analyzing and identifying areas for modification and improvement. Develop new routine applications to meet customer requirements.
• Design and Conceptualization 5: Research and interpret data, trends, and benchmarks relevant to digital products/services design.
• Product and Solution Development 5: Carry out a range of product development and engineering activities. Use established systems to analyze customer needs and define and deliver products.
• Technical Developments Recommendation 6: Discuss and recommend technical developments to improve the quality of the website/portal/applications software and supporting infrastructure to better meet users needs.
• Applications Software Maintenance 5: Monitor, identify, and correct straightforward software defects to maintain fully functioning applications software.

Responsibilities:
Design, develop, and maintain scalable data pipelines and ETL processes to support data ingestion, transformation, and storage.
Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and deliver high-quality data solutions.
Architect and optimize data models and schemas to support analytical and operational use cases.
Implement data governance and security best practices to ensure data privacy and compliance with regulatory requirements.
Monitor and troubleshoot data pipelines to ensure reliability, performance, and scalability.
Stay abreast of emerging technologies and best practices in data engineering and contribute to continuous improvement initiatives.
Qualifications:
Bachelors or Masters degree in Computer Science, Engineering, or related field.
Minimum of 5 years of experience in data engineering or related roles.
Proficiency in programming languages such as Python, Java, or Scala.
Solid understanding of cloud platforms (e.g., AWS, Azure, GCP) and experience with cloud-based data services (e.g., S3, BigQuery, Redshift).
Experience with Snowflake data platform is a plus.
Experience with PowerBI is a plus.
Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.