Designing and managing data pipelines that extract data from various sources, transform it into a usable format, and load it into a DB.
Building and maintaining data storage systems that can manage large amounts of data.
Establishing processes and checks to ensure data accuracy, completeness, and consistency.
Developing and maintaining data models to facilitate efficient data analysis and reporting.
Ensuring that the infrastructure used to store and process data is scalable, reliable, and secure.
Working closely with the application development team and provide necessary data infrastructure required for them.
Keeping abreast of new technologies and techniques in data engineering and incorporating them into the organisation s data infrastructure as appropriate.
Qualifications:
Bachelor s Degree in Computer Science, Information Technology, or a related field (or equivalent experience).
Excellent troubleshooting and problem-solving abilities.
Strong communication and collaboration skills, with the ability to work effectively across teams.
Project management experience with the ability to handle multiple tasks and deadlines.
Proven experience in database management, data warehousing, and ETL processes.
Strong problem-solving and analytical skills.
Preferred Skills: .
Prior experience in database management.
Proficiency in SQL and Python.
Strong experience in data warehousing, ETL processes, and cloud-based data storage solutions.