Data Engineering

We are seeking a highly skilled and experienced Senior Data Engineer to join our team. This role will be instrumental in designing, developing, and maintaining our data infrastructure, ensuring the effective processing and analysis of large datasets. The ideal candidate will have a strong background in data modeling, data architecture, and experience with a variety of data technologies.

Key Responsibilities:

Design and implement robust data pipelines, ETL processes, and data warehouses to support our analytics and reporting needs.
Develop and maintain data models, schemas, and metadata to ensure data quality and consistency.
Collaborate with data scientists, analysts, and business stakeholders to understand their requirements and translate them into technical solutions.
Optimize data pipelines for performance and scalability to handle large volumes of data.
Stay up-to-date with the latest data technologies and trends to drive innovation and efficiency.

Responsibilities
Design, develop, and maintain scalable data architectures, pipelines, APIs, and integrations.
Create and optimize data models to support efficient data processing and storage.
Manage and maintain databases, including Postgres, SSIS, ensuring data integrity and performance.
Develop, deploy, and manage ETL and EDI processes.
Develop and maintain scripts and applications using Python for data processing and analysis.
Ensure data security and compliance with relevant regulations and best practices.
Leverage cloud services (e.g., Azure, AWS) for data storage, processing, and analytics.
Collaborate with cross-functional teams to gather requirements and provide data-driven insights.
Implement and manage caching solutions to improve data retrieval speeds.
Create and maintain comprehensive documentation for all data processes and architectures.
Utilize data visualization tools to create interactive dashboards and reports for stakeholders.

Qualifications
Bachelors degree in Computer Science, Information Systems, Data Science, or a related field (or equivalent work experience).
Minimum of 5 years of experience in data engineering or a related field.
Proficiency in data modeling, data architecture, and database management with Postgres or SSIS..
Experience with electronic medical records (EMRs) and understanding of the healthcare industry is strongly desired.
Strong SQL skills and experience with common ETL tools.
Proficiency in Python for data processing and automation.
Experience with common caching solutions (e.g., Redis, Memcached).
Expertise in data security best practices and regulatory compliance.
Hands-on experience with cloud platforms like Azure and AWS.
Proficiency with data visualization tools such as Power BI, Tableau, or similar.
Excellent problem-solving skills and ability to troubleshoot data issues effectively.
Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to non-technical stakeholders.

Desired Skills
Knowledge of data warehousing concepts and methodologies.
Experience with Agile/Scrum methodologies.
Familiarity with Power BI administration and deployment.