Senior Data Engineer

Our growing Team is in need of a Senior / Lead Data Engineer, to support Vibrents data-driven approach to health, as we explore data from multiple disparate sources to discover patterns and hidden insights.

Were looking for candidates who thrive in professional, strategic and innovative user-focused environments, and who are committed to delivering quality products and/or services. The candidate must be able to think independently, analyze, troubleshoot and resolve complex business and technical problems.

You will work with very large, complex, cloud-based scientific datasets and help identify and answer questions that will shape scientific studies. The work that you do will contribute to improving the health of people across the nation.

You will be responsible for developing, Optimizing and maintaining code and data pipelines.

Role and Responsibilities:

• Design, code, test, debug, document, and implement changes to new and existing software applications
• Implement processes that verify, standardize, and scale data ingestion, transformation and storage
• Automate recurring ETL and reporting jobs
• Perform application testing to assure delivery meets the users requirements
• Refine new or existing data pipelines for performance tuning
• Evolve proof of concept reports and analyses in Python to make them into reusable, high-value analytics products
• Collaborate with the Data Analysts, Application Developers, Report Developers, Product Manager and other stakeholders to provide visibility into the data layer and data pipelines
• Identify opportunities to leverage data and create innovative analytic solutions
• Collaborate with product management and engineering team members to understand company needs and devise possible solutions
• Keep up-to-date with latest technology trends
• Work as a team member in a highly creative and collaborative environment

Required Skills and Education:

• Educational Background:
• Bachelors Degree with 6+ years of experience or equivalent.
• Technical Skills:
• Python 3: Extensive, advanced knowledge for data management and analytics.
• ETL, Data Warehousing, and BI: Good experience in these areas.
• SQL Database: Good knowledge and experience.
• AWS Services: Working experience required.
• SQL and NoSQL Databases: Significant experience.
• Soft Skills:
• Problem Solving and Logical Reasoning: Strong skills required.
• Analytical Skills: Strong analytical abilities.
• Communication Skills: Strong verbal and written communication skills.
• Critical Thinking and Self-Starter: Must be a critical thinker and self-starter.
• Adaptability: Willingness to learn new technology tools.
• Work Environment: Ability to work in the fast-paced nature of a high-growth organization.
• Desirable Skills:
• Experience with Tools: Dagster, Meltano, DBT, Metabase.
• Warehouse Solutions: Experience with Snowflake.
• Kubernetes and Docker: Experience is beneficial.
• Jupyter Notebooks: Experience is advantageous.