Senior Data Engineer

• Develop data pipelines, databases, and overall data lake architecture
• Design and implement an analytical environment using third-party and in-house tools
• Use Python to improve and automate analytics, ETL, and data quality platform
• Build and deploy complex data models and model metadata
• Create reports and dashboards
• Take ownership of data dashboarding and presentation tools for the end users of our data products and systems
• Conduct and support ingestion and migration of data in multiple types and formats
• Partake in data retrieval, integration, and analysis
• Understand data trends by analyzing collected data to establish facts
• Deploy developed data solutions, user applications, databases, etc
• Work closely with internal and third-party data producers, consumers, and users
• Collaborate with non-technical stakeholders
• Analyze, understand, and document existing workflows
• Conduct integration and data structuring activities

Job Requirements:

• Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
• At least 8+ years of relevant experience as a Data Engineer
• Experience with ETL, Data Modeling, and Data Architecture (at least 8-10 years)
• Expertise in writing and optimizing SQL
• Previous experience developing scripting software solutions using Linux/Unix
• Operational experience in large data warehouses or data lakes
• Demonstrable experience with AWS technologies, Databricks, Benchling, and Glue
• Previous understanding of Lambda, and RDS (PostgreSQL, MySQL)
• Expert-level skills in ETL optimization, designing, coding, and using Apache Spark or similar technologies to tune big data processes
• Background developing applications and data pipelines to process and stream datasets at low latencies
• Ability to track data - track data lineage, ensure data quality, and improve data discoverability
• Sound understanding of distributed systems and data architecture (Lambda)
• Ability to design and implement batch and stream data processing pipelines
• Understanding of how to optimize the distribution, partitioning, and MPP of high-level data structures
• Background in life science data a plus
• Familiarity with Docker
• Ability to clearly express ideas, listen, question, and share valuable information with colleagues
• Effective presentation skills and the ability to communicate ideas to technical and non-technical audiences
• Great to possess high energy and enthusiasm to boost productivity
• Strong organization and planning skills, ability to establish a clear course of action to accomplish goals and objectives
• Ability to effectively manage time and utilize resources and systems
• Knowledge of task prioritization, ability to keep track of activities, and task completion
• Self-starter with the know-how to work independently and multi-task while maintaining quality standards
• Fluent in spoken and written English