Data Engineer

• Work directly with product owners and data experts to build products that solve complex client problems
• Build and support a distributed platform supporting all the existing data
• Work across the product, primarily on the data pipelines
• Interface directly with internal teams
• Evaluate software, implementation options, and document them for technical teams
• Work with data analysts to collect insight on possible data collection efficiencies and identify automation potential for manual workflows
• Integrate best qualitative practices in program design and development
• Develop technical architectures and specific implementations to meet business needs
• Guide the team s software engineering best practices by documenting standards and completing code reviews
• Troubleshoot new and existing code and provide feedback/solutions to structural issues in the codebase as they arise
• Advise on the feasibility of nonfunctional requirements and ensure the successful implementation of features while meeting those requirements

Job Requirements:

• Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
• At least 3+ years of relevant experience as a data engineer
• 3+ years of knowledge of Spark, Python, or Scala
• 3+ years experience with RDBMS, T-SQL, NoSQL, and DataLakes
• Strong familiarity with map/reduce programming models
• Familiarity with Power BI Embedded, .NET Core, JavaScript/TypeScript, HTML5, and CSS3 is nice to have
• Proficiency in writing production-quality code
• Prior experience working with Azure cloud and Databricks
• Deep expertise in database schema design, optimization, and scalability
• Experience with Azure or AWS cloud-based service-oriented architecture
• Solid understanding of testing pyramid (unit, integration, black box, service)
• Experience working in an Agile/Scrum environment
• Strong analytical and problem-solving skills
• Good time management and organizational skills
• Ability to work on challenging issues independently or in a team environment
• Ability to learn and adapt quickly to new technologies and environments
• Strong communication skills