Data Engineer

Job Description

SENIOR (10 YRS OF EXPERIENCE)
Develop and test code to deliver functionality that meets the overall business strategy and objectives
Build the work needed to implement features from the product backlog
Size user stories
Unit test code, create automated test scripts, and execute all other testing-related tasks
Test deliverables against a user storys acceptance tests
Execute necessary project documentation
Work closely with other team to ensure that features meet business needs
Follow industry-standard agile software design methodology for development and documentation
Work with infrastructure, security, and other partners
3-5 years in an engineering role
1-3 years participating in agile development
Scrum certification, a plus
Experience with test-driven development and software test automation
Deep experience working in an agile environment (e.g. user stories, iterative development, etc.)

Main responsibility is to maintain an existing system, enhance and also help
troubleshoot performance issues. Will have support from existing team.
Required
- Proficiency in Java or Python or Scala
- On-call experience (monitoring, logging)
- Distributed systems with large volume of data
- Kafka (familiarity with Kafka cluster, consuming from / producing to topics)
- Yarn (interfacing and troubleshooting issues with the scheduler)
- Docker
- Jenkins

Optional / Bonus
- Haskell
- Rust
- Nix