Senior Data Engineer

• Work with cross-functional teams to implement solutions that bring value to the customer base
• Ensure the ongoing health of core products and analyze bottlenecks
• Automate and document software processes to reduce the burden of existing features and accelerate the development of new ones
• Be responsible for the analytic pipeline using Big Data technologies like Spark, Airflow, Scala, etc.
• Deploy cutting-edge technologies to support the existing services, new services, and processes
• Efficiently design and implement data features in an agile environment
• Drive data projects through all stages of development
• Improve the output of the engineering team by managing quality, identifying inconsistencies, and resolving issues

Job Requirements:

• Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
• At least 5+ years of relevant software engineering experience
• Must have at least 3+ years of experience in Scala and Spark
• Extensive experience working with cloud environments, preferably AWS
• Prolific experience working with NoSQL databases, preferably Cassandra / Scylla
• Passionate about working in a fast-paced, complex environment
• Solid understanding of software architecture principles and patterns
• Demonstrable experience working with SQL databases, preferably Postgres
• Comprehensive experience building and maintaining data pipelines, preferably with Airflow
• Proficiency with Kafka and event-based processing will be a plus
• Excellent communication and interpersonal skills
• Prolific system design skills