Senior Data Engineer

• Design and implement systems for transforming, connecting, storing, and delivering data from a wide range of sources
• Associate domains and IPs to companies on a continuous basis
• Enable junior engineers to deliver value with minimum duplication of effort
• Automate the infrastructure supporting the data pipeline as code and deployments by improving CI/CD pipelines
• Monitor, troubleshoot, and improve the data platform to maintain stability and performance

Job Requirements:

• Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
• At least 3-6+ years of relevant experience as a data engineer
• Demonstrable experience developing data pipelines and software development
• Extensive coding skills in at least one high-level programming language (Scala, Java, or Go)
• Solid understanding of big data technologies such as Kafka, Spark, and Databricks toolkit
• Prior experience with Dataflow orchestration in Google Cloud Flow, Airflow, or Conductor
• Experience with AWS services, including EMR, S3, Redshift, and RDS
• Comprehensive knowledge of the full lifecycle of an IP address originating from IANA to the end-user (DNS, networking)
• Excellent communication skills to collaborate with cross-functional teams and independently drive projects and decisions
• Previous experience working in distributed teams
• Fluent in verbal and written English