Data Engineer

• Participate in data migration and aid the team in transferring its data from a SQL server to CockroachDB over the coming months
• Support in switching from RDS/MongoDB to CockroachDB
• Join forces and assist in setting up the infrastructure in accordance with pre-established architectural details
• Work with a committed team while exercising complete autonomy to recommend tools or technology that could be useful for the implementation

Job Requirements:

• Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
• At least 4+ years of relevant experience as a data engineer or application developer
• 4+ years of experience working extensively with Python, SQL, and Scala
• 3+ years of experience working with AWS development
• 3+ years of experience with distributed data and computing tools like MapReduce, Hadoop, Hive, EMR, Spark, and Athena
• 3+ years of expertise using ETL tools including SSIS, Kafka, and AirFlow
• Considerable expertise in creating data warehouse or data lake solutions (Snowflake, Redshift)
• Working knowledge of Git version control and remote repositories on GitLab/GitHub
• Prior experience carrying out migration initiatives and managing the migration of large amounts of data
• Experience in agile and iterative development environments is desirable
• Nice to have some experience interfacing with .NET API (.NET C# for .NET Core 6)
• Experience with Elasticsearch and/or Solr is preferred
• Ability to work autonomously, troubleshoot, and communicate proactively
• Excellent English communication skills, both conversational and written