Senior Data Engineer - Apache Spark/SQL (10-15 yrs)

Qualifications :

- Bachelor's degree in Engineering, Computer Science, or relevant field.

- 10+ years of experience in a Data Engineer role.

- 3+ years experience with Apache Spark and solid understanding of the fundamentals.

- Deep understanding of Big Data concepts and distributed systems.

- Strong coding skills with Scala, Python, Java and/or other languages and the ability to quickly switch between them with ease.

- Advanced working SQL knowledge and experience working with a variety of relational databases such as Postgres and/or MySQL.

- Cloud Experience with DataBricks

- Experience working with data stored in many formats including Delta Tables, Parquet, CSV and JSON.

- Comfortable working in a linux shell environment and writing scripts as needed.

- Comfortable working in an Agile environment

- Machine Learning knowledge is a plus.

- Must be capable of working independently and delivering stable, efficient and reliable software.

- Excellent written and verbal communication skills in English.

- Experience supporting and working with cross-functional teams in a dynamic environment.