Data Engineer - Spark/Python (5-8 yrs)

Role Overview :

We are looking for a skilled and innovative Data Engineer to join our team. As a Data Engineer, you will play a key role in developing, constructing, and maintaining scalable data pipelines that will support data-driven decision-making across the organization. You will collaborate with cross-functional teams to ensure seamless data flow, data integrity, and efficient storage for analytics and reporting needs.

Key Responsibilities :

- 5-7 years of experience in Solution, Design and Development of Cloud based data models, ETL Pipelines and infrastructure for reporting, analytics, and data science.

- Experience working with Spark, Hive, HDFS, MR, Apache Kafka/AWS Kinesis

- Experience with version control tools (Git, Subversion)

- Experience using automated build systems (CI/CD)

- Experience working in different programming languages (Java, python, Scala)

- Experience working with both structured and unstructured data.

- Strong proficiency with SQL and its variation among popular databases

- Ability to create the data model from scratch.

- Experience with some of the modern relational databases

- Skilled at optimizing large complicated SQL statements

- Knowledge of best practices when dealing with relational databases

- Capable of configuring popular database engines and orchestrating clusters as necessary

What We Offer :

- Competitive salary and benefits.

- A collaborative, innovative work environment.

- Opportunities for growth and career advancement.