Data Engineer

to join our rapidly growing engineering team. They will join the data group, tasked with architecture, deployment, and automated maintenance of our Big Data platform. The role will collaborate with a cross-functional team to provide data solutions with engineering, marketing, merchandising, and executive teams. Roles and Responsibilities:

• Contribute to technology selection and strategy for big data solutions
• Build, test and operate stable, scalable data pipelines that cleanse, structure and integrate disparate data sets into a readable and accessible format for end-user facing reports, data sciences and ad-hoc analyses
• Create data pipelines to handle data ingestion in a way that is both rapidly available and fault tolerant
• Support AI/Machine Learning Initiatives to drive value for consumers and internal stakeholders
• Review and contribute to technical documentation
• Knowledge sharing and coaching
• Support with the onboarding of new data team members

Required skills and Qualification:

• Education: Bachelor s degree in Computer Science, Engineering, or a related technical field (or equivalent experience).
• Experience: 5+ years of experience in data engineering or related fields.

Technical Skills:

• Snowflake: Experience with Snowflake for data warehousing solutions, including managing Snowflake data architecture, storage, and computing resources for efficient data processing and retrieval.
• Programming: Minimum of 5 years of experience in Object Oriented Programming (OOP) and/or functional programming.
• Cloud Big Data Solutions: Familiarity with Cloud Big Data solutions such as AWS (EMR, Redshift, Kinesis, Data Streams), Google BigQuery, Azure Data Pipelines, and Azure Data Warehouse.
• Apache Big Data Architecture: Knowledge of Apache suite technologies, such as Spark, Akka, Cassandra, Kafka, and DBT for data modeling and transformation.
• SQL Scripting ETL Tools: Expertise in SQL scripting, AWS Glue, and PySpark for ETL processes.
• Python: Proficiency in Python programming is a plus.

Job Location: The Citadel, 6th floor 601-603, Opp. Star Bazaar, Adajan, Surat, Gujarat 395009.