Data Engineer

We are looking for an Engineer II to join our growing team of data experts. This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics. The Engineer will work closely with analyst, report developers, architects, data scientists and other engineers on data initiatives and will be involved in designing our next generation of data platform architecture to support increasing data demands.

Below are the MUST HAVE skill needed for this role

• Cloud Platform - AWS experience
• Coding - Python and PySpark
• Cloud data warehouse Snowflake or Redshift
• AWS cloud services S3, EC2, EMR, Glue, Athena, Lambda
• SQL

Primary Responsibilities:

• Partner with Product and IT stakeholders to understand business needs, gather data requirements, and translate them into structured data modelsensuring data consistency, integrity, and optimal performance.
• Design, develop, and maintain the systems and infrastructure (i.e., data pipelines) necessary for the collection, storage, processing, and analysis of large volumes of data.
• Collaborate with Data Analysts, Data Scientist, and Business Analytics users to provide access to clean and organized data for various business purposes.
• Partner with Enterprise and Solution Architects to implement continuous improvement processes to protect, govern, automate, and scale data platform.
• Participate in data governance initiatives and contribute to maintaining data dictionaries and documentation to facilitate effective data management and analysis.
• Responsible for break/fix support (triage and resolution) of data systems, applications, and processes in production and in lower environments.

Basic Qualifications

We are looking for candidate with 4+ years of experience in a Data Engineer role and has attained bachelors degree in technology and has experienced with Agile/Scrum development process and methodologies.

• Proficient in MicroStrategy data integration and Infrastructure design/build (i.e., schema design, dimensional data modeling, semantic layer design, reporting, and data/object level security).
• Proficient in managing data across multiple platforms (Snowflake, Oracle, AWS Redshift)
• Proficient in data query and language (SQL, Python)
• Experience in developing data models, ingestion processes, and data extracts to support data consumption tools (MicroStrategy, Tableau, Datameer).
• Experience with data governance processes (linage, profiling, classification, and regulatory compliance).
• Working knowledge of data ingestion ETL/ELT tool (Informatica).
• Working knowledge of AWS cloud services (S3, EC2, EMR).
• Retail experience is a plus.Role & responsibilities