Data Platform Engineer

Project Role :Data Platform Engineer


Project Role Description :Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.

Must have skills :PySpark


Good to have skills :NA
Minimum

5 year(s) of experience is required


Educational Qualification :15 years full time education

Summary:As a Data Platform Engineer, you will assist with the data platform blueprint and design, collaborating with Integration Architects and Data Architects to ensure cohesive integration between systems and data models. You will contribute to the relevant data platform components and play a key role in data platform development. Key ResponsibilitiesPlay the integration consultant role on o9 implementation projects. Understand o9 platform's data model (table structures, linkages, pipelines, optimal designs) for designing various planning use cases. Review and analyze the data provided by customer along with its technical/functional intent and inter-dependencies. Participate in the technical design, data requirements gathering, making recommendations in case of inaccurate or missing data. Work on designing and creating batch schedules based on frequency and configuration settings for daily/weekly/quarterly/yearly batches. E2E integration implementation from partner system to o9 platform.
Technical ExperienceMust have minimum 3 to 7 years of experience on SQL, PySpark, Python, Spark SQL and ETL tools. Proficiency in database (SQL Server, Oracle etc ). Knowledge of DDL, DML, stored procedures.Good to have experience in Airflow, Dalta Lake, Nifi, Kafka. At least one E2E integration implementation experience will be preferred. Any API based integration experience will be added advantage.
Professional AttributesProven ability to work creatively and analytically in a problem-solving environment. Proven ability to build, manage and foster a team-oriented environment. Excellent problem-solving skills with excellent communication written/oral, interpersonal skills. Strong collaborator- team player- and individual contributor.
Educational QualificationBE/BTech/MCA/Bachelor's degree/master's degree in computer science and related fields of work are preferred.
Additional InformationOpen to travel - short / long term


Qualifications
15 years full time education