Data Platform Engineer

Project Role :Data Platform Engineer


Project Role Description :Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.

Must have skills :Databricks Unified Data Analytics Platform


Good to have skills :PySpark
Minimum
7.5 year(s) of experience is required


Educational Qualification :15 years full time education

Summary:As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. You will collaborate with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Your typical day will involve working on the data platform blueprint and design, collaborating with architects, and ensuring seamless integration between systems and data models.
Roles & Responsibilities:

Expected to be an SME

Collaborate and manage the team to perform

Responsible for team decisions

Engage with multiple teams and contribute on key decisions

Provide solutions to problems for their immediate team and across multiple teams

Data Pipeline Development:Build scalable ETL pipelines using Databricks and Spark.

Data Integration:Integrate and manage data from diverse sources.

Stakeholder Collaboration:Work with data scientists, analysts, and product managers to meet data needs.

Performance Optimization:Optimize data workflows and resource usage.

Data Quality and Governance:Implement data quality checks and ensure compliance.

Automation and Orchestration:Automate data processes and manage workflows.

Troubleshooting:Resolve data pipeline issues promptly.

Documentation:Maintain documentation of data processes and best practices.

Continuous Improvement:Stay updated with new technologies and improve practices.

Product Development Support:Contribute data expertise to product development.
Professional & Technical Skills:

Must To Have Skills:Proficiency in Databricks Unified Data Analytics Platform

Good To Have Skills:Experience with PySpark

Strong understanding of statistical analysis and machine learning algorithms

Experience with data visualization tools such as Tableau or Power BI

Hands-on implementing various machine learning algorithms such as linear regression, logistic regression, decision trees, and clustering algorithms

Solid grasp of data munging techniques, including data cleaning, transformation, and normalization to ensure data quality and integrity
Additional Information:

The candidate should have a minimum of 7.5 years of experience in Databricks Unified Data Analytics Platform

This position is based at our Mumbai office

15 years full time education is required

 Qualifications 
15 years full time education