Senior Data Engineer

Designation: Senior Data Engineer

Mandatory Skills: Python, PySpark, Azure, ADF, Notebook, Synapse

Role & responsibilities:

Data Pipeline Development: Design and develop data pipelines to efficiently extract, transform, and load (ETL) data across various systems, ensuring smooth data migration and deployment.

Data Quality Assurance: Implement robust data validation and cleansing processes to maintain high data quality and integrity.

Performance Optimization: Optimize and tune data infrastructure to improve processing performance and scalability.

Data Engineering Leadership: Act as the Subject Matter Expert (SME) on data engineering best practices and techniques, providing guidance and insight in team discussions and project planning.

Advanced Data Processing: Process large volumes of structured and unstructured data from multiple sources, ensuring efficient integration.

Data Modelling and Database Design: Develop data models and designs, with a strong understanding of SQL and distributed computing.

Production Deployment: Participate in code release, production deployment, and ensure post-release stability.

Perks and benefits: Salary on time, PF and Health Insurance