Senior Data Engineer (5-7 yrs)

Skill : Azure (Azure Data Factory, Azure Databricks, Data Stage, Airflow), SQL/Python, Rest API) and maintain Data Warehousing/Data Lakes/Data Hubs and analytical reporting environment

RESPONSIBILITIES OF THE ROLE :

- Design, build, and maintain large-scale data systems, including data warehouses, lakes, and pipelines.

- Develop and implement data infrastructure, such as databases, data processing frameworks, and data storage solutions.

- Ensure data quality, integrity, and security, and develop data governance policies and procedures.

- Work with data scientists and analysts to understand data requirements and develop solutions to meet their needs.

- Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from various sources.

- Optimize data systems for performance, scalability, and reliability.

- Collaborate with cross-functional people teams, regional and business leads.

- Stay up-to-date with new technologies and tools in the field of data engineering.

- Develop and maintain documentation and best practices for data engineering.

- Troubleshoot and resolve data system issues and errors.

ROLE EXPECTATIONS :

KNOWLEDGE AND EXPERIENCE :

- Bachelor's degree in computer science, Information Technology, or related field.

- Certified Data Engineer (CDE) or equivalent certifications would be a plus.

- Programming languages : Python, SQL

- Data storage : Relational databases, NoSQL databases, data warehouses

- Data processing : ETL, data pipelines, data streaming

- Cloud platforms : Azure (Azure Data Factory, Azure Databricks, Data Stage, Airflow)

- Agile development methodology

- 5+ years in data engineering, software engineering, or related field

- Experience with large-scale data systems and big data technologies

- Strong understanding of data modeling, data warehousing, and ETL processes

- Strong collaboration and communication skills