Data Engineer

Role: Data Engineer.

Location: Magarpatta, Pune

Experience: 2-5 years

Skills:

SQL, Python, Pyspark, Shell scripting, Big data, ETL pipelines, Data Discovery and Analysis.

Willing to work on rotational shifts.

Key responsibilities:

1.     Development, Product Enhancements and Improvements:

a.     Experience in development of data pipelines and processing of data.

b.     Experience in debugging, tunning and optimizing PySpark data pipelines.

c.     Provide enhancements for end-users, addressing technical issues, troubleshooting software problems, and resolving user inquiries.

d.     Work on continuous improvement initiatives to enhance IT systems and services.

e.     Efficient communication skills to coordinate with users, technical teams and Data Solution architects.

f.      Working closely with the overall Enterprise Data & Analytics Architect and Engineering practice leads to ensure adherence with the best practices and design principles.

g.     Evaluate existing processes and systems, recommending and implementing improvements to increase efficiency and user satisfaction.

2.     Technical Troubleshooting:

a.     Identify, diagnose, and resolve technical issues.

b.     Collaborate with other teams or external vendors to resolve complex technical problems.

3.     Documentation:

a.     Create and maintain documentation for IT processes, procedures, and troubleshooting guides.

b.     Keep knowledge base up-to-date with solutions to common problems.

4.     Training and Awareness:

a.     Provide training sessions for end-users on IT systems and best practices.

b.     Promote IT security awareness among users to minimize security risks.

5.     Collaboration:

a.     Collaborate with other IT teams, such as system administrators, and developers, to ensure a cohesive IT environment.

b.     Work with project teams to implement new technologies and systems.

c.     Consumers and Business User Collaboration

6.     Monitoring and Reporting:

a.     Monitor system performance and user activity, addressing any anomalies or issues proactively.

b.     Generate regular reports on system performance, support ticket metrics, and user satisfaction.

7.     Change Management:

a.     Follow established change management processes when implementing updates, patches, and system changes to minimize disruptions.

8.     Emergency Response:

a.     Be part of the team responsible for responding to and mitigating IT emergencies, such as system outages or security incidents.

9.     User Feedback:

a.     Gather and analyze user feedback to identify areas for improvement and make recommendations for enhancing IT services.

It's important to note that these responsibilities can be adjusted based on the organization's specific requirements and the size and scope of its IT infrastructure.