Nagarro - Senior Big Data Engineer - PySpark/BigQuery (3-5 yrs)

We're Nagarro.

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 36 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That's where you come in!

REQUIREMENTS :

Experience : 3+ Years

- Strong technical background in data engineering, with expertise in BigQuery, Cloud Composer, and PySpark.

- Strong experience in building and optimizing ETL pipelines for batch and real-time data processing.

- Proficiency in SQL, Python, and data engineering tools.

- Familiarity with data modeling concepts and building scalable data systems.

- Hands-on experience in orchestrating workflows using Cloud Composer and working with PySpark for large-scale data processing.

- Knowledge of data security and governance practices in cloud environments.

- Strong problem-solving skills and ability to troubleshoot complex data issues.

- Excellent communication skills and a passion for continuous learning.

RESPONSIBILITIES :

- Understanding the client's business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements.

- Mapping decisions with requirements and be able to translate the same to developers.

- Identifying different solutions and being able to narrow down the best option that meets the client's requirements.

- Defining guidelines and benchmarks for NFR considerations during project implementation

- Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers

- Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed.

- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it

- Understanding and relating technology integration scenarios and applying these learnings in projects

- Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.

- Carrying out POCs to make sure that suggested design/technologies meet the requirements.