Valiance Solutions - Data Engineer - Python/PySpark (1-2 yrs)

Job Title : Data Engineer

Location : Gurgaon, India

About the Role :

We are seeking a highly motivated and detail-oriented Data Engineer to join our team.

The ideal candidate will have 1-2 years of experience in handling data pipelines, designing efficient workflows, and working with large datasets. If you are passionate about building robust data systems and enabling business decision-making through data-driven insights, this opportunity is perfect for you.

Key Responsibilities :

- Develop, maintain, and optimize data pipelines to integrate data from various sources.

- Write efficient SQL queries to extract, clean, and transform data for analysis and reporting purposes.

- Work with Python and PySpark to build scalable data processing solutions.

- Design and implement NoSQL data solutions using MongoDB.

- Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions.

- Monitor and troubleshoot data workflows, ensuring data accuracy, consistency, and performance optimization.

- Support the development and implementation of data models and architectures for analytics and reporting.

- Document technical processes and workflows for future reference.

Required Skills and Qualifications :

- 1-2 years of experience as a Data Engineer or in a similar role.

- Strong proficiency in SQL for querying and managing relational databases.

- Hands-on experience with Python and PySpark for data processing.

- Familiarity with MongoDB and other NoSQL databases.

- Understanding of ETL processes, data integration, and data warehousing concepts.

- Strong analytical and problem-solving skills.

- Ability to work independently as well as in a team environment.

- Excellent communication and interpersonal skills.

Preferred Qualifications :

- Experience with cloud platforms (e.g., AWS, Azure, GCP).

- Familiarity with big data technologies such as Apache Hadoop, Kafka, or Spark Streaming.

- Knowledge of data visualization tools (e.g., Power BI, Tableau) is a plus.