Add office photos
All Filters
146 Quantified HR Jobs
Data Management Specialist / Data Engineer
3-5 years
Gurgaon / Gurugram
1 vacancy
Data Management Specialist / Data Engineer
Quantified HR
posted 3mon ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
We are seeking a highly skilled and motivated Dataset Management Specialist/Data Engineer to join our client s team in NCR. In this role, you shall be responsible for the efficient management of the databases and Elasticsearch datasets, ensuring data integrity, quality, and accessibility. You will play a crucial role in automating data updates, implementing data validations, and creating platforms for seamless data management.
Key Responsibilities:
- Data Management:
- Utilize Python and related libraries such as Pandas to manipulate and preprocess data
- Manage and maintain both relational databases (PostgreSQL) and Elasticsearch clusters
- Define and implement data schema in PostgreSQL and Elasticsearch to optimize data retrieval and search performance.
- Data Validations:
- Develop and implement data validation processes to ensure data accuracy and consistency before uploading data to the database and Elasticsearch
- Create validation scripts and rules to identify and handle data anomalies and errors
- Automation and Platform Creation:
- Design and develop automated data update processes for the database and Elasticsearch
- Utilize Python, Flask, or FastAPI to build robust and efficient APIs for data upload, retrieval, and maintenance
- Implement error handling, logging, and monitoring to ensure data pipelines are running smoothly
- Data Engineering:
- Collaborate with the data engineering team to design, build, and maintain data pipelines and ETL processes
- Develop data integration solutions to extract, transform, and load data from various sources into our databases and Elasticsearch
Candidate profile
- Proven experience as a Python Developer for 3-5 years
- Bachelors degree in computer science, data science, or a related field. A masters degree is a plus
- Strong proficiency in Python, Pandas, PostgreSQL, and Elasticsearch
- Prior experience in managing databases and Elasticsearch schemaSolid understanding of data validation techniques and data quality principles
- Experience with Flask or FastAPI for building RESTful APIs
- Proven experience in designing and developing data pipelines and ETL processes
- Familiarity with big data technologies, such as Hadoop and Spark, is a plus
- Strong database design and SQL skills
- Knowledge of data warehousing and data modeling concepts
- Proficiency in data integration tools and technologies
- Experience with cloud platforms like AWS, Azure, or Google Cloud for data-related services
- Strong programming skills in languages like Java, Scala, or Ruby, in addition to Python
- Familiarity with data orchestration and workflow tools like Apache Airflow
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
- Proven ability to work independently and in a team-oriented environment
Employment Type: Full Time, Permanent
Read full job description What people at Quantified HR are saying
What Quantified HR employees are saying about work life
based on 1 employee
Flexible timing
Monday to Friday
No travel
Quantified HR Benefits
View more benefits
Compare Quantified HR with
Randstad
Compare
Innovsource Services
Compare
V5 Global Services
Compare
Evision Technoserve
Compare
IMPACT Infotech
Compare
eTeam
Compare
First Advantage
Compare
CIEL HR
Compare
Kutumbh Care
Compare
Careernet
Compare
Teamware Solutions
Compare
Progressive Infovision
Compare
Experis IT
Compare
PeopleStrong
Compare
LanceSoft
Compare
Talentpro
Compare
Pyramid IT Consulting
Compare
2COMS
Compare
Virtual Employee
Compare
ABC Consultants
Compare
Similar Jobs for you
Lead Software Engineer - NMS Systems with Security Protocol Expertise
4-8 Yrs
Bangalore / Bengaluru
Test Engineer - UI & Backend Testing For Advanced Applications
2-6 Yrs
Bangalore / Bengaluru
UI Engineer - React & Frontend Integration Specialist
3-6 Yrs
Bangalore / Bengaluru
Share an Interview