Cloud Data Engineer (6-13 yrs)

Role : Cloud Data Engineer

Location : Gurugram, Haryana, India

About RiDiK :

RiDiK, a subsidiary of CLPS Incorporation (Nasdaq: CLPS), is a leading technology solutions provider, delivering innovative and high-quality services to global clients. We are seeking a highly skilled and experienced Cloud Data Engineer - Sr. Software Engineer to join our team in Gurugram.

Position Overview :

As a Cloud Data Engineer - Sr. Software Engineer at RiDiK, you will be responsible for designing, developing, and maintaining scalable and robust data pipelines and data warehousing solutions in cloud environments. You will leverage your expertise in Python/PySpark, cloud platforms, and data engineering best practices to deliver high-quality data solutions that meet our clients' business needs. This role requires a strong understanding of data engineering principles, cloud technologies, and a passion for building efficient and reliable data systems.

Responsibilities :

- Design, develop, and maintain scalable data pipelines using Python/PySpark for data ingestion, transformation, and loading.

- Implement ETL processes for data migration and integration from various data sources.

- Orchestrate data pipelines using relevant tools and technologies.

- Design and implement data warehousing and reporting solutions on cloud platforms (AWS, Azure).

- Manage and optimize data storage and processing on cloud environments.

- Utilize cloud-native services for data engineering tasks.

- Design and implement real-time data streaming solutions using Kafka.

- Process and analyze streaming data for real-time insights.

- Design and manage relational databases (MySQL, PostgreSQL) and NoSQL databases.

- Optimize database performance and ensure data integrity.

- Develop data models to support business requirements.

- Perform data analysis and provide insights to stakeholders.

- Implement data security measures and ensure compliance with relevant regulations.

- Manage data access and authorization controls.

- Develop automation scripts using Python/PySpark for data manipulation and processing.

- Automate data pipeline deployments and monitoring.

- Work closely with data scientists, analysts, and other engineers.

- Communicate effectively with stakeholders and provide regular updates on project progress.

Required Skills :

Education : Master's degree in computer science, Information Technology, or a related field.

Experience : 6 to 13 years of experience as a Cloud Data Engineer or similar role.

Programming Languages :

- Strong proficiency in Python/PySpark for scripting, automation, and data manipulation.

- Expertise in relational databases (MySQL, PostgreSQL) and NoSQL databases.

- Experience working with cloud platforms (AWS, Azure) for data engineering.

- Knowledge of real-time data streaming (Kafka) and data pipeline orchestration.

- Experience in data warehousing and reporting solutions.

- Hands-on experience with ETL processes, data migration, and data modeling.

- Strong understanding of data security, compliance, and access management.

Preferred Qualifications :

- Experience with Big Data technologies (Hadoop, Spark).

- Knowledge of containerization (Docker, Kubernetes).

- Exposure to Machine Learning and AI-driven data solutions.

- Immediate joiners or those available within 30 days are preferred.

Soft Skills :

- Strong problem-solving and analytical skills.

- Excellent communication and interpersonal skills.

- Ability to work independently and as part of a team.

- Strong attention to detail and a commitment to quality.

Benefits :

- Competitive salary and benefits package.

- Opportunity to work on challenging and innovative projects.

- Collaborative and supportive work environment.

- Opportunities for professional growth and development.

- Exposure to global clients and projects.