39 Spruce Infotech Jobs
Big Data Engineer - Hadoop/PySpark (5-6 yrs)
Spruce Infotech
posted 2d ago
Flexible timing
Key skills for the job
Responsibilities :
- Design, develop, and implement robust big data pipelines and ETL processes using Hadoop and PySpark.
- Perform data analysis, transformation, and cleansing to extract valuable insights.
- Optimize performance and scalability of big data applications.
- Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.
- Stay up-to-date with the latest advancements in big data technologies and trends.
- Troubleshoot and resolve complex data-related issues.
Qualifications :
- 5+ years of experience in big data engineering and development.
- Strong proficiency in Hadoop, PySpark, and related technologies.
- In-depth understanding of big data concepts, including data ingestion, processing, and analysis.
- Experience with data warehousing and data lakes.
- Knowledge of SQL and NoSQL databases.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills
Functional Areas: Software/Testing/Networking
Read full job descriptionPrepare for Big Data Engineer roles with real interview advice