Big Data Engineer - Hadoop/Hive (4-9 yrs)

Responsibilities :

- Design, develop, and execute test cases for large-scale big data platforms.

- Perform testing on various Big Data technologies (e. g., Hadoop, Hive, Spark, NoSQL databases).

- Ensure data accuracy, integrity, and quality in data processing and transformations.

- Work closely with developers, data engineers, and business analysts to understand data requirements and identify testing needs.

- Automate test cases and build robust test suites for continuous integration pipelines.

- Perform performance testing and stress testing on large-scale data systems.

- Troubleshoot data issues, report defects and ensure resolution within defined timelines.

- Monitor data workflows to ensure all jobs, data ingestion, and processing activities run as expected.

- Validate ETL processes and data pipelines to ensure data is loaded, transformed, and stored correctly.

- Provide test reports and metrics on data quality, performance, and stability.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 4+ years of professional experience in big data engineering.

- Strong understanding of big data concepts and principles.

- Experience with big data technologies and frameworks (Hadoop, Spark, Kafka).

- Experience with database systems (SQL, NoSQL).

- Experience with data modeling and ETL processes.

- Excellent problem-solving and analytical skills.

- Strong communication and interpersonal skills.