Big Data Developer/Lead

Mandatory Skills Java with Spark, AWS

• Develop and optimize data processing pipelines using Java and Spark to handle large datasets efficiently.
• Write clean, maintainable, and efficient code in Java.
• Integrate data from various sources and ensure data quality and integrity through validation and error handling.
• Should have good experience working on AWS services such as S3, EC2.
• Ensure that data pipelines are fault-tolerant, scalable, and cost-effective.
• Implement best practices for data security, including encryption, access control, and compliance with industry standards.
• Troubleshoot and resolve performance bottlenecks in data workflows.
• Work in an Agile development environment, collaborating with cross-functional teams to deliver timely solutions.
• Stay updated on the latest trends in Big Data technologies and provide insights for continuous improvement.