Big Data Engineer

Job Title: Senior Big Data Engineer
Employment Type: Full-time

Experience : 10+ Years

JD:

• Design, implement, and optimize data processing pipelines and architectures to handle large-scale, high-volume data sets.
• Build and maintain robust, scalable, and fault-tolerant big data platforms and data lakes using modern big data tools and frameworks (e.g., Hadoop, Spark, Kafka).
• Develop solutions for data ingestion, data transformation, and storage that improve efficiency and performance.
• Work with cross-functional teams to ensure that data infrastructure meets the needs of business analytics and machine learning initiatives.
• Ensure data quality, integrity, and consistency across multiple systems and data sources.
• Collaborate with data scientists, analysts, and software engineers to build and deploy data-driven solutions.
• Optimize queries, data pipelines, and systems to handle large-scale data processing effectively.
• Monitor and troubleshoot production data workflows, ensuring continuous data availability and minimal downtime.
• Implement automation and monitoring for data workflows and infrastructure.
• Drive the adoption of best practices for data governance, data security, and compliance.
• Mentor junior engineers and help them grow in technical skills and domain knowledge.