Senior Data Engineer_JunoLabs_Bengaluru

About the Role:

We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in designing, developing, and maintaining our data infrastructure. This role requires a deep understanding of data engineering principles, big data technologies, and cloud platforms.

Key Responsibilities:

• Data Pipeline Development:
• Design, develop, and deploy robust data pipelines to ingest, process, and transform large volumes of data from various sources.
• Utilize a variety of tools and technologies, such as Apache Spark, Kafka, and SQL, to extract, transform, and load (ETL) data.
• Data Modeling and Architecture:
• Develop and implement data models and schemas that are efficient, scalable, and aligned with business needs.
• Design and maintain data warehouses, data marts, and data lakes.
• Cloud Platform Expertise:
• Leverage cloud platforms like AWS, GCP, or Azure to build and manage data solutions.
• Utilize cloud-native services for data storage, processing, and analytics.
• Data Quality and Monitoring:
• Ensure data quality and consistency through rigorous testing and validation.
• Implement monitoring and alerting systems to proactively identify and resolve data issues.
• Performance Optimization:
• Optimize data pipelines and queries for optimal performance and efficiency.
• Identify and resolve performance bottlenecks.
• Collaboration and Teamwork:
• Collaborate with data analysts, data scientists, and business stakeholders to understand their data needs.
• Work effectively in a cross-functional team environment.

Required Skills and Qualifications:

• Strong proficiency in SQL and Python or Scala.
• Experience with big data technologies such as Hadoop, Spark, Kafka, and Hive.
• Knowledge of cloud platforms (AWS, GCP, or Azure) and their data services.
• Understanding of data warehousing and data lake concepts.
• Experience with data modeling and ETL processes.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.

Preferred Qualifications:

• Experience with data visualization tools like Tableau or Power BI.
• Knowledge of machine learning and AI concepts.
• Certifications in cloud platforms or data engineering.

If you're a passionate data engineer who enjoys solving complex data challenges and building scalable data solutions, we encourage you to apply.