Location: Bangalore (3 days in office at Marathalli)
Job Description
The successful candidate will be:
Big Data engineer with extensive coding experience in Spark & Scala.
Ability to work well within a product-based organization (product mindset) and with a team comprising of developers & functional experts on a critical customer-facing product.
Has prior experience of at least 2 years as a PO or lead business analyst and is comfortable with technical products.
Experience in creating data pipelines using Spark and in-depth knowledge of Spark performance tuning.
Good to have experience in microservices-based architecture.
Autonomous, motivated, and self-driven.
Prior experience in managing direct customer communication, expectations management, and handling ambiguity.
Strong stakeholder management skills to manage dependencies across multiple teams and lead discussions with multiple stakeholders.
Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review.
Ready to work with a DevOps mindset with other engineers.
Ability to understand Application architecture and align with overall product functionality and vision.
Excellent English verbal and written communication skills.
Strong analytical and conceptual thinking for performing efficient root cause analysis and driving resolutions.
Airline industry knowledge is a strong positive.
Technical Skills
10+ years of experience in analysis, design, development, documentation, implementation, and testing of software products using Spark, Scala, and Big Data tech stacks.
At least 6+ years of working with Big Data Tech stacks: Databricks, Kafka, Spark, and experience on the Azure cloud platform.
Good to have experience with NoSQL data using MongoDB, Cassandra, HBase, etc.
Good to have experience in microservices-based architecture.
Sound knowledge of OOPs concepts (Class loading, Memory Management, Transaction management, Multithreading, Garbage collection, Performance optimization), Data structures, and Design Patterns.
Experience with Streaming data using Apache Kafka and processing it in real-time with optimum performance.
Experience in Messaging architecture using MQ is a plus.
Experience in designing and developing high-volume, low-latency applications for mission-critical systems, ensuring high availability and performance.
Key Words:
Scala, Databricks, Kafka, Spark, Azure, NoSQL, DataLake, Big Data, Streaming.