Data Engineer - Sr. Consultant level-Scala or Python

• We value creative and driven individuals who love to own their products, and design and implement solutions that create a seamless experience for consumers and clients. Our Data engineers work across the stack, and are experts in building data driven business solutions using technologies such as Hadoop, Hive, Spark, Scala, Python, MS SQL, Kafka & Power BI. As we embark on the journey to build a Data Lake, we are looking for a Senior Consultant - Data Engineer who can drive architecture, design and development activities.

The role involves extensive hands-on activities.

Here are key job responsibilities -

• Responsible for the architecture, design and development
• Work on development of new products iteratively by building quick POCs and converting ideas into real products
• Develop workflows and ETL/ELT code using Hive scripts, Spark and other utilities on Hadoop.
• Build analytical applications using Hadoop eco system using packaged or open source technologies
• Build resilient data pipelines for reporting and data science/ML use cases
• Interact with both business and technical stakeholders to deliver high quality products and services that meet business requirements and expectations while applying the latest available tools and technology
• Have a passion for delivering zero defect code and be responsible for ensuring the teams deliverables meet or exceed the prescribed defect SLA
• Present technical solutions, capabilities, considerations, and features in business terms. Effectively communicate status, issues, and risks in a precise and timely manner.
• Perform other tasks on R&D, data governance, data security, system infrastructure, and other cross team functions, on an as-needed basis