Software Developer- Spark Scala

About this opportunity:
We are hiring Software Developer- Sparks Scala, in this role you will be required to translate application storyboards and use cases into functional applications. As a Software Developer, you will be responsible to Design, build, and maintain efficient, reusable, and reliable code. You will also ensure the best possible performance, quality, and responsiveness of the applications. Your role will include reviewing, Identifying bottlenecks and bugs, and devise solutions to these problems. Help team member to maintain code quality and carry out PoC s against new technologies/frameworks in the domain and demonstrate the same.

What you will do:
The Big data Engineer shall build the solutions which architect has designed.
Develop, maintain, test and evaluate big data solutions.
Builds Large Scale data processing systems.
Understands how to apply technologies to solve big data problems and to develop innovative big data solutions.
Collecting, Parsing, Managing, Analysing and visualizing large sets of data to turn information into insights using multiple platforms.
Designing efficient and robust ETL workflows.
Documenting requirements as well as resolve conflicts or ambiguities.
Design and develop data applications using selected tools and frameworks as required and requested.
Perform tasks such as writing scripts, web scraping, calling APIs, write SQL queries, etc.
Support business decisions with ad hoc analysis as needed (PoC s).
Define data retention policies.
Identify New Business Opportunities.
Lead Solution Acceptance (UAT) towards Customer.
Solution Handover to L1/L2/L3/CNS(Support)/Customer s OM team.
Identify Scope Creep, Change Requests during delivery phase.
Support Pre-Sales Activities-
o Create Work Breakdown structure
o Document Scope of Work.
o Prepare Efforts Estimation
o Inputs in Resource Loading
o Identify Skill Set required for Project execution
Proactive Competence development of self in new solution areas in the domain technologies.
Mentor Solution Integrators, developers and provide transparent open environment for growth and development.

The skills you bring:

• 2 - 7 years of recent experience in data engineering.
• Bachelor s Degree or more in Computer Science or a related field.
• A solid track record of data management showing your flawless execution and attention to detail.
• Strong knowledge of and experience with statistics.
• Programming experience, ideally in Python, Spark, Kafka, Scala, Hive, Scoop, Oozie, SQL, Bash programming languages to meet goals objectives.
• Experience in Frameworks, tools as -Cloudera and Horton works, Flink, Pandas, Pyspark etc.
• Experience in Distributed file system like HDFS, GlusterFS in SQL as well NSQL databases.
• Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.
• Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
• A willingness to explore new alternatives or options to solve data mining issues, utilize a combination of industry best practices, data innovations your experience to get the job done.
• Experience in production support and troubleshooting.
• You find satisfaction in a job well done and thrive on solving head-scratching problems.
• Must be willing to occasionally travel within and outside India and alter daily work schedule to meet with customers.