Wipro - Senior Data Engineer - Python/Scala (7-11 yrs)

Job Description :

In this role, you will :

- Design & Develop batch and streaming solutions using various Big Data technologies

- Work closely with architect to design secure and scalable

- Be responsible for assessing technologies and approaches for ingestion, transformation and storage

- Develop software utilizing open-source technologies to interface with distributed and relational data sources

- Work closely with team members from across Mastercard to identify functional and system requirements

Skills Required :

- Primary : Python or Scala, Spark, Data Modeling, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms.

- Experience with SQL, Parallel Data Processing, Message Queuing & Distributed Systems.

- Plus : Experience in Java/.net, Scala, or Python technologies

- Nice to have : Performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts Experience in working with Cloud (e.g., Azure, AWS)

The ideal candidate for this position should :

- Hand on experience of working with Big Data / Analytics technologies like Hadoop, Spark, Python, Scala.

- Have experience working with real-time or near real-time ingestion

- Have strong programming knowledge in Java, Scala or Python.

- Be skilled at explaining technical problems succinctly and clearly.

- Strong aptitude for problem solving.

- Proven track record of delivering software projects and willingness to roll up sleeves to get the job done

- Have excellent oral and written communication

- Be familiar with Agile/Scrum methodologies

- Have demonstrated ability to adapt to new technologies and learn quickly

- Have the ability to manage multiple priorities simultaneously

- Have a BS/BA degree in Computer Science, Information Systems or related field