Big Data Developer ( Pyspark)

"Innovate, collaborate, and succeed together"
Are you a Big Data Pyspark wizard ready to craft the future? Join us to unlock
your potential.
As a Senior Data Engineer, you'll be at the forefront of data-driven innovation, designing and
building scalable data pipelines. Your expertise in PySpark, Python, and the broader Big
Data ecosystem will be instrumental in transforming raw data into actionable insights.

Role: Sr Big Data Pyspark Developer (Bhubaneswar)

Description of Role - High level designer of Big data configurations and pipelines.

Purpose
• Independently Design and build/configure Big data pipelines as per the design
• Able to identify and solve big data problems independently.
• Work closely with Sr. Big data developer to report any issues in build
• Work on defect fixes during QA & UAT.
• Work through the life cycle of the code from low-level design to production and Postproductions support.

Experience - 5.5 to 11 yrs. of IT experience with more than 4 yrs. of big data implementation experience.

Capabilities
• Strong technical and analytic skills to solve complex big data problems.
• Experienced with Spark software stack, Prior experience in working on Spark using Python or Scala or Java
and PySpark based big data implementations.
• Have strong knowledge and hands-on few of HDFS, Map reduce Hive, Impala, Tej, Sqoop, Pig, Oozie, HBase,
Cassandra, Mongo DB, Kafka, Spark, Storm, Knox, Ranger, Flume, NiFi, Falcon, Kerberos, Sentry, Cloudera
Manager, Cloudera Navigator and Ambari.

Enterprise Competencies
• Independent High-level design and developer.
• Strong communicator
• Ability to manage stakeholders' expectations.

Technical Competencies
• Big Data Stack (Spark, Hive, Hbase, Apache Pheonix, Pig), Python , Scala, Kafka, Spark Streaming, Atlas, Pig,
Java ,SQL, Impala, Tej, Sqoop, Pig, Oozie, HBase, Cassandra, Mongo DB,
• Kafka, Spark, Storm, Knox, Ranger, Flume, Nifi, Falcon, Kerberos, Sentry,Cloudera Manager, Cloudera
Navigator and Ambari.
• Good Experience in CICD & DevOps concepts.
• Good experience working in any cloud environment (Azure / AWS / GCP) using Agile methodology