Data Engineer

We are looking for candidates with hands on experience in Big Data or Cloud Technologies.

Must have technical Skills

• 2-4 Years of experience
• Expertise and hands-on experience on Python Must Have
• Expertise knowledge on SparkQL/Spark Dataframe – Must Have
• Good knowledge of SQL – Good to Have
• Good knowledge of Shell script – Good to Have
• Good Knowledge of one of the Workflow engine like Oozie, Autosys – Good to Have
• Good knowledge of Agile Development– Good to Have
• Good knowledge of Cloud- Good to Have
• Passionate about exploring new technologies – Good to Have
• Automation approach - – Good to Have

Roles & Responsibilities

• Selected candidate will work on Data Warehouse modernization projects and will responsible for the following activities.
• Develop programs/scripts in Python/Java + SparkSQL/Spark Dataframe or Python/Java + Cloud native SQL like RedshiftSQL/SnowSQL etc.
• Validation of scripts
• Performance tuning
• Data ingestion from source to target platform
• Job orchestration