Data Engineer

JOB RESPONSIBILITIES:

• Experience in Spark ecosystem, and familiarity with MongoDB data loads, Snowflake and AWS platform (EMR, Glue, S3).
• Hands on experience in writing advanced SQL queries, familiarity with variety of databases.
• Experience in handling end to end data testing for complex big data projects, which includes extensive experience in writing and executing test cases, performing data validations, system testing and performance checks.
• Experience in handling different file formats like JSON, ORC, Avro, Parquet, CSV.
• Knowledge and familiarity with basic shell scripting and commands
• Familiarity of data pipelines with NoSQL databases like MongoDB, jobs scheduling tools and understanding of APIs and data streaming concepts (such as Kafka services).

--

Thanks & Regards,

Karthik Kumar,

IT Recruiter

SP Software (P) Limited (An ISO, ISMS & CMMI Level-3 Certified company)

An SP Group Enterprise.

Connect on : linkedin.com/in/b-karthik-kumar-116990179