Data Engineer

Job Title: Sr. Data Engineer

Experience: 3+ years experience

Location: Mumbai

Essential Duties and Responsibilities:

• Improves efficiency through workable thinking and the efficient use of new technologies and concepts
• Analysis of requirements handed forth in order to discover the best solution possible within the limits.
• Work closely with product leaders and managers to have a thorough understanding of the company and provide excellent solutions.
• Create UT cases to ensure that the codebase maintains system stability and documentation.
• Implement best practices and learn innovative approaches to keep codebases up to date on a regular basis.
• Learn how to write more efficient code and support the development of predictive data-driven solutions.
• Create systems and procedures to acquire, organize, and clean raw data that data scientists and MIS teams.
• Working with cloud services, data lake storage, Hadoop, Spark, Python/ Scala, Hive, HDFS, SQL and No-SQL databases.
• Knowledge on creating Batch and Realtime Data pipelines with different cloud services, ETL tools and Kafka etc.
• Perspective to always create optimized complex ETL mappings for relational and non-relational workloads.
• Hands on Unix scripting or PowerShell.