Data Engineer

Job Title: Data Engineer

Location: Mumbai, India

Job Description:

We are seeking a highly skilled Data Engineer to join our dynamic team in Mumbai. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure and analytics platforms. The ideal candidate will have a strong background in data engineering, cloud technologies, and a deep understanding of data warehousing and data lake architectures.

Key Responsibilities:

1. Data Engineering:
   
• Design and develop scalable data pipelines to ingest, process, and transform data from various sources.
• Implement and optimize ETL/ELT processes to ensure data quality and reliability.
2. Cloud Technologies:
   
• Utilize AWS services for data storage, processing, and analytics.
• Develop and manage data solutions using AWS technologies like S3, Redshift, Glue, and EMR.
3. Programming Languages:
   
• Write efficient and maintainable code in SQL, Scala, and PySpark.
• Collaborate with software engineers to integrate data engineering solutions into applications.
4. Data Warehousing / Data Lake:
   
• Design and implement data warehouse and data lake solutions to support analytics and reporting needs.
• Ensure data governance and security in data warehousing and data lake environments.
5. Software Development Life Cycle (SDLC):
   
• Follow best practices in SDLC, including version control, code reviews, and testing.
• Participate in the design and implementation of data engineering projects from inception to deployment.
6. Analytics, AI / ML:
   
• Collaborate with data scientists and analysts to provide data for machine learning models and advanced analytics.
• Support the deployment and monitoring of AI/ML solutions in production.
7. Domain Knowledge:
   
• Apply mutual fund business knowledge to enhance data solutions and analytics.
• Understand industry-specific data requirements and regulatory compliance.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Proven experience in data engineering, data warehousing, and data lake architectures.
• Proficiency in AWS cloud services, SQL, Scala, and PySpark.
• Strong understanding of SDLC and best practices in software development.
• Experience with analytics, AI/ML, and mutual fund business knowledge is highly desirable.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.