Data Engineer - Python/Scala (2-4 yrs)

Job Summary :

We are looking for a skilled and detail-oriented Data Engineer to join our team.

The ideal candidate will design, develop, and maintain robust data pipelines and systems that enable seamless data flow and analytics.

You will play a crucial role in building efficient data solutions to support business intelligence, machine learning, and operational reporting.

Key Responsibilities :

- Design, build, and maintain scalable ETL (Extract, Transform, Load) pipelines.

- Develop solutions for data extraction from various structured and unstructured data sources.

- Ensure data quality, integrity, and reliability throughout the data lifecycle.

- Design and optimize databases for performance and scalability.

- Manage data storage solutions, such as data lakes and warehouses (e., AWS Redshift, Snowflake, Azure Synapse).

- Monitor and troubleshoot database and pipeline issues to ensure uninterrupted data flow.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements.

- Integrate data from diverse platforms, APIs, and third-party systems.

- Work with DevOps teams to automate workflows and deploy scalable data solutions.

- Implement data governance policies, ensuring compliance with security and privacy regulations.

- Manage access controls and data encryption to secure sensitive information.

- Monitor data usage and establish standards for data consistency.

- Stay updated with emerging technologies in data engineering and analytics.

- Identify and implement opportunities for improving data infrastructure performance and reliability.

Qualifications :

Education :

- Bachelor's degree in Computer Science, Information Technology, or a related field.(Master's degree preferred.)

Experience :

- 2+ years of experience as a Data Engineer or in a similar role.

- Proven expertise in data engineering, database management, and data architecture.

Skills :

- Proficiency in programming languages like Python, Java, or Scala.

- Experience with SQL and NoSQL databases.

- Hands-on expertise with data pipeline tools like Apache Kafka, Airflow, or AWS Glue.

- Familiarity with cloud platforms (e., AWS, Azure, Google Cloud) and associated data services.

- Strong knowledge of data warehousing and big data technologies (, Hadoop, Spark).

- Understanding of data governance, security, and compliance standards (e., GDPR, HIPAA).

Key Competencies :

- Problem-solving and analytical thinking.

- Strong communication and teamwork skills.

- Attention to detail and focus on delivering high-quality solutions.

- Ability to handle complex data environments with efficienc