Gloify - Data Engineer - Big Data Frameworks (2-4 yrs)

About the Role :

We are looking for a skilled and motivated Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining data pipelines and architectures, ensuring efficient data flow and accessibility for analysis and business insights.

Key Responsibilities :

- Design, develop, and maintain scalable, reliable, and efficient data pipelines to process large-scale datasets.

- Collaborate with cross-functional teams to gather and understand data requirements.

- Implement data models and schemas for optimized data storage and retrieval.

- Ensure the security and integrity of data through robust processes and protocols.

- Perform data cleaning, transformation, and validation to ensure quality and accuracy.

- Monitor and optimize system performance, addressing issues in a timely manner.

- Integrate and manage data from various sources, including APIs, databases, and third-party systems.

Required Skills & Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Minimum of 2 years of experience in a Data Engineer role or similar.

- Proficiency in programming languages such as Python, Java, or Scala.

- Hands-on experience with big data frameworks like Apache Spark, Hadoop, or Kafka.

- Strong knowledge of SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB).

- Experience with cloud platforms such as AWS, Azure, or Google Cloud.

- Familiarity with ETL processes and tools (e.g., Apache NiFi, Talend, Informatica).

- Solid understanding of data warehousing concepts and solutions like Snowflake, Redshift, or BigQuery.

- Excellent problem-solving and communication skills.