Data Engineer - ETL (5-12 yrs)

We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing, building, and maintaining scalable data pipelines and architectures. You will work closely with data scientists, analysts, and software engineers to ensure efficient data flow and accessibility.

Responsibilities :

- Design, develop, and maintain robust, scalable, and efficient data pipelines.

- Optimize and automate data ingestion, transformation, and loading (ETL/ELT) processes.

- Implement and manage data lakes, data warehouses, and cloud-based data solutions.

- Collaborate with cross-functional teams to understand data needs and deliver effective solutions.

- Ensure data security, integrity, and compliance with company and regulatory standards.

- Monitor and troubleshoot data pipelines to ensure seamless operation.

- Work with big data technologies to process and analyze large datasets efficiently.

- Develop and maintain documentation related to data architecture, processes, and workflows.

Requirements :

Education : Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

Experience : 5-12 years of experience in data engineering, big data, or related fields.

- Programming : Proficiency in Python, Java, or Scala.

- Data Processing : Expertise in ETL/ELT tools like Apache Spark, Apache Flink, or Talend.

- Databases : Strong experience with SQL and NoSQL databases (PostgreSQL, MySQL, MongoDB, Cassandra, etc. ).

- Cloud Technologies : Hands-on experience with AWS, Azure, or Google Cloud (GCP).

- Data Warehousing : Experience with Snowflake, Redshift, BigQuery, or similar solutions.

- Big Data Frameworks : Knowledge of the Hadoop ecosystem, Spark, or similar technologies.

- CI/CD & DevOps : Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines.

- Version Control : Experience with Git and collaborative development workflows.

- Data Governance : Understanding of data security, privacy, and compliance standards.

Preferred Qualifications :

- Experience with real-time data streaming tools like Kafka, Apache Flink, or Kinesis.

- Hands-on experience with Airflow or other workflow orchestration tools.

- Strong problem-solving skills and ability to work in an agile environment.

- Excellent communication and collaboration skills.