Lead I - Data Engineering

Experience: 5-12 Years

Location: Trivandrum, Chennai, Kochi, Bangalore, Noida, Pune, Kolkata

• Hands-on experience with PySpark and GCP (or any other cloud platform).
• Strong proficiency in Python for data processing and automation.
• Expertise in designing, implementing, and optimizing data pipelines using Spark, Hadoop, and Hive .
• Strong knowledge of SQL for querying and data manipulation.
• Ability to collaborate with product managers and data stewards to gather requirements and translate them into scalable data workflows.
• Experience in monitoring and troubleshooting data pipelines to ensure high availability and performance.
• Strong problem-solving skills and ability to work in a team-oriented environment.
• Excellent written and verbal communication skills.

• Experience with BigQuery, Snowflake, or Redshift .
• Familiarity with CI/CD pipelines for data engineering.
• Knowledge of Airflow or similar workflow orchestration tools.
• Exposure to Kafka or other streaming technologies .