Lead Data Engineer( immediate To 15 days joiners)

Required Skills:

• 8+ years of experience in data engineering, machine learning, AI, data warehousing, and data management Projects Med to Small.
• 3+ years in a leadership role, responsible for the direct oversight of a team of data engineers (offshore) where you oversaw day-to-day activities, attained delivery metrics, and provided technical coaching to staff (Must Have)
• Data processing programming using SQL, Python, and similar tools (Must Have).
• Solid experience with cloud-based data tools and platforms - AWS (Must Have), Azure or, Google (Nice To Have)
• Deep hands-on experience using databases and related technologies in a fast-paced business environment with large-scale and complex datasets including design and optimize queries, create data structures, and develop data models (Must Have)
• Be comfortable with building effective cross-team collaborative working relationships with people at all levels of the organization. (Must Have)
• Experience in enterprise level data platforms involving implementation of end-to-end data pipelines. (Must Have)
• Experience with column-oriented database technologies, Redshift (Must Have) Big Query or Vertica (Nice to Have), and traditional database systems SQL Server and Oracle (Must Have), MySQL (Nice to Have).
• Experience in architecting data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Matillion (Must Have but can be learned), Lambda (Preferred), Spark (Preferred), AWS Glue ETL (Nice to Have), Spark Streaming (Nice to Have), AWS Glue DataBrew (Nice to Have), Kinesis Data Firehose (Nice to Have)
• Logical programming in Python (Must Have), Spark (Preferred), PySpark (Nice to Have), Java(Nice to Have), Javascript(Nice to Have), and/or Scala (Nice to Have).
• Cloud-native data platform design with a focus on streaming and event-driven architectures (Preferred)