Data Engineer

Technical skills We use a broad range of tools, languages, and frameworks. We dont expect you to know them all but experience or exposure with some of these (or equivalents) will set you up for success in this team. Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform. Preferably with at least 8+ years of hands-on experience in a Data Engineering role. Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing. Preferably with at least 5+ years of hands-on experience. Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python. Proficient in SQL scripting, writing complex SQLs for building data pipelines. Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants. Experience in working in Agile teams, including working closely with internal business stakeholders. Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system. Certification on Cloudera CDP, Hadoop, Spark, Teradata, AWS, Ab Initio is a plus. Experience in Ab Initio software products (GDE, Co>Operating System, Express>It ) Experience in AWS technology (EMR, Redshift, DocumentDB, S3,)