Data Engineer

• Build data pipeline infrastructure/process
• Upgrade the current data infrastructure
• Design database and data pipeline/ETL using emerging technologies and tools
• Drive the team to develop operationally efficient analytic solutions
• Define standards, methodologies for the Data Warehousing environment

Job Requirements:

• Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
• At least 3+ years of relevant experience as a data engineer
• Proficiency in Python and its common libraries
• Knowledge of Pandas and SQL connector
• Extensive experience in parsing files and can write classes
• Experience in writing queries to dedup and performing conditional aggregations using window functions
• Familiar with popular computing engines such as EC2, EMR, and Batch
• In-depth understanding of s3, EFS, awscli, and boto3
• Understanding of ETL processes can write modular code to facilitate better unit test of each module
• Experience with Apache airflow or Docker