Technozis - Data Engineer - ETL/Python (2-6 yrs)

Job Description :

Key Responsibilities :

- Build ETL pipelines on AWS Cloud, setup S3 Trigger based process, monitor data ingestion workflow, etc.

- Make necessary amendments in the ETL pipelines and maintain/optimise the AWS Redshift datawarehouse.

- Data discovery, build, develop and maintain data models, reporting systems, data automation systems, dashboards and performance metrics support that support key business decisions

- Design and build technical processes to address business issues.

Education and Work Experience Requirements :

- 2-6 years of software/data engineering experience using Python.

- Hands-on experience in data integration(ETL/ELT) development using multiple languages (eg: Java, Scala, Python, Pyspark, SparkSQL)

- Experience building and maintaining data pipelines supporting variety of integration patterns(batch, CDC, event streaming) and data lake/warehouse.

- Hands-on experience in SQL and Mongo DB.

- Knowledge in Cloud Technologies (AWS), CI/CD, Jenkins, Terraform, Kafka, dbezium,

Testing methodologies is preferred.

- Excellent written and verbal communication skills.

- Creating & Reading API and converting/storing data to readable format