Data Engineer - ETL/Data Ingestion (7-12 yrs)

Responsibilities :

- Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks.

- Deploy and provide support for application codes and analytical models.

- Create and enhance data solutions that enable seamless integration and flow of data across the data ecosystem.

- Provide business analysis and develop ETL code and scripting to meet all technical specifications and business requirements according to the established designs.

- Develop real-time data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark (SQL, Scala, Java), Python, and Hadoop Platform and any Cloud Data Platform.

- Utilized multiple development languages/tools such as Python, SPARK, Hive, Presto, and Java to build prototypes and evaluate results for effectiveness and feasibility.

- Develop application systems that comply with the standard system development methodology and concepts for design, programming, backup, and recovery to deliver solutions that have superior performance and integrity.

- Offer system support as part of a support rotation with other team members.

- Operationalize open source data-analytic tools for enterprise use.