Senior ETL Developer (1-15 yrs)

Role : Senior ETL Developer

Job description :

- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big-data technologies.

- Prepare High Level Design and ETL design

- Creation and support of batch and real-time data pipelines built on AWS technologies including Glue, Redshift/Spectrum, Kinesis, EMR and Athena

- Able to design AWS ETL workflows and ETL mapping.

- Maintain large ETL workflows, Review and test ETL programs

- Work closely with business end users to analyze, translate, develop, and troubleshoot ETL code.

- Optimize ETL processes, SQL queries, and Azure Data Factory pipelines for improved performance and scalability.

- Recognize areas for automation.

- Design, develop, and deploy data pipelines using Azure Data Factory.

- Configure and manage Azure Data Factory activities, datasets, and linked services.

- Collect and Analyze in-depth, various campaign level data by applying various analytical quantitative techniques and provide suggestions relevant to the KPIs

- Conduct data collection, cleaning, processing and analysis

- Assist & lead in building infrastructure requirement for data extraction, transformation and loading from a variety of sources

- Conduct Exploratory Data Analysis to create an Analytical dataset

- Assist in troubleshooting data related issues

- Analyze large amounts of information to discover trends and patterns

- Design data integration framework and processes

- Work closely with Account Management Team to understand Campaign objectives, structure and metrics

Skills Required :

- Experience knowledge of SQL Server for managing large volume of data

- Experience in Azure

- Problem-solving, troubleshooting, automation, scripting, and familiarity with cloud platforms.

- Experience of dashboards with the use of visualization.