ETL Developer

1. Extract Data:

Data Extraction: Develop and manage processes to extract data from various sources (e.g., databases, APIs, flat files, web scraping, cloud services, etc.) in a structured or unstructured format.
Source Analysis: Analyze the data sources to understand the structure, format, and integrity of the data, ensuring it can be efficiently extracted for processing.

2. Transform Data:

Data Cleansing and Validation: Clean, filter, and validate the extracted data to ensure accuracy, consistency, and quality. Handle missing or corrupted data by applying transformation rules.
Data Transformation: Apply business rules, aggregation, and formatting to transform data into the appropriate format for loading into the target system. This could include combining data from multiple sources, changing data types, and performing calculations.
Data Mapping: Create data mappings to match source data with target systems, ensuring that the correct data is placed in the right fields.