i
TalentBox Labs
10 TalentBox Labs Jobs
Senior Data Engineer - ETL Tools (7-10 yrs)
TalentBox Labs
posted 4d ago
Key skills for the job
Job Description :
- Design and implement scalable data migration pipelines from relational databases and teradata to AWS Databricks.
- Experience using IBM Data Stage, FiveTran, Airflow, and Databaricks Workflow
- Optimize ETL processes, performance tuning, and data transformations using Spark and SQL.
- Develop automation for data ingestion, validation, and quality checks in a cloud environment.
- Collaborate with architects and stakeholders to ensure a secure, efficient, and seamless migration.
Required Skills & Technologies :
- Databricks (Delta Lake, Unity Catalog, Workflows, Lakehouse Architecture)
- Apache Spark & SQL for large-scale data processing
- AWS Cloud Services (S3, Glue, Lambda, Redshift)
- Relational Databases (Oracle, SQL Server, DB2, Teradata)
- ETL/ELT tools (IBM DataStage, Apache Airflow, FiveTran)
- Data Modeling, Performance Tuning, and Query Optimization
- Automation, Data Quality, and Governance Best Practices
Functional Areas: Software/Testing/Networking
Read full job description