Data Engineer-Spark/Scala/AWS

Key Responsibilities:

Big Data Processing Development: Design, develop, and optimize data pipelines using Apache Spark (Scala/Java). Implement batch and real-time data processing solutions. Handle large-scale data transformations and aggregations.
Database Management (Oracle): Develop and optimize SQL queries for Oracle databases. Work on performance tuning, indexing, and data modeling.
ETL Development Data Integration: Build and manage ETL workflows to process structured and semi-structured data. Work on data ingestion, cleaning, transformation, and storage.
Good to Have - Cloud Automation (Optional but Preferred): Experience working with Unix/Linux environments for scripting and automation. Exposure to CI/CD for automated deployment of data pipelines. Knowledge of Python for additional scripting and automation. Familiarity with Snowflake and AWS services (S3, Glue, EMR, RDS, etc.) is a plus.

Required Skills:

Must have Apache Spark (Scala/Java) for data processing Scala Java for backend data engineering Oracle database development and optimization
Good to Have: Unix/Linux scripting CI/CD Pipelines for automation Python for scripting and automation Snowflake for data warehousing AWS basic services (S3, Glue, EMR, RDS)

Skills:

• Apache Spark
• Java
• Oracle
• Scala
• Python
• Snowflake