Big Data Engineer

Position AWS- Big Data Engineer

AWS Big Data Tools Amazon EMR, Amazon Redshift, Amazon Athena & AWS Glue

Programming Languages Python, Scala, or Java

Role L2 Level support

Location Chennai

Windows Support 24/7

Experience range 3 to 5Years

Reporting to Technical Lead

Seniority level Entry / Associate

Employment type Full time

Job Function Big Data

Number of Vacancies 1

Industry Information Technology & Services

Annual salary Range

Education B.E/ B. tech specialization in ECE, EEE, CS, IT

Roles & Responsibilities:

The range of activities that our AWS-Big Data Engineers get involved with is extensive and includes:

• Monitor and optimize the performance, scalability, and cost efficiency of big data solutions on AWS
• Troubleshoot and resolve issues related to data processing, data integrity, and system performance
• Design, develop, and deploy scalable and reliable big data solutions on AWS using services like Amazon EMR, Amazon Redshift, Amazon Athena, and AWS Glue
• Develop and optimize ETL/ELT processes to transform and load data into data lakes or data warehouses
• Perform data exploration, data profiling, and data quality assessments to ensure data accuracy and consistency
• Implement security measures and data governance practices to ensure compliance with privacy and regulatory requirements
• Implement data ingestion pipelines to capture, process, and store large volumes of structured and unstructured data from various sources
• Collaborate with data scientists and analysts to design and implement data models and analytical frameworks for business intelligence and advanced analytics

Desire Skills and experience:

• Proficiency in big data technologies like Hadoop, Spark, Hive, or Presto
• Familiarity with data modelling and database design principles
• Experience in building and optimizing ETL/ELT pipelines using tools like Apache Airflow or AWS Step Functions
• Strong understanding of data warehousing concepts and experience with data warehouse solutions like Snowflake or Amazon Redshift
• Knowledge of data visualization tools (e.g., Tableau, Power BI) for creating dashboards and reports