Data Architect- AWS-Big Data

Position: Data Architect- AWS-Big Data

Purpose of the Position:

As a Data Architect, you will be responsible for designing and optimizing complex Big Data solutions using AWS services, ensuring a balance between cost and performance. Responsibilities include assessing existing technology, performing impact assessments, optimizing designs, and documenting projects. The role involves effective communication of architectural decisions, conducting Proof-of-Concepts and design solutions, suggesting automation and providing expert advice.

Location: Nagpur/Pune/Chennai/Bangalore

Type of Employment: Full-time

Key Result Areas and Activities:

• Technology Assessment and Impact Analysis: Evaluate existing technology and     data integration frameworks, and conduct impact assessments based on requirements.
• Big Data Use Case Design: Create complex Big Data use cases using AWS services, focusing on cost, performance, and durability.
• Optimization and Performance: Recommend optimizations to balance cost and performance in existing designs.
• Architectural Communication and Proof-of-Concepts: Communicate architectural decisions to stakeholders, conduct Proof-of-Concepts, document findings, and lead design reviews.
• Process Improvement and Automation: Implement automation to improve processes and enhance team productivity, while providing expert advice, troubleshooting, and support for client proposals.

Essential Skills:

• Experience of AWS services (S3,EC2, EMR, Athena, AWS Glue, Lambda) and AWS VPC, subnets, security groups, and route tables
• Expertise in MPP databases (AWS Redshift, Snowflake, SingleStore) and Data Warehousing concepts
• Proficient in Big Data technologies, specifically Apache Spark, and table formats like Delta Lake or Apache Iceberg
• Strong programming skills in Scala and Python, along with SQL proficiency and experience with orchestration tools like Apache Airflow
• Skilled in developing ETL workflows with complex transformations (SCD, deduplication, aggregation)
• Proficient in operating systems, including Linux and Windows

Desirable Skills:

• Prior experience working in a large media company would be an added advantage. Knowledge of Data Fabric and Data Mesh concepts
• Programming Language: Java, Bash
• Cloud Databases: AWS Aurora

Qualifications:

• Bachelor's degree in computer science, engineering, or related field (Master's degree is a plus)
• Demonstrated continued learning through one or more technical certifications or related methods
• 9 years of IT experience with minimum 5+ years of experience on cloud-related projects

Qualities:

• Hold strong technical knowledge and experience with the capability to deep dive and research in various technical fields
• Self-motivated and focused on delivering outcomes for a fast-growing team and organization
• Able to communicate persuasively through written, verbal and client presentations
• Effective and self-organized in cross-functional team and across different time zones