Solution Designer - Data Architecture (15-17 yrs)

Job Title : Senior AWS End to End Solution Designer.

Job Description :

We are looking for a Senior AWS Data Solution Architect with extensive experience in the banking sector to lead the design and implementation of data and analytics solutions on AWS.

In this role, you will collaborate with cross-functional teams (including data scientists and analysts, to understand data requirements and deliver high-quality data solutions), engage with banking clients, and provide strategic guidance on data architecture, analytics, and cloud integration.

Key Responsibilities :

Architectural Design :

- Design, develop, and implement scalable and secure data and analytics solutions on AWS, ensuring alignment with business goals and regulatory requirements.

Data Strategy :

- Define and execute data strategies that leverage AWS services to collect, store, process, and analyze banking data efficiently and effectively.

Data Migration experience :

- Define and execute data migration strategies that leverage AWS migration services to migrate data efficiently and effectively.

- Migrate Cloudera based Hadoop data, jobs, users and access to Data services on AWS such AWS EMR, Glue, S3.

AWS Expertise :

- Utilize your expertise in AWS services such as Amazon EMR , S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions.

Data Modeling :

- Design data models and structures to support data processing, reporting, and advanced analytics needs, ensuring data accuracy and performance.

Data Quality :

- Implement data quality and data governance best practices to maintain data integrity.

Security and Compliance :

- Implement robust security measures and ensure compliance with industry standards, banking regulations, and AWS security best practices.

Data Governance :

- Define and enforce data governance policies and practices to maintain data quality and integrity.

Automation :

- Implement automation processes and best practices to streamline data workflows and reduce manual interventions.

Advanced Analytics :

- Lead the development of advanced analytics solutions, including machine learning and AI models, to provide actionable insights for banking clients.

Performance Optimization :

- Identify and resolve performance bottlenecks, tuning AWS configurations to maximize performance and cost-efficiency and storage solutions to ensure optimal performance.

Documentation :

- Create and maintain comprehensive documentation, including architectural diagrams, configurations, and best practices.

Mentorship :

- Provide guidance and mentorship to junior team members and share your expertise across the organization.

Data Integration :

- Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion.

Must have :

- Experience in Design, Development and Architecting of large Data migration projects.

- Handon on AWS Data services (AWS EMR, AWS Glue, AWS DataSync, AWS DMS, AWS Managed Kafka etc.

- Understanding ETL tools specially Informatica and AWS Glue.

- Experience working with bigdata ACID file formats to build delta lake, particularly with Iceberg file formats and loading methods of Iceberg.

- Good knowledge on Iceberg functionalities to use the delta features to identify the changed records, optimization and housekeeping on Iceberg tables in the data lake.

- Experience designing high standard batch solutions which involves end to end data processing.

- Good understanding of job dependencies and optimized scheduling strategies to ensure the smooth processing of the batch throughout the calendar days.

- As an end-to-end solution designer, should have experience of defining on the batch quality metrics and putting effective monitoring strategies in place.

Good to have :

- Experience on Hadoop ecosystem ie HDFS, Hive, Spark, Impala, Scala, Sqoop.Snowflake.

- Experience in Banking Domain.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Data Science, or related field.

- 15+ years of experience in data architecture, with a strong focus on the banking sector and data and analytics.

- Proven expertise in designing and implementing data solutions on AWS, with AWS certifications (e.g , AWS Certified Solutions Architect) being a strong advantage.

- In-depth knowledge of banking operations, regulations, and industry-specific data challenges.

- Experience with big data technologies, machine learning, and AI.

- Strong problem-solving and troubleshooting skills, with the ability to identify and resolve complex technical issues.

- Excellent communication and collaboration skills, including the ability to work effectively with technical and non-technical stakeholders.

- Familiarity with DevOps practices and tools for automating deployments and scaling.

- Strong understanding of data governance, data lineage, and data quality.