AWS Redshift Administrator - Cluster Management (6-10 yrs)

Job Description :

- Should have minimum of 2-7 years of Experience with AWS Redshift or another analytic column-store.

- Should have set up Redshift clusters from scratch and involved in planning the cluster, deployment and administration.

- 2+ years of experience with SQL analysis, troubleshooting activities, including data warehousing, analytical applications support.

- Experience in working on AWS technologies, AWS services, AWS CLI & S3 storage understanding.

- Strong knowledge on multiple cloud technologies including VPC, EC2, S3, Amazon API Gateway, DynamoDB, SimpleDB, AWS Route 53

- 2 -3 years IT operation with strong understanding of database structures, theories, principles, and practices is an added advantage.

- Ability to read, understand and communicate complex technical information or queries.

- Ability to express ideas in an organized, articulate and concise manner

- Any certification regarding Redshift Administration services will be an added advantage.

- Should have a good understanding of services business for fortune 1000 from the operations point of view

- Should have good understanding of ITIL processes, operations support and ticketing tools

Roles & Responsibilities :

Redshift Cluster Planning :

- Principal points to consider in choosing the cluster.

- Analyze the sizing of the cluster and an estimated need of storage.

- Given a scenario and workload pattern, analyze the Redshift workloads i.e., Data integration, Workflow orchestration and Analysis.

- Cluster sizing & Benchmarking: given a scenario and frequency of execution, identify the specifics for the workload, including CPU, memory, storage, disk I/O

Cluster Administration :

- Deploy and administer AWS Redshift, columnar data lake, and SQL query engines.

- Modifications to any existing databases with appropriate impact analysis.

- Automate provisioning, operation, monitoring and troubleshooting of the database and data lake infrastructure.

- Provide consistent database maintenance, optimization and best practices inputs to existing Redshift and SQL databases, data lake, SQL engines, and applications.

- Development and testing support - Helping programmers and engineers to efficiently utilize the database.

- Integrity - Verifying or helping to verify data integrity

- Availability - Ensuring maximum uptime

- Performance - Ensuring maximum performance.

- Establish and maintain sound backup and Disaster Recovery (DR) policies with RPO/RTO objectives and procedures.

Cluster Maintenance :

- Regular maintenance and data cleanups.

- Troubleshooting error

- User on-boarding

- Should be able to scan logs, errors, exception and get to the root cause of the issue

Cluster monitoring :

- Redshift admins must monitor the database performance and evaluate complex information coming from a variety of sources.

- Suggest and implement service improvements for enhancing monitoring and alerting

- Configure automated alerts and notifications.

- Strong CloudWatch monitoring experience

Cluster security :

- Implement and maintain database security (create and maintain users and roles, assign privileges).

- Security - Defining and/or implementing access controls to the data

- Apply authorized checks & validation procedures.

- Manage customer calls and analyze issues reported by customer

- Should be capable of working independently & responsible for L1/L2/L3 Support

- Should work with complete ownership and handle all issues without missing SLA's

- Work closely with engineering team and support team for productionizing new use cases, users

- Should be able to debug the issues and report appropriately in the ticketing system

- Handover the shift and circulate a daily report to stakeholders

- Contribute to improve the efficiency of the assignment by quality improvements & innovative suggestions

- Should be customer oriented and willing to work in 24/7 shifts

- Contribute in developing a knowledge base on collaboration with other team members

- Maintain customer loyalty through Integrity and accountability

- Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.

- Working with data delivery teams to setup new users.

- Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.

- Point of Contact for Vendor escalation

- Working with application teams for system upgrades and patches.

- Maintain and publish a platform roadmap forecasting all upgrades, patches, capacity changes, and new services.

- Cluster and application problem resolution for restoring service

- Drive operational enhancements back to the product organization

- Create runbooks & troubleshooting guides & knowledge base

- Notify applications teams to compress or purge files while necessary