Site Reliability Engineer

As an SRE Engineer, you will be responsible for the Activate and Production Infrastructure. Your essential duties encompass ensuring the seamless operation and optimal performance of large-scale distributed software applications. Your role revolves around maintaining a robust and high-performing environment, contributing to the reliability of our services, and innovating solutions to guarantee 24/7 availability. By leveraging your technical expertise and dedication, you contribute to maintaining a seamless experience for our users while upholding the highest standards of operational excellence. Your specific responsibilities include:

Role and Responsibilities:

1. Monitoring and Alerting
   • Review existing and set up new monitoring tools and systems as needed to track system performance, key metrics.
2. Incident Management
   • monitor the alerts and logs to promptly identify incidents or anomalies.
   • Prioritize incidents based on severity and potential impact on stability and reliability.
   • Engage in effective incident resolution, applying necessary fixes and mitigations to restore normal operations.
3. On-Call Responsibilities
   • Organize on-call schedules to ensure 24/7 coverage for incident response.
   • Respond to alerts, troubleshoot issues, and coordinate with NOC and Engineering teams for incident resolution.
   • Conduct post-incident reviews to identify root causes, learn from incidents, and implement preventive measures.
4. Automation and Tooling
   • Review pre-existing and build new automation scripts and tools as needed to streamline repetitive tasks, enhance efficiency, and reduce manual errors.
   • Regularly update and maintain tools used for monitoring, deployment, and incident management to align with evolving needs.
5. Performance Optimization
   • Analyze application performance using profiling and monitoring tools to identify bottlenecks and areas for improvement.
   • Work on optimizations, infrastructure upgrades, and architectural improvements to enhance system performance and efficiency.
6. Capacity Planning and Scaling
   • Monitor resource utilization and trends to predict capacity needs and plan for scaling.
   • Scale resources, such as servers and databases, are based on usage patterns and anticipated growth to maintain performance and reliability. Also, automate the entire sizing process.
7. Disaster Recovery and Redundancy
   • Develop and maintain disaster recovery plans and procedures to ensure business continuity in case of failures or disasters.
   • Implement redundancy and failover strategies to minimize downtime and maintain service availability during failures.
8. Knowledge Sharing and Documentation
   • Create and maintain comprehensive documentation for configurations, procedures, incidents, and best practices.
   • Foster a culture of knowledge sharing within the team, conducting regular knowledge-sharing sessions and training programs.
9. Feedback Loop and Continuous Improvement
   • Collect feedback from incidents, post-mortems, and NOC/Dev team interactions to identify areas for improvement.
   • Continuously iterate on processes, tools, and systems based on feedback and lessons learned to drive continuous improvement.
10. Collaboration and Communication
    • Collaborate closely with Engineering and DC/NOC teams to align goals and priorities.
    • Ensure open and transparent communication within the team and with stakeholders, providing regular updates on incidents, progress, and initiatives.

• Bachelors degree in computer science or related disciplines
• Total 3+ years experience in software application/product support
• Ability to program using programming languages like Go, Scripting languages like Shell or Python
• Good to have prior experience in technical engineering
• A proactive approach to identify the problems, performance bottlenecks, and areas of improvement
• Must know, Networking, Database (MySQL) and Linux System concepts, Debugging and analyzing the core dumps
• Hands-on experience with monitoring and observability tools like Grafana, Nagios, Influx, ELK, etc.
• Familiarity with orchestration tools like Docker and Grafana and incident management systems like Zenduty
• Excellent communication and collaboration skills, with the ability to work effectively across teams.
• Self-motivated and positive mindset to examine any incidents