Senior Observability Engineer - Splunk (5-6 yrs)

Responsibilities :

- Design and implement a comprehensive observability framework to monitor, log, and analyze data across our distributed infrastructure stack.

- Utilize Splunk as a core platform for data ingestion, transformation, and visualization.

- Configure and manage Splunk components, including indexers, forwarders, search heads, and dashboards.

- Integrate Splunk with other observability tools (e., Dynatrace, OpenTelemetry, OpenSearch) to create a unified monitoring experience.

- Implement best practices for log management, including log collection, parsing, and enrichment.

- Develop and maintain alerting rules to proactively identify and notify teams of potential issues.

- Collaborate with DevOps engineers to ensure seamless integration of observability practices into the development lifecycle.

- Automate monitoring and logging tasks using tools like Ansible or Puppet.

- Maintain and troubleshoot the Splunk environment, ensuring optimal performance and scalability.

- Stay up-to-date on the latest advancements in observability tools and technologies.

- Participate in knowledge sharing and provide guidance to junior team members.

Technical Skills (Must-Have) :

- 5+ years of experience in designing and implementing observability solutions.

- Proven expertise in Splunk, with hands-on experience in configuration, administration, and search queries.

- Strong understanding of Red Hat Enterprise Linux (RHEL) and familiarity with Linux administration principles.

- Experience with open-source observability tools (e., OpenTelemetry, OpenSearch) is a plus.

- Technical Skills (Good to Have) :

- Experience with enterprise observability tools from different vendors (e., Dynatrace, Sahara).

- Experience with public cloud observability offerings (AWS CloudWatch, Azure Monitor, GCP Cloud Monitoring) is a plus.

- Experience with writing test plans and automation scripts for observability tools