ELK Developer (7-8 yrs)

Essential Skills/Basic Qualifications :.

- Familiar with various logstash use cases, experience with use of different plugins for inputs, filters, outputs..

- Familiar with Elasticsearch query DSL, ideally has experience with use of aggregations and scripting in more complex Elasticsearch queries.

- Familiar with Kibana out-of-the -box visualization functionality, has built dashboards for different use cases.

- Familiar with use of filebeat and metricbeat and/or elastic agent.

- Awareness of alerting use cases (using watcher and/or kibana alerts).

- Awareness of role-based access models in Kibana.

- Awareness of Elastic APIs e.g. search, bulk, index, security APIs..

- Awareness of ELK stack architecture and administration (e.g. index lifecycle management using templates and ILM policies, concepts like shards and replicas for optimising resiliency and performance of Elasticsearch clusters).

- Experience with DevOps tools (use of version control e.g. git, some awareness of build orchestration tools e.g. Jenkins and package repos e.g. Nexus).

- Basic SQL querying knowledge.

Skills : ELK-stack, Splunk, DevOps tools, Kafka & AWS.

Years of Experience :

Overall Experience : Min. 7 years.

Relevant Experience - Min 4+ years

Responsibilities :

- Design, develop, and maintain efficient and scalable ELK pipelines for log aggregation, analysis, and visualization.

- Configure and optimize Logstash pipelines using various plugins for diverse input, filter, and output requirements.

- Develop complex Elasticsearch queries using Query DSL, including aggregations and scripting for advanced data analysis.

- Create insightful dashboards and visualizations in Kibana to monitor key performance indicators and identify trends.

- Implement and manage Filebeat, Metricbeat, and Elastic Agent for data collection and forwarding.

- Administer and optimize Elasticsearch clusters, including index lifecycle management (ILM), shard and replica configuration, and performance tuning.

- Implement alerting solutions using Watcher and/or Kibana alerts to proactively identify and address critical issues.

- Configure and manage role-based access control in Kibana to ensure data security and compliance.

- Utilize Elastic APIs (search, bulk, index, security) for programmatic interaction with the ELK stack.

- Integrate ELK solutions with DevOps tools, including version control systems (Git), build orchestration tools (Jenkins), and package repositories (Nexus).

- Participate in the development and maintenance of automated deployment and configuration processes.

- Work with Kafka for data ingestion and streaming.

- Work with AWS services that relate to the ELK stack, or that contribute data to the ELK stack.

- Analyze log data to identify patterns, anomalies, and potential issues.

- Generate reports and dashboards to provide insights into system performance and user behavior.

- Utilize basic SQL querying knowledge when needed.

- Troubleshoot and resolve issues related to the ELK stack and related components.

- Provide technical support to users and other teams.

- Evaluate and implement Splunk solutions as needed.