Elastic ELK Engineer (3-5 yrs)

About the Role :

We are looking for a highly skilled and experienced Elastic ELK Engineer to join our team.

You will be responsible for the full lifecycle management of our ELK stack, from installation and configuration to optimization, maintenance, and development.

The ideal candidate will have deep expertise in Elasticsearch, Kibana, and Logstash, and a passion for building robust and scalable solutions for data analysis and visualization.

You will play a critical role in ensuring the performance, availability, and security of our ELK infrastructure.

Key Responsibilities :

- Install, configure, and maintain Elasticsearch clusters, Kibana instances, and Logstash pipelines.

- This includes setting up appropriate configurations for memory, heap size, node roles, and other critical parameters.

- Optimize Elasticsearch clusters for performance, scalability, and resource utilization. This involves tuning index settings, query performance, shard allocation, and other factors to ensure efficient data retrieval and analysis.

- Develop and maintain Logstash pipelines for data ingestion, transformation, and enrichment.

- This includes writing Grok patterns, filters, and other configurations to parse and process various log formats.

- Implement and configure Kibana dashboards and visualizations for analyzing log data. This includes creating interactive dashboards, reports, and visualizations to provide insights into system performance, application usage, and other key metrics.

- Monitor and troubleshoot ELK stack performance and availability.

- Proactively address potential problems before they impact users.

- Ensure the integrity, security, and backup of Elasticsearch data. This includes implementing security measures such as authentication, authorization, and data encryption.

- Develop and test backup and recovery procedures to ensure data availability in case of disaster.

- Collaborate with development teams to integrate ELK solutions into various applications.

- Create and maintain technical documentation for the ELK stack, including installation guides, configuration settings, and troubleshooting procedures.

- Contribute to capacity planning for the ELK stack, forecasting future needs based on data growth and usage patterns.

- Stay up-to-date with the latest developments in the Elastic ecosystem, including new features, best practices, and security updates.

Required Skills and Qualifications :

- Strong hands-on experience with Elasticsearch, Kibana, and Logstash.

- Deep understanding of Elasticsearch architecture, including nodes, clusters, indexes, shards, and mappings.

- Proficiency in writing Grok patterns and configuring Logstash pipelines.

- Experience developing Kibana dashboards and visualizations.

- Strong troubleshooting and problem-solving skills.

- Experience with Linux operating systems.

- Knowledge of networking concepts and protocols.

- Excellent communication and collaboration skills.

- Ability to work independently and as part of a team.

Preferred Skills :

- Experience with other data visualization tools.

- Knowledge of scripting languages such as Python or Bash.

- Experience with cloud platforms such as AWS, Azure, or GCP.

- Familiarity with DevOps practices and tools.

- Experience with security best practices for ELK deployments