Senior ELK Data Engineer (5-8 yrs)

Job Title : Senior ELK Data Engineer

Experience : 5-8 Years

Location : Bangalore, Hyderabad

Job Type : Contract (6 months)

Mode : C2C

Key Responsibilities :

~ Create Kibana dashboards and visualizations for monitoring logs, metrics, and system performance.

~ Implement indexing, sharding, and querying strategies to ensure efficient search performance.

~ Manage log aggregation, parsing, and transformation from diverse sources (e.g., servers, applications, cloud services).

~ Work with Elasticsearch APIs to develop custom search and analytics solutions.

~ Ensure data security, role-based access control (RBAC), and compliance with industry standards.

~ Integrate ELK with cloud environments (AWS, Azure, GCP) and containerized platforms like Docker and Kubernetes.

~ Automate deployments using Terraform, Ansible, or CI/CD pipelines.

~ Monitor, troubleshoot, and optimize Elasticsearch clusters, identifying performance bottlenecks

Required Skills & Experience :

~ 5+ years of experience in data engineering with at least 3 years working on ELK Stack (Elasticsearch, Logstash, Kibana, Beats).

~ Strong hands-on experience in Elasticsearch query DSL, index management, and cluster tuning.

~ Expertise in Logstash pipeline development, custom filters, and Beats configuration.

~ Proficiency in Python, Shell scripting, or Java for log processing and automation.

~ Experience with Kafka, Fluentd, or other log aggregation tools.

~ Strong understanding of scaling Elasticsearch clusters, sharding strategies, and performance tuning.

~ Knowledge of monitoring tools like Prometheus, Grafana, or OpenSearch.

~ Experience with cloud-based ELK deployments on AWS, Azure, or GCP.

~ Hands-on experience with Kubernetes, Docker, and Infrastructure as Code (IaC) tools.