Python DevOps Engineer - Linux OS (5-9 yrs)

Senior Developer / Technical Lead

STRICTLY NEED RESOURCE WITH LINUX BACKGROUND. NO INSTITUTION TRAINING.

Years of Exp . - Min 5+ years

Primary Skill - Python DevOps

Project type - Development

Shift involved - 12 to 9 P.M IST

Key Responsibilities :

- Data Pipeline Development : Design, develop, and optimize scalable, robust, and reliable data pipelines using Python and other relevant technologies.

- ETL Processes : Implement and maintain ETL processes to extract, transform, and load data from various sources into data warehouses or data lakes.

- Data Integration : Work with APIs, third-party data providers, and internal data sources to integrate and manage data efficiently.

- Database Management : Design and maintain relational and non-relational databases (e.g., SQL, NoSQL).

- Performance Optimization : Monitor, troubleshoot, and improve the performance of data pipelines and infrastructure.

- Collaboration : Work closely with data analysts, data scientists, and other stakeholders to understand data requirements and ensure data quality.

- Data Governance : Implement data validation, data quality checks, and ensure compliance with data governance and security policies.

- Automation : Identify opportunities for automation to improve data processes and workflows.

Skills and Qualifications :

Technical Skills :

- Proficiency in Python, including libraries such as Pandas, NumPy, PySpark, or Dask.

- Experience with big data frameworks like Hadoop, Spark, or Kafka is a plus.

- Knowledge of cloud platforms (e.g., AWS, GCP, Azure) and their data services.

- Hands-on experience with databases (e.g., PostgreSQL, MySQL, MongoDB, Cassandra).

- Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).

- Proficiency in using workflow orchestration tools like Apache Airflow or Luigi.

Soft Skills :

- Strong problem-solving and analytical skills.

Skill :

- DevOps / Jenkins- 5/5

- DevOps / Groovy- 5/5

- DevOps / Docker- 5/5

- DevOps / GIT- 4/5

- Python scripting- 3/5

- DevOps / Gradle- 4/5

- Communication- 5/5

- Problem Solving- 5/5