Software Engineer

Primary Skills-

• Primary is Python for ETL
• Cosmos GraphDB
• (API, JSON) experience

Job Title: Software Engineer with Strong Exposure and Interest in Data Engineering

We are seeking a talented Software Engineer with strong exposure and interest in Data Engineering to join our team. The ideal candidate will have experience in software development, strong API and JSON skills, and a passion for working with data.

Responsibilities:

• Design, develop, and maintain software applications that interact with data systems.
• Collaborate with cross-functional teams to identify data sources and requirements.
• Perform data cleaning, transformation, and augmentation using ETL tools and techniques.
• Monitor and optimize data pipelines for performance, reliability, and scalability.
• Implement and maintain data security and privacy measures.
• Analyze and document the existing architecture, workflows between various systems.
• Explore and implement new tools and technologies to improve data accuracy and efficiency.
• Stays up-to-date with the latest trends and technologies in software development and data engineering.

Requirements:

• Bachelors degree in Computer Science, Engineering, or related field.
• 6+ years of experience in software development or related field.
• Strong understanding of software development principles and practices.
• 2+ Years Experience with Python is required.
• Experience with Cosmos GraphDB and Gremlin required
• Familiarity with cloud Ecosystems like AWS, Azure or Google Cloud.
• Azure Blob Storage
• Strong API and JSON skills.
• Good understanding of tools such as PowerBI would be an added benefit.
• Understanding of how Front-end systems consume data from APIs.
• Advanced experience with Git Workflows and Actions
• 2 years of experience working on large scale, multiple team projects
• 2 years of experience with Agile methodologies and Test Driven Development
• Familiarity with modern data collection, augmentation, and ETL processes is a plus.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Ability to work independently with minimal supervision.

Skills:

• Azure Cloud
• Python
• API
• Azure Functions
• ADF
• Spark
• Scala
• Azure Data Bricks
• snowflake
• Oracle
• Airflow
• Hadoop
• ETL Skills

Skill Matrix

Skills :

• AWS
• Python
• Airflow
• Spark
• Scala
• SQL
• Shell Scripting

Customer provided below details for skills

• 7+ Years of Overall IT experience.
• 2+ Years Orchestration (Airflow or MWAA preferred. Spark flows experience a plus)
• 3+ Years of experience - AWS . Spark . Scala.
• 2+ Years of experience - Python . SQL . CI (Git preferred) . Devops. Healthcare Domain & Data Standards.

Nice to Have -

• Azure
• Shell scripting

Cosmos Db, Snowflake, Adb, Adf, Oracle, Api, Sql, Python, Json, Git, Scala, Aws, Shell Scripting, Spark, Etl