Data Engineer - Chennai / Bangalore

Responsibilities

• 6+ years of experience in python scripting.
• Data Modeling and ETL Pipeline Development
• Experience with cloud platforms (AWS, Azure). Relevant experience of 5+ years for Azure DE and 4+ for AWS DE.
• Data ingestion and extraction from various sources (SQL, NoSQL, APIs, etc.)
• Proficient in enterprise Python language and its Data Structures to perform ETL operations of data using python.
• Exposed to python-oriented Algorithms libraries such as NumPy, pandas, beautiful soup, Selenium, pdfplumber, Requests etc.
  • Proficient in SQL programming, Postgres SQL.
  • Knowledge on DevOps like CI/CD, Jenkins, Git.
  • Experience working with AWS(S3) and Azure Databricks
• Data cleaning, transformation, and validation
• Collaborating with data analysts and business stakeholders

Desired Candidate Skills

• Programming: Proficiency in languages like Python.
• 5+ years for Azure DE and 4+ for AWS DE.
• ETL: Expertise in building and optimizing ETL pipelines.
• Cloud Platforms: Familiarity with AWS, Azure.
• Experience working with AWS(S3) and Azure Databricks