Opening For Backend API integration

Job Description:

A Data Engineer with strong expertise in API integration such as GraphQL / RESTful API. Scalable and secure data pipelines for interacting with web-based APIs are to be built and maintained. The data flow between external systems and internal platforms is to be ensured, providing processed data for downstream analytics and reporting.

Key Responsibilities:

• Develop, implement, and maintain efficient data pipelines for performing CRUD operations on data via GraphQL / RESTful APIs in a seamless and efficient manner.
• Work closely with frontend and backend teams for smooth data integration across systems.
• Design and build scalable API integrations for fetching, processing, and storing data.
• Develop scripts and tools for writing processed data back to the website's APIs, ensuring data consistency, security, and correct API usage.
• Ensure data accuracy, consistency, and timely updates between websites and internal systems.
• Monitor and troubleshoot API integration issues to ensure minimal disruption and high system performance.
• Work closely with data teams to ensure that data fetched via APIs is properly cleaned, transformed, and loaded into internal systems for further analysis.
• Optimize API-related workflows and ensure efficient handling of large volumes of data.
• Create and maintain API documentation for internal and external stakeholders.

Essential Skills and Qualifications:

• Strong experience with GraphQL based API integrations, including CRUD operations.
• Strong programming skills in Python, SQL.
• Strong understanding of data formats (JSON, XML, CSV) and how to manipulate them for different API interactions
• Familiarity with API testing, error handling, and performance tuning.
• Familiarity in handling authentication mechanisms (e.g., OAuth, API Keys, JWT, etc.) for secure API connections.

Nice to have:

• Familiarity with AWS cloud platforms and their API integration services.
• Experience working with large-scale web data and interacting with third-party APIs.
• Knowledge of data processing frameworks and technologies like Spark.
• Understanding of security practices related to API access and data privacy.

Excellent problem-solving and troubleshooting skills.