Data Engineer

Job Description:

We are looking for a talented and motivated Data Engineer to join our dynamic team. This role involves working with modern cloud technologies, building scalable systems, and driving automation and data pipelines to support real-time streaming and event-driven applications. As a Data Engineer, you will be responsible for designing and implementing microservices, integrating cloud services, and building efficient solutions using various Python-based frameworks.

Key Responsibilities:

• Develop, maintain, and enhance data pipelines and microservices architecture using AWS cloud services and Python frameworks.
• Integrate with various AWS cloud tools such as AWS CDK, S3, Lambda, DynamoDB, EventBridge, Kinesis, and CloudWatch to implement scalable data engineering solutions.
• Design and build real-time streaming solutions and event-driven architectures that support high-volume data ingestion and processing.
• Work collaboratively with cross-functional teams to implement API architectures using FastAPI, GraphQL, and Pydantic.
• Ensure high-quality software development practices by applying knowledge of software development life cycle (SDLC) methodologies and best practices.
• Contribute to improving Continuous Integration (CI), Continuous Development (CD), and Test Driven Development (TDD) processes.

Required Skillset:

• Bachelors degree in information systems, Computer Science, or a related field.
• Minimum 4+ years of experience in software development, with at least 2+ years of hands-on experience working with Cloud technologies.
• Proficiency in Python 3.6 or higher, along with frameworks like Pytest.
• Solid understanding and hands-on experience with AWS Cloud tools and technologies (AWS CDK, S3, Lambda, DynamoDB, EventBridge, Kinesis, CloudWatch, etc.).
• Expertise in building microservices and APIs using FastAPI, GraphQL, and Pydantic.
• Strong experience in data engineering, real-time data streaming, and event-driven systems.
• In-depth knowledge of software development practices and attention to detail.
• Experience with version control systems like Git (Github, Bitbucket, etc.).