Test Engineer (Python, PySpark, TypeScript, SQL, Automation)

Job Overview

We are seeking a highly skilled Test Engineer with expertise in Python, PySpark, TypeScript, and SQL, along with a strong background in automation testing for backend and frontend systems. This role is crucial to ensuring the quality, performance, and reliability of our products.

Role & responsibilities

As a Test Engineer, you will be responsible for designing, implementing, and executing comprehensive testing strategies for backend and frontend systems. You will work closely with cross-functional teams to ensure robust, scalable, and high-quality software solutions.

Key Responsibilities

1. Design, implement, and maintain automated test frameworks for backend data pipelines and frontend systems.
2. Validate data workflows, transformations, and models within Palantir Foundry.
3. Perform comprehensive testing of data pipelines, metrics, and transformations.
4. Validate business logic across all layers of data transformations.
5. Ensure data quality, accuracy, and completeness throughout the data pipeline.
6. Have Palantir Foundry knowledge for testing requirements
7. Conduct integration, system, and regression testing for both backend and frontend components.
8. Test Strategy and Planning
• Develop and document detailed test plans, strategies, and test cases for backend and frontend systems.
• Collaborate with product managers and developers to ensure comprehensive test coverage.
9. Automation Development
• Design and implement automation frameworks for backend testing using Python and PySpark.
• Frontend testing using TypeScript
• Integrate automated tests into CI/CD pipelines to streamline the development lifecycle.
10. Data Validation and Testing
• Validate data accuracy, transformations, and consistency using SQL queries.
• Test ETL processes and ensure the reliability of data pipelines.
11. Functional and Integration Testing
• Perform functional, integration, and regression testing for APIs, backend services, and frontend interfaces.
• Ensure seamless interaction between backend and frontend components.
12. Performance and Security Testing
• Conduct performance testing to evaluate the scalability and reliability of applications.
• Collaborate with security teams to validate application security and compliance with industry standards.
13. Defect Management
• Identify, document, and track defects using tools like JIRA, Azure DevOps, or similar.
• Collaborate with development teams to prioritize and resolve issues promptly.
14. Collaboration and Communication
• Work closely with developers, data engineers, and product teams to align on quality goals and deliverables.
• Provide regular updates on testing progress, coverage, and results to stakeholders.
15. Continuous Improvement
• Stay updated on the latest testing tools, frameworks, and industry trends.
• Propose and implement process improvements and automation to enhance testing efficiency and effectiveness.

Required Skills and Qualifications

• Proven experience in data testing, particularly in large, complex data environments.
• Experience testing data pipelines, transformations, and metrics.
• Programming Languages: Proficiency in Python for backend automation and TypeScript for frontend testing.
• Big Data Tools: Hands-on experience with PySpark for testing distributed data systems and pipelines.
• Database Skills: Strong expertise in SQL for data validation, query optimization, and testing.
• Automation Tools: Experience using Typescript for frontend testing.
• Backend Testing: Proficiency in API testing using tools like Postman, RestAssured, or similar frameworks.
• Defect Tracking Tools: Experience with tools like JIRA, Azure DevOps, or similar.
• CI/CD Tools: Familiarity with Jenkins, GitLab CI/CD, or similar tools for automated testing pipelines.
• Version Control: Proficiency with Git and collaborative workflows.

Plus: Strong proficiency in Palantir Foundry, including workflow development and data pipeline validation.

Preferred candidate profile

• Familiarity with cloud platforms like AWS and Palantir Foundry.
• Knowledge of Typescript, SQL, Python
• Experience with Automation
• Strong understanding of Agile methodologies and best practices.
• Excellent problem-solving and analytical skills, self starter!

Perks and benefits

• Competitive salary and global exposure.
• Flexible working hours and remote work options.
• Opportunities for professional growth and development.
• A collaborative and inclusive work environment.
• The chance to work on impactful projects with cutting-edge technologies.