Establish and maintain the overall test strategy and appropriate test pyramid to ensure comprehensive platform quality coverage. Own Test Automation Frameworks
Build, maintain and take ownership of the test automation repository and framework across frontend, backend and API layers.
Develop Automated API Tests
Create and maintain REST API tests covering functional, negative, integration and schema validation scenarios.
Develop automated tests for asynchronous processes involving polling, message queues and WebSockets. Develop End-to-End UI Tests
Build and maintain end-to-end UI automation tests using Playwright to validate platform functionality.
Test AI Agent Workflows
Implement smoke and integration tests covering AI agent deployment, authentication, MCP tool calls, logs, traces and memory-related functionality.
Integrate Tests into CI/CD Pipelines
Implement automated tests in CI/CD pipelines, including merge-request quality gates, scheduled regression runs and post-deployment smoke tests.
Maintain Cloud Test Environments
Support the provisioning and maintenance of AWS-based test environments to ensure reliable automated testing.
Perform root cause analysis of test failures, identify flaky tests and implement improvements to increase automation reliability. Monitor Application Behaviour
Use application logs, metrics and distributed tracing to investigate issues and assess platform performance.
Collaborate with Engineering Teams
Work with developers, platform engineers and AI specialists to identify quality risks early in the development lifecycle.
Review Technical Designs
Evaluate technical designs and recommend improvements to testability, reliability and overall product quality.
Report Quality Results and Risks
Communicate test results, report quality risks and continuously improve testing processes and practices.
Requirements
QA and Software Testing Experience
Minimum 5 years of experience in QA or Software Testing, including at least 3 years of hands‑on experience in Test Automation.
Test Strategy and Framework Ownership
Experience defining test strategies and independently managing test automation frameworks or repositories.
Programming Skills
Strong programming skills in Python or TypeScript, with practical experience applying them to test automation.
REST API Testing
Practical experience with REST API test automation, including functional, negative and integration testing scenarios.
API Schemas and Contract Testing
Knowledge of OpenAPI, JSON Schema validation and contract testing to verify API specifications and integrations.
Asynchronous Workflow Testing
Experience testing asynchronous workflows involving polling, message queues and WebSockets.
Authentication and Authorization
Understanding of OAuth2, OIDC, JWT and RBAC mechanisms used to secure application access and permissions.
Frontend Test Automation
Hands‑on experience with Playwright, preferably testing React-based single-page applications.
Test Reliability and CI/CD Integration
Experience identifying and reducing flaky tests and integrating automated testing into CI/CD pipelines, preferably GitLab CI.
Containerization and Cloud Infrastructure
Knowledge of Docker and containerized environments, with experience testing cloud-based applications and infrastructure, preferably AWS.
Monitoring and Observability
Familiarity with application logs, metrics and distributed tracing for investigating application behaviour and technical issues.
AI and LLM Application Testing
Understanding of LLM-based applications, AI agents and the specific challenges involved in testing AI-powered functionality.
AI Development Tools and Communication Skills
Experience using AI coding assistants, combined with strong analytical, troubleshooting and communication skills.
What we offer
B2B Contract
Employment based on a B2B contract
Stable and Dynamic International Firm
Opportunity to work in a stable, dynamically developing international company
Engaging Projects and Latest IT
Chance to participate in interesting projects and work with the latest information technologies
Competitive Rates
Attractive remuneration rates offeres
Renowned International Projects
Involvement in the most prestigious international project
MultiSport and Private Medical Care
MultiSport and Private Medical Care
Nice to have
AWS Services
Experience with AWS services such as Lambda, API Gateway, S3 and CloudWatch.
AI Agent Frameworks
Familiarity with LangGraph, CrewAI or AWS Strands.
LLM Evaluation Tools
Experience with DeepEval, Promptfoo or Ragas.
MCP and A2A Protocols
Knowledge of Model Context Protocol (MCP) and Agent-to-Agent (A2A) protocols.
RAG and Vector Databases
Experience with RAG pipelines, vector databases and retrieval-based applications.
Application Security
Understanding of OWASP security principles and application security testing.
Regulated Environments
Experience working in regulated environments or with GxP requirements.
Work with us
Test Automation Engineer in Warsaw – pracodawca: Seargin Ltd
Nasza firma to doskonały pracodawca, oferujący dynamiczne środowisko pracy w Gdańsku lub Warszawie, gdzie możesz rozwijać swoje umiejętności w obszarze DevOps i SecOps. Oferujemy atrakcyjne wynagrodzenie w modelu B2B, możliwość pracy nad międzynarodowymi projektami oraz dostęp do nowoczesnych technologii, co pozwala na realny wpływ na przyszłość technologii. Nasza kultura pracy sprzyja innowacjom i współpracy międzydziałowej, co czyni nas idealnym miejscem dla osób poszukujących satysfakcjonującej kariery.