automation qa

One of the worlds great ecommerce companies requires an Automaton QA Engineer to join on a freelance basis.

• Embed automation testing in the development process, where applicable;
• Define and track quality metrics (test coverage, flakiness rate, MTTR, escape rate);
• Own test environment management and test data strategies;
• Support the CI/CD efforts, proposes test automation tooling and infrastructure and work with developers to build and maintain it;
• Actively contribute to the tech strategy by providing valuable insights on test automation and software quality in general;
• Stay up to date with new test automation technology and plan strategically for possible changes;
• Design and maintain automated tests across all layers: API, integration, contract, and UI;
• Build evaluation frameworks - covering success rates, latency, error handling, and graceful degradation when AI-driven systems produce unexpected results;
• Become the 'Go to' person for the test automation topic for both business and tech stakeholders;
• Work with development team to understand the business needs and identify the quality requirements;
• Contribute to incident response and post-mortems with quality-focused root cause analysis;
• Plan and prioritise the different strategies according to business needs;
• Evaluate internal testing tools and introduce new ones with clear migration paths and deprecation plans.

• 6-8 Years of experience in high technological environment in a similar role;
• Understanding of non-deterministic systems and ability to design test approaches that use thresholds, scoring, and statistical confidence rather than exact-match assertions;
• Proficient in Java or Javascript;
• Hands-on experience using AI coding tools in daily development workflow;
• Expert in unit or automation test frameworks like JUnit, TestNG, Mockito, Playwright, Postman, JMeter, REST Assured etc;
• Experience developing fully automated CI/CD pipeline, working with CI & source control tools & using Jenkins, GitHub, Gitlab, Octopus, TFS/other;
• Experience testing distributed systems at the API/service level (REST, gRPC);
• Ability to choose the right test framework in accordance with the needs of the project balancing against trade-offs;
• Nice to have: experience in design and maintain test strategies for MCP tools and the MCP App.

• Contract role;
• Initial 3 months with possible extension;
• Requires 2 days a week in the Amsterdam office with the rest of the week working from home.