описание
TransPerfect helps organizations navigate the global marketplace. Founded in an NYU dorm room in 1992 and still founder-led, TransPerfect has grown into the world’s largest translation and language services company, with thousands of employees across more than 160 offices worldwide and over $1.3 billion in annual revenue.
The TransPerfect TechOps team builds and supports the technology behind that success – from workflow improvements and core GlobalLink platform services to AI-powered language solutions and scalable client-facing applications.
As a QA Engineer, you will help ensure the quality, reliability, security, and performance of our web applications, APIs, and AI-enabled products. You will design and maintain automated tests, perform hands-on exploratory and regression testing, and work closely with engineering and product teams to identify risks early. You will also use AI-assisted development and testing tools responsibly and contribute to validating AI/LLM features, including translation and other generated language outputs.
This position offers:
- A significant role in a dynamic QA team, part of a technology division within the world's largest provider of language services and technology solutions
- Ownership of test automation and opportunities to influence product quality and release readiness
- Collaboration with distributed product, development, and release teams
- Hands-on exposure to AI-enabled products, LLM evaluation, and modern AI-assisted testing workflows
- Opportunities to expand skills in automation frameworks, API testing, CI/CD, and responsible AI quality practices
задачи
- Design, implement, execute, and maintain automated functional, integration, regression, and API tests for web and mobile-enabled applications
- Build and improve scalable, maintainable test automation frameworks using Playwright, Selenium, or comparable tools, with appropriate code reviews and quality checks
- Integrate automated tests into CI/CD pipelines, analyze failures, reduce flaky tests, and provide timely feedback on release quality
- Create risk-based test strategies, test plans, test scenarios, and traceable test cases aligned with user stories and acceptance criteria
- Perform hands-on exploratory, cross-browser, system, end-to-end, database, and RESTful API testing as needed
- Validate data integrity, access control, error handling, usability, and compatibility across supported environments
- Identify, document, prioritize, and track defects in Azure DevOps or comparable tools, supplying clear steps, evidence, impact, and technical findings
- Work with developers, product managers, QA leads, and release managers to assess risks, investigate defects, and support release-readiness decisions
- Test AI-powered features and LLM-based workflows for functional correctness, output quality, reliability, and alignment with requirements
- Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation, terminology, fluency, formatting, and locale conventions; collaborate with language specialists when subject-matter review is needed
- Design repeatable AI test scenarios and evaluation datasets covering normal, edge, ambiguous, multilingual, and adversarial inputs
- Identify and document AI-specific failures, including hallucinations, omissions, inconsistent responses, bias, unsafe outputs, and failures to follow instructions or required formats
- Account for non-deterministic AI behavior by using appropriate evaluation rubrics, comparative baselines, sampling, and repeat testing rather than relying on exact-text assertions alone
- Use approved AI assistants to accelerate test-case design, test-data preparation, automation scripting, coverage analysis, debugging, and defect reporting; independently verify all AI-generated artifacts
- Assess the risks of AI-assisted testing workflows, including sensitive-data exposure, unsupported assumptions, fabricated test evidence, and weak assertions; follow company security and data-handling policies
- Maintain test assets and technical documentation, and proactively recommend improvements to test coverage, effectiveness, and execution efficiency
Communication:
- Communicate test progress, quality risks, defects, and release blockers clearly to QA, development, and product stakeholders
- Collaborate effectively with cross-functional teams across locations and time zones; participate in Agile planning, refinement, and daily standups
требования
- Bachelor’s degree in Computer Science, Engineering, a related discipline, or equivalent relevant experience
- Professional experience in software quality engineering with both manual and automated testing
- Hands-on experience developing and maintaining UI or API automation using Playwright, Selenium, or similar frameworks
- Programming proficiency in C#, Java, or a comparable language used for test automation
- Experience with RESTful API testing, debugging, test-data management, and validation of backend behavior
- Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps, TeamCity, or Jira
- Ability to analyze requirements, develop risk-based coverage, and maintain traceability from acceptance criteria to test results
- Familiarity with AI-assisted coding or testing tools, plus the judgment to review and validate generated code, test cases, and results
- Foundational understanding of LLM capabilities and limitations, including hallucinations, variable outputs, and the need for structured evaluation
- Strong analytical, troubleshooting, documentation, and communication skills; ability to work independently and collaboratively
- Experience testing AI/LLM applications, machine translation, retrieval-augmented generation (RAG), or other generative AI features
- Experience creating automated AI evaluations, quality rubrics, curated datasets, or regression benchmarks for model-generated outputs
- Knowledge of AI security and safety test scenarios, including prompt injection, data leakage, and inappropriate output handling
- Experience with .NET development, SQL/database validation, performance or load testing, and service virtualization
- Experience with AI coding assistants or agent-based QA workflows, including tool integrations and human-in-the-loop validation
- Professional working knowledge of an additional language, especially for multilingual product testing
- Ability to work across time zones and understand complex business workflows
By applying, I confirm I have read and accept TransPerfect's Privacy Policy: https://www.transperfect.com/about/data-privacy-recruiting