Sr. QA Engineer (AI Products)

Build the safety net for products with probabilistic outputs and model behaviour, where a wrong answer can reach a client.

About Lejit

Lejit is an AI-native law firm with same-day turnaround, enabled by AI and lawyers. Lejit AI runs a law firm's entire client journey. Our all-in-one platform provides outcome-based, full-stack legal services across four areas:

Tech for law firms
Legal work for businesses
AI-native law firm
Tech for in-house teams

The Role

At Lejit, we need a Sr. QA Engineer (AI Products) to build the safety net for products with probabilistic outputs and model behaviour, where a wrong answer can reach a client.

What You Will Do

Build automated test suites for web and APIs: Playwright or Cypress, API contract tests, and visual regression where useful.
Design evaluation-based tests for model behaviour: golden prompts, output-distribution checks, and spot-checks for hallucinated citations and wrong clauses, dates or parties.
Own CI gates, unreliable-test quarantine, regression tracking and release checklists in GitHub Actions.
Find edge cases in agent workflows: tool-loop retries, prompt injection, long-context truncation and partial streamed failures.
Work with lawyers to turn legal accuracy into test cases and acceptance criteria.

What We Need

4+ years of QA/automation.
REST or webhook testing.
Python or TypeScript scripting and GitHub Actions.
Experience with non-deterministic systems is a plus.