Review automated test repairs without weakening assertions

What self-healing is — and isn’t

Strip away the marketing and self-healing is one operation: when an element a test targets can no longer be found, the system re-identifies it from context and updates the locator. That’s it. Done well, it compresses hours of mechanical repair after every redesign into a reviewable diff. Done badly, it quietly re-points assertions at whatever element looks closest — including brand-new, half-built UI — and your suite reports green while the product regresses underneath it.

The scope boundary matters as much as the mechanism. Self-healing addresses locator drift: the element still exists, still serves the same user purpose, but its DOM coordinates changed. It does not address changed behavior, changed copy semantics, or broken flows. A tool that claims to “heal” failing assertions by rewriting them is not maintaining your tests; it is deleting your safety net one rewrite at a time.

Locator ranking is most of the battle

The amount of healing a suite needs is largely decided at authoring time. A recorder that grabs the first matching CSS path creates maximal future damage; a generator that ranks candidates creates almost none. Every serious implementation converges on roughly the same ladder:

# Locator ranking, best to worst
1. data-testid             (purpose-built, stable across redesigns)
2. role + accessible name  (getByRole('button', { name: 'Checkout' }))
3. label association       (getByLabel('Email') for form fields)
4. unique text content     (human-meaningful, survives restyling)
5. structural CSS / XPath  (last resort — breaks on any DOM change)

Roles and accessible names survive styling overhauls because they describe what the element is, not where it sits in the tree. If your current stack makes this ranking awkward, our Playwright vs Cypress comparison covers how their selector engines differ. Healing then becomes narrow: re-run this same ranking when the primary candidate fails, constrained by what the step is supposed to accomplish.

Capture intent at authoring time

Here is the part most tools skip. To re-identify an element safely, you must know what it was for — not just what it looked like. “Click the third button” contains no recoverable intent; “click ‘Pay now’ to submit the order” contains plenty. When authoring (or generating) a test, record alongside each step: the semantic action, the target’s accessible identity, the assertion expected afterward, and a screenshot or accessibility snapshot at that point.

This metadata is cheap to store and priceless later. With it, healing is a verification problem: find candidate elements, keep the ones whose role, name, and position satisfy the recorded intent, propose the strongest one. Without it, healing degenerates into fuzzy text matching against pixels, which is exactly how suites get silently re-pointed at the wrong controls. AI-generated tests have an advantage here — generation pipelines that map flows first naturally produce steps with semantic labels attached — but hand-written suites benefit equally from disciplined naming and comments. The same authoring-time discipline underpins everything in our E2E practices guide.

The heal loop: propose, review, approve

A production-grade heal loop has five stages: detect the breakage, re-rank candidates against stored intent, verify the proposal (the new element must satisfy every recorded constraint), emit a diff with evidence, and wait for human approval before anything lands. The output should look like code review, because it is code review:

- // Checkout: submit order
- await page.click('div.checkout > form > button:nth-child(4)');
+ await page.getByRole('button', { name: 'Pay now' }).click();
  # Evidence: redesign commit moved checkout into a modal.
  # Candidate matched: role=button, name="Pay now", visible, enabled.
  # Post-step assertion held: confirmation banner appeared.

Review a locator change through the same process as other test code, then rerun the original assertion. Confirm that the target still serves the same purpose. Molar’s Mender remains in preview; do not assume automatic repair is enabled for a beta project.

Audit trails make healing defensible

The moment software starts editing your tests, “trust me” stops being acceptable. Every heal should be logged as a queryable record: which test, which step, old locator, new locator, match confidence, the run evidence that justified it, who approved it, and when. That record turns disputes (“did this test ever cover the old flow?”) into database lookups instead of archaeology, and it gives you the aggregate numbers that tell you whether healing is working: proposals per week, acceptance rate, mean time-to-heal, and — critically — heals later reverted, which are your false-positive signal.

Auditability also changes team behavior. Engineers accept machine-proposed diffs far more readily when rejection is one click and fully reversible; they resist anything that feels like it edits behind their back. Deterministic replay closes the loop — being able to replay the exact run that motivated a heal, with full DOM and network state, makes the evidence checkable rather than anecdotal.

Preserve the original assertion when changing a locator

Draw the line explicitly in policy, not just in code. Locators are mechanics — safe to re-rank with review. Assertions, step order, and coverage boundaries are semantics — never touched by automation. And diagnose before healing: if the same test fails intermittently rather than after a specific UI commit, you’re looking at flakiness, not drift, and healing will just paper over a race condition. Our flaky-tests field guide covers that diagnosis path, and the CI wiring that surfaces both failure classes is in the GitHub Actions guide.