A11yLTLNav: Automatic Detection of Accessibility Navigation Failures

1University of Michigan 2University of Utah

arXiv preprint, 2026 · Under review at CHI 2027

Pressing Enter on Add to List opens a dialog, but keyboard focus stays on the trigger instead of entering the dialog. The temporal property detects this focus-management failure.
Opening the dialog leaves focus on its trigger. Figure 2. Paper · Enlarge

Abstract

For blind and low-vision (BLV) screen-reader users, a website that appears accessible in a static snapshot can become difficult or impossible to navigate once interaction begins. Yet, most automated accessibility checkers miss failures involving focus, interface state, and accessible feedback across interactions. We present A11yLTLNav, a property-based approach for automatically detecting accessibility navigation failures. Through a structured review of prior research, we organize accessibility navigation failures into a failure taxonomy and formalize a browser-observable subset as executable Linear Temporal Logic properties over action-state traces. A11yLTLNav combines random keyboard exploration with runtime property monitoring to detect these failures during interactions. We evaluate A11yLTLNav on 31 generated websites based on real-world websites and tasks. It reported 309 accessibility failures, of which 274 were confirmed, achieving 88.7% precision and identifying more confirmed failures than the comparison checkers. Our results show that A11yLTLNav transforms accessibility knowledge into reusable checks of interface behavior over time.

Video

A11yLTLNav project video · 4 min 59 s · Open video

Method

A11yLTLNav combines keyboard exploration, accessibility-state extraction, and runtime monitoring of temporal properties. Each reported violation records the triggering action and the observed state.

The checker selects a keyboard action, observes the resulting accessibility state, and checks temporal rules. A violation produces a failure log. The cycle repeats.
System overview. Figure 1 · Enlarge

Example property: opening a dialog should move keyboard focus inside.

G(openModal(d)→XfocusInside(d))
Temporal properties

G means “every time”; X means “in the next checked state”; d is the dialog. The checker observes the relevant state after the interaction settles.

Linear Temporal Logic (LTL) expresses rules about action sequences. Random testing tries varied sequences of available keyboard actions against those fixed rules. Each failure report records the interaction and resulting state.

Exploration does not guarantee that every failure will be found. Read the method.

Demos

Dialog focus

Before: Email button focused

The Email article button has keyboard focus before the email dialog opens.
Focus on the Email button.

After pressing Enter

The email dialog is now open, but the yellow focus annotation still points to the Email article button behind the dialog.
Dialog opens. Focus stays behind.

Opening the email dialog leaves focus on the background page.

Yellow outlines indicate keyboard focus.

Checker replay

00:03 · Focus stays outside. 01:47 · Escape does not close the player.

Checker replay reconstructed from timed screenshots.
Full replay · Evidence & checker output

Focus restoration

After preparing the email

The dialog says Email ready, but the yellow focus annotation identifies the page body instead of a dialog control.
“Email ready.” Focus falls to the page body.

After closing the dialog

The dialog is closed and keyboard focus remains on the page body rather than returning to the Email button.
Dialog closed. Original focus is not restored.
Full recording
Task: prepare an email, close the dialog, search for Chiefs.
All four annotated states

Text-editor navigation

SynthVis Pro's Audio editor, Visual editor, and preview. Open the walkthrough to see the annotated keyboard-focus explanation.
Interactive walkthrough
An exit-path check needs more than one Tab press.

Evaluation

Human-reviewed, deduplicated reports · 31 generated websites
CheckerReportedConfirmed
errors
False
positives
Precision
AxeStatic1817194.4%
WAVEStatic68343450.0%
Adapted TaskAuditAgentic27615811857.2%
A11yLTLNavRun 13092743588.7%

Confirmed errors were verified by human reviewers. Static checkers scanned the first page only; counts include findings relevant to blind and low-vision users. Paper · Table 4