Reach opens on a single big Start button. That screen is deliberate: it's built for someone practising alone at home. But it hides almost everything else in the app. This sheet shows you where it all is.
/app.html?simple=0 and you go straight there. To show someone the patient's view, use /app.html?simple=1.
/app.html?demo=1. A clearly labelled synthetic patient moves instead, so you can explore every screen without a webcam.Advanced mode has four tabs along the top, plus a row of settings on the right of the header.
Header settings: affected side (the hand being recovered) · camera scores (which hand is being measured right now) · Swap L/R (turn this on if the wrong hand lights up green) · Calm (no confetti or animation) · Cheer-on (encouragement based on facial expression; runs on the device only) · ✎ Write a prescription (the clinician side, see §6).
The first dropdown in the Practice panel switches between three modes. Each mode adds a second dropdown with different contents:
Ready-made sets that run step by step. Skip › moves to the next step.
+ Build your own appears here as well: put steps together, set targets, save the routine, or share it as a plan code.
| Group | Challenges |
|---|---|
| Hand & Fingers | Finger Extension ⭐ (the hero movement) · Pinch · Finger Isolation · Open & Release · Open & Release, arm extended. Pick a finger from the finger menu where it applies. |
| Wrist / Forearm | Wrist Up & Down (beta) · Palm Up & Down (beta) |
| Elbow & Arm | Bend & Straighten · Reach & Return · Raise & Lower. Sit back so your upper body is in view. |
| Functional 🎯 | Ball → Bucket (pinch a ball, carry it, release it over the bucket) · Pick & Place (carry blocks across the midline: reach, pinch, cross, release). These are the Box-and-Blocks-style tasks. |
Finger Spread · Finger Taps · Thumb Opposition · Grip Squeeze (60s) · Free Play · Reach & Return (arm) · Mirror (experimental).
All of these are built and working. You only find them if you know where to look.
| Gem | What it is | Where |
|---|---|---|
| 🧱 Pick & Place | Box-and-Blocks-style carry across the midline. Target is 5 blocks. | Practice → Single challenge → Functional |
| 🎮 Game mode ("play as") | The same routine, with the same targets and measurements, presented as a game instead of guided reps. Fetch is the built-in example. | Practice → Guided routine → play as menu. It only appears in Guided routine. |
| ⚖️ The crossover | Once someone has practised both ways (guided and game), Progress compares the two side by side: reps, quality, pass rate, minutes. It's a within-person experiment. | Progress tab. Appears after sessions in both modes. |
| ▶ Today's set + Rough day | One tap starts today's set from the plan. Tick Rough day first for a shorter, gentler version. | Practice, after the camera is on |
| 😖 That one hurt | Marks the exact moment and attempt for the care team. Nothing stops. | Practice, during a session |
| 📏 Calibrate my range | Captures what this hand can do today so goals fit the person, not an average. | Practice → Calibrate my range |
| 🎯 Set personal neutral | For contracture or spasticity: records the person's own "straight" so the app measures from their zero. Alt-click to clear it. | Practice → Set personal neutral |
| 📋 Standard assessment | A fixed ~5-minute protocol (open/release, index extension, pinch, isolation, wrist, elbow, shoulder, reach, 30 seconds each). Practice adapts to the person; the assessment never changes, so results can be compared over time. | Assess tab. Calibrate first. |
| 🦴 Live joint angles | MCP · PIP · DIP angles for the focus finger, in degrees (180° = straight). | Practice → Live panel → Joints (live) (and Fingers (live)) |
| 📤 Data export | Download CSV gives one row per attempt plus a file explaining each column. Alt-click → JSON with frame-by-frame data · Alt+Shift-click → frame-by-frame CSV · Shift-click → raw trace of the current session. | Practice → Live panel → Tuning & instrument |
| ⏺ Record & replay | Saves the 21 hand points per frame, never video. Replay file… runs a saved recording back through the tracker. Useful for studying a session together. | Practice → Live panel → Tuning & instrument |
| 🖨 Report for the care team | A printable page with practice, trends and the latest assessment. Built on the device; nothing is uploaded. | Progress → Print report or Copy summary for your coach (also on Assess) |
| 🪞 Mirror | A mirror-feedback experiment. | Practice → Sandbox → Mirror (experimental) |
| Add this | What it does |
|---|---|
?demo=1 | Synthetic patient with no camera. Clearly labelled. |
?simple=1 / ?simple=0 | Forces the patient's one-button screen, or the full board. |
?coach=off | Same movements and targets, but no instructions, form correction or encouragement. This is the "coach on vs off" study condition. A badge shows that it's active. |
?lsl=1 | Syncs with Lab Streaming Layer, so Reach's timing lines up with EEG/fNIRS recordings in the lab. |
A starting point for the taxonomy workstream: which built movements touch which function. Test this against your own taxonomy; finding the gaps is the useful part.
| Function | Where it shows up in Reach today |
|---|---|
| Grasp → carry → release | Ball → Bucket · Pick & Place |
| Precision grip (pinch) | Pinch · Pinch Circuit · Thumb Opposition |
| Opening / release | Finger Extension ⭐ · Open & Release (incl. arm extended) · Steady Open |
| Individuation / pointing | Finger Isolation · Finger Taps · High Five |
| Crossing the midline | Pick & Place |
| Proximal arm | Bend & Straighten · Reach & Return · Raise & Lower |
| Stabilize · quick release (throwing) | Not covered yet. |
The coach view (dashboard, goal attainment, notes) needs the hosted sign-in. In this version, new patient pairings are switched off, so treat it as a preview of the design.