Check in

Demo + eval tracker

Result

The VergeCare demo, the market it serves, and every measured run of the pipeline — newest last.

Run run-3 · 6 clips · 2026-11-03

Demo

VergeCare Demo (Beta) — Meta Global AI Hackathon 2026. Film a repair issue, get a snag list, matched handymen, and tracked bills.

Latest scores · run-3

Trade routing
6/6 · 100%
Severity triage
6/6 · 100%
SAM 3.1 grounded clips
0/6 · 0%
Pipeline per clip
12-29s

Homes and landlords to go

TAM: ~2.3B households worldwide (derived from Euromonitor 2024). SOM: UK, US, and Nigeria.

United Kingdom~5.5M privately rented homes (HMRC 2024-25)
2.88M landlords
United States~10–11M individual landlords (Census RHFS, IRS/HUD)
48M rental units
Nigeria~28M incl. substandard homes; Lagos 1.38M rental households (FMoH 2026; Lagos Housing Market Vol. 3)
15M-unit deficit

UK landlords and Manchester tenants first; Lagos rental density (~77% renters) makes Nigeria the scale play.

History

  1. tuning-1 · 2026-11-01 · 2 clips · unscored

    2 single-clip trials from staged clips (/tmp/eval-01only, /tmp/eval-06only); observational, unscored. Window work routed to Carpenter, so Window fitter joined the trade choices the same morning (commit f37cdde).

    • Spot-checked 2 clips: 01 gardener + 06 window.
    • Window work misrouted to Carpenter — added Window fitter.
    • Fix shipped same morning: commit f37cdde.
  2. pilot-1 · 2026-11-02 · 6 clips · trade 6/6 (100%)

    6 held-out WhatsApp field clips; filename labels as ground truth. Mid-frame still per clip for SAM grounding. Severity misses all run high→low/medium; the rubric rates high as active water/gas/power/security, so the high labels are under review.

    • Trade routing 100% (6/6) — every clip sent to the right tradesman.
    • SAM 3.1 grounded damage in 50% (3/6); all 3 boxes held the issue.
    • Full pipeline 12–22s per clip: film, narrate, snag list.
    • 6 held-out WhatsApp field clips, filename labels as ground truth.
    • Severity 33% (2/6) vs strict labels — high means water/gas/power only.
  3. run-3 · 2026-11-03 · 6 clips · trade 6/6 (100%)

    9 check-ins from 3 independent demo users (Derby, London, Texas), rescored under the narrated-only rule: 6 scored, 3 excluded (2 mumbled, 1 TV audio — all listed in RESULTS.md). 17 trade choices incl. Window fitter. Clean sweep on strangers' clips: 6/6 trade, 6/6 severity. Combined narrated n=12: trade 12/12 (100%), severity 8/12 (67%). Full n=15 incl. excluded: trade 14/15 (93%), severity 11/15 (73%).

    • Run 3: 6/6 trade + 6/6 severity on new users' clips.
    • Narrated n=12: trade 12/12 (100%), severity 8/12.
    • 3 homes (Derby, London, Texas); names withheld.
    • 3 unnarrated clips excluded, all listed.

Clips · run-3

ClipTradeSeveritySAM
07 blindstruth: Window fitterHit Window fitterHit lowGrounding not re-run on run-3 clips
10 cracktruth: PlastererHit PlastererHit lowGrounding not re-run on run-3 clips
11 blindstruth: Window fitterHit Window fitterHit lowGrounding not re-run on run-3 clips
13 bulbtruth: ElectricianHit ElectricianHit lowGrounding not re-run on run-3 clips
14 cracktruth: PlastererHit PlastererHit lowGrounding not re-run on run-3 clips
15 mouldtruth: CleanerHit CleanerHit mediumGrounding not re-run on run-3 clips

muse-spark-1.2 + sam-3.1

9 check-ins from 3 independent demo users (Derby, London, Texas), rescored under the narrated-only rule: 6 scored, 3 excluded (2 mumbled, 1 TV audio — all listed in RESULTS.md). 17 trade choices incl. Window fitter. Clean sweep on strangers' clips: 6/6 trade, 6/6 severity. Combined narrated n=12: trade 12/12 (100%), severity 8/12 (67%). Full n=15 incl. excluded: trade 14/15 (93%), severity 11/15 (73%).

Suite

  • 152 tests across 24 files (2026-11-02)
  • 51 commits in 5 days, solo indie build

Pipeline

  • 17 trades, 31 fallback objects
  • ≤20s per clip, 50MB cap, ≤3 SAM boxes per issue