Case Study Vestas Conversation Design

Halyard

A voice-first field agent for onshore wind technicians — guided procedure execution and diagnostic reasoning with no hands, no eyes, and no connectivity required.

OutcomeSpecified a fixed-phrase confirmation pattern for safety-critical steps that makes an ambiguous "yeah" structurally unable to advance a lockout sequence.

Halyard voice-first field agent shown across rugged field-service devices for wind turbine technicians.
Role
Lead Product & Conversation Designer
Agency
Symmetri
Client
Vestas
Scope
Field Research → Conversation Design → Product UX
Status
Delivered

The Challenge

A wind turbine technician spends the working day ninety metres up, inside a nacelle the size of a shipping container, wearing a fall-arrest harness, hearing protection, and gloves rated for electrical work. The machinery is loud. Their hands are on a torque wrench. And yet everything they need — the torque spec for this turbine variant, the isolation checklist, the fault history that would tell them another technician found the same problem four months ago — is on a tablet they cannot safely reach.

The result is a workflow built on interruption: stop, de-glove, retrieve the device, find the information, re-glove, resume. Fourteen times per turbine visit, on average, costing roughly two and a half minutes each — and often skipped entirely, with the technician working from memory instead. My client was building a voice-first agent to remove that interruption. I led research, conversation design, and product design from the acoustic field study through build-ready specification.

  • Contextual Inquiry
  • Acoustic Field Study
  • Conversation Design
  • Dialog State Modeling
  • Multimodal Wireframes

The Approach

I spent nine weeks across four sites in Scotland, Germany, and Texas — GWO-certified, harnessed, following the same protocols as the crew — running ride-alongs, nacelle contextual inquiry, and Wizard-of-Oz voice trials where I acted as the agent over radio while technicians worked. A parallel acoustic field study measured ambient noise at nine work positions across three turbine models, because the entire product direction depended on whether speech recognition could function in that environment.

The Wizard-of-Oz trials surfaced the design risk that shaped everything downstream: technicians respond to a read-aloud safety instruction with "yeah," "mm-hm," or a grunt — while still mid-step. A system that accepts that as confirmation will eventually advance a lockout procedure past an incomplete isolation. Every safety pattern in this project traces back to that one finding.

Research

Fourteen participants — technicians, site leads, and O&M managers — across ride-along observation, nacelle contextual inquiry, calibrated acoustic measurement, and eighteen Wizard-of-Oz voice sessions.

14×
avg. device interruptions per turbine visit
2m 40s
avg. cost per interruption, de-glove to resume
87dB
median ambient noise at the gearbox work position
22min
avg. time writing the service report, post-shift
F1

The de-gloving tax produces avoidance, not just delay

Six of nine technicians observed admitted to working from memory rather than looking up a specification, specifically because the lookup was too disruptive to be worth it. Two of those instances involved torque values.

"Getting the gloves off, finding the tablet, waiting for it to wake up, finding the right page — for a number I probably already know? I'll just do it."— P09 · Technician, 5 yrs, West Texas
F2

The nacelle is a dead zone in every sense

Cellular connectivity inside the nacelle was unusable in 100% of measured sessions, at every site, on every fleet. Technicians had already built workarounds — screenshotting pages before climbing — which are themselves a source of error when the work order updates after the screenshot was taken.

"Everyone screenshots. And when you need the one you didn't screenshot, you either climb down or you guess."— P05 · Technician, 2 yrs, Schleswig-Holstein
F3

Safety steps are where voice gets dangerous

When the researcher-as-agent read a safety isolation sequence aloud, technicians frequently responded with ambiguous acknowledgements while still performing the step. In a human radio exchange that's unremarkable. For an automated agent, it's a hazard — accepting "yeah" as confirmation of an electrical isolation step will eventually advance a procedure past an incomplete safety control.

"You say yeah because you're listening, not because you're done. If the thing takes that as done and moves on, that's how someone opens a panel that's still live."— P01 · Lead Technician, 11 yrs, Scottish Borders
F4

Technicians want a colleague, not a system

Technicians responded well to a register resembling a competent colleague on a radio — direct, willing to say "I don't know." They responded poorly to anything resembling a consumer voice assistant. Explicit uncertainty raised trust; confidence theatre was actively disliked.

"Don't make it chirpy. I need it to tell me the number and shut up. If it doesn't know, say it doesn't know — I'd rather that than it making something up."— P07 · Lead Technician, 13 yrs, West Texas

Personas

Three roles across the operational hierarchy. Ewan is the primary user — Halyard is designed for him first. Marisol governs the knowledge layer it creates. Thomas holds the safety accountability that determines whether it can be adopted in the field.

Wind Turbine Technician · The Primary User
Ewan MacRae
Scottish Borders · mixed Vestas fleet · 6 years in role
Age
31

Ewan is competent and physically confident on the tower — what slows him down is the non-routine: an unfamiliar fault, a variant-specific spec he doesn't have memorized. He's not hostile to technology, but his scepticism toward the tablet his employer issued him is earned: slow to wake, battery fails in the cold, half its functions need signal he doesn't have.

Design implications
Full offline is the price of entry — Ewan's entire productive window is a dead zone. The spec comes to him, not the reverse — he never removes his gloves to retrieve a number. Trust is earned by admitting uncertainty — he'll abandon the product permanently the first time it confidently states a wrong torque value.
Site Lead · The Knowledge Steward
Marisol Vega
West Texas · mixed GE/Vestas · 14 years, 5 as lead
Age
43

Twelve years in the nacelle before moving into leadership gives Marisol credibility a purely managerial appointment wouldn't have. She'd own Halyard's knowledge governance — when a technician flags that a spec is wrong, she decides whether it propagates fleet-wide, and she's acutely aware of the risk of institutionalizing an error.

Design implications
Field knowledge needs a human approval gate — contributed corrections never auto-adopt. Safety compliance needs a defensible audit trail — every confirmation, timestamped, attributable. Attribution matters for trust and reversal — every adopted correction retains its source and can be traced back.
O&M Manager · The Commercial & Safety Owner
Thomas Brandt
Northern Germany · 340 turbines, 11 sites, 62 technicians
Age
52

Thomas is the buyer, and the person most likely to kill the project — not from resistance to technology, but because he won't approve anything that could plausibly contribute to an incident. He's been in the industry long enough to have known people who were injured. Any pitch that leads with efficiency and treats safety as secondary fails with him immediately.

Design implications
Safety is the primary value proposition, not the second slide. The system must be architecturally unable to issue an unsafe instruction — advisory only, never commanding the turbine. The audit trail must satisfy an external auditor, not just an internal one — this is what makes Halyard defensible after an incident, and the reason Thomas can sign off.

Scope & Trade-offs

The brief could have grown into a general-purpose maintenance platform. I scoped it down to the interaction that actually removes the de-gloving tax, and deferred everything adjacent.

Turbine control was cut entirely — Halyard is advisory only, and any action affecting machine state runs through certified controls the technician operates directly. That boundary isn't a UX nicety; it's what makes the product approvable at all for a buyer like Thomas, whose primary objection is exactly this risk.

Predictive analytics, blade inspection and drone imagery, and offshore operations were deferred as different workflows for different users. Scheduling and dispatch stay with the existing CMMS — Halyard receives the work order, it doesn't create or optimize it. And autonomous report submission was never on the table: the technician always reviews and signs, and no report leaves the device unsigned.

  • Cut: Turbine Control
  • Deferred: Predictive Analytics
  • Deferred: Offshore Operations
  • Kept: Guided Procedure + Diagnostic Reasoning

What I Designed

Three functions, in priority order — documentation is deliberately third, a byproduct of the first two rather than a task the technician performs. Guided procedure execution reads torque specs, sequences, and safety steps aloud at the technician's pace, confirming critical steps explicitly and never advancing on a timer. Diagnostic reasoning lets the technician describe symptoms and hear likely causes ranked by probability, informed by fleet history — including what a specific previous technician found on this specific machine, with attribution spoken aloud.

Underneath both sits a register model that shifts from conversational to terse the moment the interaction crosses a safety boundary — sentences shorten, structure becomes numbered, and the confirmation requirement changes from any casual acknowledgement to one fixed phrase. The shift is itself a signal to the technician that the stakes have changed, backed by a two-tone earcon at the boundary and a 0.95 confidence floor with no margin for interpretation.

Information Architecture

A voice-primary product has no navigation the technician can browse or recover a wrong turn from — the architecture lives entirely in what the system can understand and what it holds in context. Thirty-one intents organize into six families, each with its own confidence floor and failure behaviour calibrated to the cost of being wrong, not to a single global accuracy target.

ORIENT4 intents · floor 0.70
Confirm asset contextRebind asset

Establish or confirm situational context. Safe to guess narrowly and ask for clarification.

RETRIEVE8 intents · floor 0.85
Get specification valueGet fault historyGet procedure reference

Fetch a spec, history, or reference value. Never fabricates — states uncertainty explicitly instead.

PROCEDURE7 intents · floor 0.80
Step-by-step guidanceProgress summary

Drives guided execution. On low confidence, repeats the step rather than advancing.

SAFETY5 intents · floor 0.95 + fixed phrase
Begin isolationConfirm safety stepEmergency halt

Isolation, lockout, verification, emergency stop. Halts and re-confirms on any ambiguity; escalates on repeat failure.

CAPTURE5 intents · floor 0.75
Record measured valueFlag knowledge correction

Records observations and values, always read back for confirmation before committing.

CONTROL2 intents · floor 0.65
Session controlPlayback control

Lowest stakes, cheap to retry — session and playback control only.

Task Flows

Four states from the dialog model, traced through a single turbine visit — from the moment Ewan wakes Halyard at the tower base to the safety gate that justifies the whole product.

S1 ORIENTING

Session start & context binding

Ewan · tower base, 06:38

Halyard binds to the work order, verifies the offline cache is current, and reads context aloud before Ewan climbs — the last moment he's likely to look at a screen for hours.

S3a ASIDE

Specification retrieval mid-procedure

Ewan · nacelle, 07:51

A three-word question — "what's the torque?" — contains no component, variant, or spec type. The context stack supplies all three; Halyard answers and returns to the exact step, position never lost.

S4 SAFETY_GATE

Isolation sequence — fixed-phrase confirmation

Ewan · nacelle, 08:14

Register shifts to terse. "Yeah, that's done" is rejected on semantics, not confidence — only "CONFIRM" advances the sequence. Three consecutive failures halt the procedure and log an anomaly.

S6 REPAIRING

Recognition failure & modality shift

Ewan · nacelle, 09:06 · 81 dB

Recognition degrades as the turbine idles for a running check. Halyard escalates through three repair tiers — never repeating a strategy, never apologizing — and defers to the screen the moment voice genuinely can't carry it.

Outcome

  • Delivered a build-ready conversation and product design system — dialog states, confidence thresholds, repair strategies, and six multimodal screens — handed to speech and platform engineering.
  • Specified the fixed-phrase confirmation pattern as an architectural safety control, not a UX preference — the design artifact Thomas needed to approve the pilot.
  • Designed the three-layer organizational learning model (lexicon, protocol, field knowledge) with governance built in at the point of contribution, not bolted on after.
  • Set the product's own bar: fewer than 3 device interruptions per visit (from a baseline of 14), and over 96% of safety steps explicitly confirmed — the two numbers that matter most to field adoption.

Session Start & Orientation 01 / 06

Tower base, 06:38. Ewan has arrived at Turbine 14 and woken Halyard. The system binds to the work order, verifies cache currency, and reads the context aloud. This is the only moment in the visit where he is likely to look at the screen before climbing.

Screen WF1 · Orientation
Session Start — Context Binding
Halyard has bound to WO-4471, cached the asset bundle, and is reading context. Connection present at tower base; will be lost on ascent. Cache verified current.
Ewan · Technician OR.01 S1 ORIENTING
Ruggedized handheld · chest mount
06:38CACHE OK
Halyard speaking
Reading session context
AssetT-14 · Vestas V112
Variant3.0 MW · Rev B
Work orderWO-4471
TypeGearbox inspection
TriggerTemp alarm · Tue
Procedures cached4 of 4
Spec tablesV112-B current
Fault history24 mo · 7 records
Revision checkD4 · current
Session opened · offline bundle verified
06:38
Steps
Diagram
History
Halt
dialog_transcript
06:38:04 → 06:38:31 · 27s
Tech
Halyard.
Wake phrase. S0 DORMANT → S1 ORIENTING. No response required beyond the listening earcon.
Earcon
[listening open — 90 ms, rising]
Replaces a spoken "I'm listening." Saves 1.1 s and one interruption.
Halyard
Turbine 14, Vestas V112, revision B. Work order 4471 — gearbox inspection following Tuesday's high-temperature alarm.
Conversational register. Two sentences, at the charter ceiling. Answer-first: the asset identity precedes the reason for the visit. S1
Halyard
Everything's cached and current. Seven fault records on this machine. Want the history before you go up?
Cache state is volunteered, not requested — Ewan needs to know before he climbs, because there is no recovery from a bad cache at 90 m. The offer is a question, not an assumption.
Tech
Not yet. I'll ask when I'm up.
Declined. No follow-up, no reminder. Charter rule 6 — Halyard does not acknowledge the acknowledgement.
System
S1 ORIENTING → S2 IDLE · context stack L0–L3 populated · open-mic window closed after 6 s
modality_split
Voice carries
  • Asset identity and variant
  • Work order purpose
  • Cache readiness
  • Offer of fault history
Screen carries
  • Same context, glanceable
  • Cache manifest detail
  • Revision currency proof
  • Persistent halt affordance
Neither carries
  • Full procedure text (on demand)
  • All 7 fault records (offered)
  • Spec tables (retrieved in context)

annotations — WF1

1
The screen and the voice say the same thing. This is the one screen where redundancy is correct. Ewan is at the tower base with gloves off and a moment to spare; letting him verify the binding visually before a two-hour ascent is worth the duplication. Every subsequent screen diverges from the voice. IA §5
2
Cache verification is volunteered, not requested. Halyard states cache currency unprompted because the cost of discovering a stale cache at 90 m is a wasted climb. This is one of only three unprompted disclosures in the system. CDS §1 charter
3
The revision check is shown as a proof, not a status. "D4 · current" tells Ewan which revision he is working to, not merely that a check passed. Research finding P8 — a technician working from a procedure two revisions out of date — is the direct source. Research P8
4
Halt is always the rightmost action and always red. Its position never changes across any screen in the system. Under stress, muscle memory is the only reliable navigation. CDS §7

Specification Retrieval 02 / 06

Nacelle, 07:51. Ewan is at step 7 of the gearbox procedure with a torque wrench in hand. He asks a three-word question that contains no component, no variant, and no specification type — and gets a fully qualified answer, because the context stack supplies all three.

Screen WF2 · Specification in Context
Spec Retrieval — The Core Interaction
Highest-frequency intent in the system. Offline, 340 ms response. The screen displays what was spoken, sized to be legible at arm's length in poor light without interaction.
Ewan · Technician RT.01 S3a ASIDE
Nacelle · no connectivity · 61 dB ambient
07:51OFFLINE
Halyard speaking
Specification · main bearing bolt
Torque · main bearing bolt
340
newton metres · ±10
V112-B · spec rev D4 · 12 bolts · star pattern
Step 7 of 14 Gearbox inspection
Torque check on main bearing bolts. Work in star pattern.
Oil sample — metal particulate noted
07:44
Cooler fan — intermittent operation
07:38
Steps
Diagram
History
Halt
dialog_transcript
07:51:12 → 07:51:19 · 7s
Tech
What's the torque?
Three words. No component, no variant, no spec type. Unanswerable without the context stack — there are eleven torque specifications in a V112 nacelle. conf 0.91
System
L5 step → step 7 expects torque / main_bearing_bolt · L2 asset → V112-B · spec lookup → 340 Nm ±10 · elapsed 340 ms
Resolution descends the stack. Step context supplies component and spec type; asset context supplies variant. The query is fully qualified before it reaches the spec table. IA §4
Halyard
Three hundred and forty newton metres, plus or minus ten.
Implicit grounding — confidence 0.91 is above the RETRIEVE floor of 0.85, so no echo. Numbers fully spoken, 15% slower than surrounding speech. Unit stated in full. RT.01
Tech
Star pattern on these?
Follow-up inside the 6-second open-mic window. No wake phrase needed.
Halyard
Yes. Twelve bolts, star pattern, two passes — half torque then full.
Answer first, detail second. The two-pass instruction was not asked for but is inseparable from correct execution — one of the few permitted elaborations.
System
S3a ASIDE → S3 GUIDING · returned to step 7, position preserved, no announcement
Ewan asked two questions mid-procedure. Position was never lost and the return was silent. He does not have to say "where were we." CDS §3 · S3a
modality_split
Voice carries
  • The value, unit, tolerance
  • Bolt count and pattern
  • Two-pass sequence
Screen carries
  • Value at glance distance
  • Spec provenance and revision
  • Step position in procedure
  • Running capture log
Neither carries
  • Torque sequence diagram (on demand)
  • Remaining 13 step texts

annotations — WF2

1
The screen is a receipt, not a request. The value appears after being spoken, at 34 px, legible at arm's length in poor light. Ewan does not need to look — but if he glances, verification costs nothing. The screen never asks him to interact.
2
Provenance is on screen, not in speech. "V112-B · spec rev D4" would cost 2.4 seconds spoken and Ewan almost never needs it. It is visible if he wants it, silent if he does not. This is the clearest example of the modality split working correctly. IA §5
3
The progress rail marks the safety step ahead in red. Step 11 is flagged before Ewan reaches it. He can see a safety gate approaching without being told, which lets him plan tool and position changes. CDS §2
4
The capture log is proof of the report being written. Two observations already recorded, timestamped. Ewan can see the report assembling itself, which is what makes him trust that he will not face a blank form at 16:30. Persona · Ewan
5
Offline is stated, never apologized for. The status strip says OFFLINE in amber as a fact. There is no degraded-mode warning, no reduced functionality notice — because there is no reduced functionality. IA §6
component_spec — value_readout
Numeral size
34px Barlow Condensed 600 — legible at 600 mm in 50 lux
Contrast
13.8:1 against card background — exceeds WCAG AAA for the gloved, goggled case
Tolerance display
Always shown with the value, never separated. Unit spelled in full, never abbreviated.
Provenance line
Variant · spec revision · quantity · pattern. Screen-only; never spoken unless requested.
Persistence
Remains until superseded by a new retrieval or a step advance. Never auto-dismisses.

Safety Gate — Isolation Sequence 03 / 06

08:14. Ewan needs to open the cooler panel, which requires electrical isolation. This is the screen and the dialog pattern that justify the product's existence. Register has shifted to terse. Only the fixed phrase advances the sequence.

Screen WF3 · Safety-Critical Confirmation
Isolation Gate — Terse Register
Step 2 of 4 in the isolation sequence. Ambiguous acknowledgement has just been rejected. The screen shifts to a distinctly different visual state — this is the only screen in the system with a red field.
Ewan · Technician SF.02 S4 SAFETY_GATE Terse
Nacelle · isolation sequence active
08:14ISOLATION
Awaiting confirmation
Say CONFIRM to advance
Isolation · step 2 of 4 LOTO · rev D4
Main breaker open. Lock applied. Tag signed.
Requires CONFIRM · fixed phrase only
Rejected"yeah, that's done"
ReasonNot a fixed phrase
Attempt1 of 3
ISO.01 — service mode, rotor locked
08:13
Steps
Diagram
History
Halt
dialog_transcript
08:13:40 → 08:14:22 · 42s
Halyard
That panel needs isolation first. Ready to start?
Still conversational — the boundary is flagged before it is crossed. Ewan is given a moment to prepare.
Tech
Go on.
Earcon
[register boundary — 180 ms, two-tone descending]
The only earcon that marks a register change. Learned within a session or two as "this part matters." CDS §8
Halyard
Isolation, step one of four. Turbine in service mode, rotor locked. Say CONFIRM.
Terse register. Rate 155 wpm. One clause per unit. Numbered. Fixed phrase demanded explicitly. S4
Tech
Confirm.
Earcon
[confirmation accepted — 140 ms, mid, warm]
No spoken acknowledgement. The earcon carries it and saves a full second per step. Over forty confirmations in a shift, that is meaningful. CDS §8
Halyard
Step two. Main breaker open, locked, tagged. Say CONFIRM.
Tech
Yeah, that's done.
Recognized cleanly at conf 0.97 — this is not a recognition failure. The words were heard perfectly. They simply do not reliably mean "the step is complete."
Halyard
Say CONFIRM.
Three words. No explanation, no apology, no softening. An explanation here would add 3 s to a safety sequence and imply the rule is negotiable. Ewan learns it once. CDS §7
Tech
Confirm.
System
LOGGED · step=ISO.02 | rev=D4 | tech=E.MacRae | ts=2026-03-14T08:14:19Z | conf=0.96 | phrase="confirm"
The audit record. This artefact is why Thomas Brandt signs the contract. Timestamped, attributed, revision-qualified, confidence-scored. Defensible to an external auditor. Persona · Thomas
modality_split
Voice carries
  • The step instruction
  • The confirmation demand
  • The rejection
Screen carries
  • Why the last attempt failed
  • Attempt count before halt
  • Sequence position
  • Completed step audit trail
Neither carries
  • The rule's rationale — taught once, in training
  • Full LOTO procedure text

annotations — WF3

1
This is the only screen in the system with a red field. Red is reserved exclusively for the safety gate and the halt action. Its scarcity is what gives it meaning — a technician who sees red knows immediately which of two things is happening.
2
Non-safety navigation is dimmed, not removed. Steps, Diagram, and History drop to 35% opacity during isolation. They remain reachable — removing them would be patronizing and could obstruct a legitimate need — but the visual weight says not now.
3
The rejection is explained on screen, not in speech. Voice says only "Say CONFIRM." The screen carries the reason and the attempt count. This is the modality split doing precise work: speech optimizes for time, screen optimizes for detail.
4
Attempt count is visible before it matters. "1 of 3" tells Ewan the sequence will halt on the third failure — before he gets there. Halting without warning would feel punitive. CDS §3 · S4a
5
The whole pattern traces to one research finding. F4 in Document 02 recorded technicians saying "yeah" while still performing the step. Everything on this screen exists to make that failure mode impossible. Research F4

Diagnostic Conversation 04 / 06

08:32. Isolation complete, panel open, cooler fan confirmed faulty. Ewan wants to know whether this has happened before. Halyard surfaces L3 field knowledge — a previous technician's finding, with attribution — and the register relaxes back to conversational.

Screen WF4 · Fleet Knowledge Retrieval
Diagnostic — L3 Knowledge with Attribution
The interaction that addresses institutional knowledge loss. A finding from a technician who left the company eight months ago, surfaced at the exact moment it is useful, with his name on it.
Ewan · Technician RT.04 S2 IDLE
Nacelle · diagnostic phase
08:32OFFLINE
Halyard speaking
Fault history · 2 matching records
Match 1 · 2024-03-18
Oil cooler fan running intermittently. Replaced relay K12. Held 9 months.
D. Whelan L3 · verified
Match 2 · 2023-11-02
Temp alarm, no fault found. Monitored, cleared.
CMMS record unverified
Cooler fan — confirmed intermittent
08:30
Steps
Diagram
History
Halt
dialog_transcript
08:32:08 → 08:32:51 · 43s
Tech
Has this happened before?
No component named. Resolved from L5 — the last capture was the cooler fan. RT.04
Halyard
Twice. March last year, Dan Whelan found the cooler fan running intermittently and replaced relay K12 — that held nine months.
The name is spoken. Attribution makes the knowledge weighable — Ewan knows Dan, knows he was thorough. Anonymous fleet knowledge is measurably less trusted. CDS §1 rule 5
Halyard
There's an older one from 2023 — temp alarm, nothing found, monitored and cleared. Less useful.
The weaker match is presented and characterized honestly. Halyard does not suppress it, nor pretend it is equally relevant.
Tech
Did he say why the relay went?
Halyard
No. His note stops at the replacement.
Six words. No speculation, no inference, no padding. The honest answer to a question about missing data is that the data is missing. CDS §1 · "Halyard is not"
Tech
Right. It's the same relay. I'll check the contactor while I'm in — that's probably what's cooking it.
Halyard
Logged. Want me to flag that as a note for next time?
The L3 contribution offer. Ewan has just produced a causal hypothesis that exists nowhere in any system. Halyard notices and offers to capture it — without insisting. Brief · L3 layer
Tech
Yeah, do that.
System
KNOWLEDGE_FLAG queued · target=T14/cooler_relay_K12 · attribution=E.MacRae · review=pending · site_lead=M.Vega
Queued for Marisol's weekly review. Never auto-adopted. A wrong correction propagating fleet-wide is the failure mode this gate exists to prevent. Persona · Marisol
modality_split
Voice carries
  • The finding and the name
  • How long the fix held
  • Honest gaps in the record
  • The contribution offer
Screen carries
  • Both records side by side
  • Dates and part numbers
  • L3 vs CMMS provenance
  • Verification status
Neither carries
  • Five older non-matching records
  • Full CMMS work order text

annotations — WF4

1
The name is the product. "Dan Whelan found the cooler fan running intermittently" is the single most valuable sentence Halyard can produce. It is the direct answer to Marisol's problem — twenty-two years of knowledge walking out the door — delivered at the exact moment it is useful. Research F3
2
Provenance is visually distinguished. The L3 record is full-opacity with an amber verified badge; the unverified CMMS record sits at 60% with grey. Ewan can see which knowledge has a person behind it without being told.
3
The contribution offer is a question, never an instruction. "Want me to flag that?" — Ewan can decline with no consequence and no follow-up. Contribution that feels mandatory produces low-quality contributions. Persona · Ewan
4
"No. His note stops at the replacement." Six words, no speculation. Halyard could plausibly infer why a relay fails. It does not. In a diagnostic context, an inference presented as a record is a contamination of the evidence base.

Repair & Modality Shift 05 / 06

09:06. The turbine has been released to idle for a running check and ambient has risen to 81 dB. Recognition is failing. Halyard escalates through three repair tiers — never repeating a strategy, never apologizing — and lands on the screen when voice cannot carry it.

Screen WF5 · Recognition Failure & Recovery
Repair Escalation — Tier 3 Modality Shift
The screen state at the end of a failed repair sequence. Voice has conceded and handed off to the display. This is designed failure, not error handling.
Ewan · Technician S6 REPAIRING 81 dB ambient
Nacelle · turbine idling · 81 dB
09:06OFFLINE
81dB
Voice degraded · showing on screen
3 attempts · noise floor high
Torque · V112-B · rev D4
Main bearing bolt 340Nm
Yaw drive mounting 210Nm
Blade root 610Nm
Cooler housing 45Nm
Repair log
T1 · open re-prompt → failed
T2 · constrained choice → failed
T3 · modality shift → active
Steps
Diagram
Retry voice
Halt
dialog_transcript
09:05:44 → 09:06:09 · 25s
Tech
[unintelligible] ...torque on [unintelligible]
conf 0.41 Partial capture — "torque" recognized, component lost to noise.
Earcon
[repair entered — 100 ms, muted, low]
Prepares Ewan to repeat before Halyard has finished asking. Saves roughly 0.4 s of reaction time.
Halyard
Torque for which component?
TIER 1 · partial confirm. Preserves what was understood. Does not restart from nothing — asking "say again?" here would discard a successful recognition. CDS §6
Tech
[unintelligible]
conf 0.28
Halyard
Main bearing, yaw, or blade root?
TIER 2 · constrained choice. Never repeats tier 1. Reduces an open recognition problem to a three-item closed set — the three most likely for this WO type, not all eleven.
Tech
[unintelligible]
conf 0.33 Third consecutive failure. Escalation is mandatory.
Halyard
I'm not getting it. Torque table's on screen.
TIER 3 · modality shift. Seven words. No apology, no blame on the environment, no "it's loud in here." States the failure and provides the alternative in one breath. CDS §6
System
S6 REPAIRING → S6a DEFER_TO_SCREEN · full spec table rendered · voice retry available, not prompted
modality_split
Voice carries
  • Progressive narrowing of the question
  • The concession
  • The handoff instruction
Screen carries
  • All four candidate values
  • Ambient noise level
  • Repair tier history
  • Explicit voice retry
Neither carries
  • Any apology
  • Any blame on conditions
  • Any suggestion Ewan did something wrong

annotations — WF5

1
The table shows four values, not one. Halyard never learned which component Ewan wanted, so it shows every plausible candidate rather than guessing. Guessing here could produce a wrong torque on a structural bolt. CDS §4
2
Yaw is highlighted amber because it is contextually most likely — but it is not selected, and the other three are equally legible. A highlight is a hint; a selection would be a decision Halyard has no basis to make.
3
The repair log is visible. Ewan can see that three strategies were tried. This is what makes the failure feel like effort rather than incompetence — the WoZ finding that escalation feels better than repetition even at equal elapsed time. CDS §6
4
Ambient dB is surfaced in the status bar during repair only. It appears when it becomes relevant and disappears when it does not. It explains the failure without Halyard having to say "it's loud in here," which is true, unhelpful, and mildly insulting.
5
"Retry voice" replaces "History" in the action strip. The action bar adapts to state — the one thing Ewan is most likely to want next takes the third slot. Halt never moves. CDS §3

Session Close & Report 06 / 06

10:24, tower base. Ewan has descended. The report has been assembling itself for three hours and forty-six minutes. He reviews a draft, not a blank form — and signs on screen, because a signature is the one interaction that must not be producible by a misrecognized utterance.

Screen WF6 · Report Review & Signature
Session Close — Documentation as Byproduct
The only screen-primary interaction in the system, and deliberately so. Draft assembled from 14 captured events. Voice reads the summary; the signature requires a deliberate physical act.
Ewan · Technician S9 CLOSING Screen-primary
Tower base · connectivity restored
10:24SYNCED
Draft ready
14 events captured · 3h 46m
Work orderWO-4471
Duration3h 46m
OutcomeFault found · part req'd
Draft summary · editable
Gearbox inspection following temp alarm. Oil sample showed metal particulate. Cooler fan confirmed intermittent — relay K12 suspected, contactor likely root cause. Main bearing torque verified at 342 Nm, within tolerance. Relay replacement required; part not on van.
Safety confirmations 4 / 4
Measurements captured 6
Knowledge flag 1 pending
Parts requested 1 · relay K12
Signature required
Sign to submit · cannot be completed by voice
Edit
Defer
Sign & submit
dialog_transcript
10:24:02 → 10:24:38 · 36s
Tech
Halyard, close it out.
Halyard
Three hours forty-six on turbine 14. Gearbox inspection, fault found — cooler fan relay. Fourteen things captured, four safety confirmations, one part requested.
Summary spoken, not read verbatim. Ewan hears the shape of the report while the detail sits on screen for him to check. S9
Halyard
Draft's on screen. Sign when you're happy with it.
The handoff is explicit. Halyard states plainly that this one needs the screen. No attempt to work around a constraint that exists for good reason.
Tech
Add that the contactor wants checking next visit.
Voice edit on a screen-displayed draft. Both modalities live simultaneously — Ewan speaks the amendment while looking at the text.
Halyard
Added to recommendations. Anything else?
Tech
No, that's it.
System
Signature captured · report submitted · knowledge flag queued to M.Vega · S9 CLOSING → S0 DORMANT
Total documentation time: 36 seconds of speech plus one signature. Baseline for this work is 22 minutes. Brief · success metrics
modality_split
Voice carries
  • The summary shape
  • Amendment dictation
  • Explicit handoff to screen
Screen carries
  • Full draft text for review
  • Capture and confirmation counts
  • Parts request detail
  • The signature affordance
Neither carries
  • Full 14-event capture log
  • Raw audit records
  • CMMS field mapping

annotations — WF6

1
Signature is screen-primary and cannot be voiced. This is the one deliberate exception to voice-completability in the entire system. A signature is a legal attestation; it must require a distinct physical act that cannot be produced by ambient speech or a misrecognition. Ewan is at the base with gloves off. IA §5
2
The draft is prose, not a form. Halyard assembles readable narrative from captured events rather than presenting labelled fields. Ewan reviews and corrects — he never faces a blank form after a twelve-hour shift. Persona · Ewan
3
Safety confirmations shown as 4/4 with a check. Not buried in an audit log. This is Thomas Brandt's artefact surfacing in the technician's own review — compliance made visible to the person who performed it, not only to the auditor. Persona · Thomas
4
"Sign & submit" is 1.6× the width of the other actions. The only asymmetric action strip in the system. At the end of a shift, the primary action should be unmissable and unmistakable.
5
"Defer" exists without penalty. Ewan can leave the report unsigned and it queues. There is no nag, no escalation, no red badge. A technician who has just come down from four hours up-tower is allowed to sign later. CDS §1 charter
component_spec — signature_gate
Voice completable
false — the only such interaction in the system
Input method
Sustained press 800 ms, or drawn signature where operator policy requires it
Preconditions
Draft rendered · all safety confirmations resolved · technician identity active
Defer behaviour
Queues locally, syncs unsigned, no reminder before end of shift
Audit payload
Signature ts, device ID, technician ID, draft hash, procedure revisions used
Back to Halyard