Physical computing

Research & source notes / 24 October 2026

The argument
behind the object.

A portfolio should make the experience legible, then let the reader follow the evidence.

调研、设计推导与作品自身的验证分别记录。Common Ground 的研究只在适用处沿用。

Research that informs the interaction

Tactons / Brewster & Brown, 2004

Structured tactile messages can use rhythm, duration and other parameters. For Fermata, this motivates a small vocabulary whose distinguishability must be tested. It does not establish that this particular wearable’s cues are understandable.

Read the paper ↗

Musical Haptic Wearables / Turchet & Barthet, 2019

A co-design approach with electronic musicians connects haptic wearables to creative communication. Fermata carries forward the need to design for performers’ attention and shared activity. Placement, training and performance context belong in the evaluation.

Publication ↗ · Author’s PDF ↗

How wearable projects tell their story

The following are documentation and design precedents, newly reviewed for this portfolio. Their results are not Fermata’s findings.

MiMU / connect the action to its mapping

The official documentation distinguishes movement and events, and makes input/output mapping explicit. The transferable lesson is to show how a bodily action becomes an intentional signal. Fermata uses cues between wearers; it is not presented as a MIDI glove or music generator.

Glove anatomy ↗ · Mapping ↗

Shape Haptics / let the mechanism carry the image

Clement Zheng’s project page ties mechanism, applications, research and a usable design tool together. For this case study, large geometry-derived hardware views and local explanations carry the technical story.

Project page ↗

Adafruit CLUE BLE MIDI Glove / connect code and use

The guide brings the parts, code, display and control mappings into one sequence. Fermata follows that documentation principle with a component-role table, real code excerpts and the actual recording UI.

Guide ↗

Jazz Hand / document a specific failure

Sean Johnson describes signal smoothing, debouncing and wire routing in a wearable music interface. The lesson for the portfolio is editorial: describe the observed problem, the change and the remaining limit, with source evidence beside them.

Project documentation ↗

The Malbody Centre / keep the body in the test

Marije Baalman’s prototype notes show that garments and skin contact can alter haptic perception. Fermata’s proposed evaluation therefore includes contact, fit, ordinary movement and interpretation.

Prototype notes ↗

Slap Snap Tap / explain through actions

MIT Media Lab’s overview describes sensor straps, physical programming and bodily action. This supports a clear action sequence as a documentation technique; no educational outcome is borrowed for Fermata.

Project overview ↗

NYU ITP / separate the case study from the process log

The documentation guide asks for the participant’s experience, a system diagram, circuit documentation, readable source and the difficulties encountered. This website is an edited path through the archive, while the local research notes retain the detailed source inventory.

Journals & Documentation ↗

What comes forward from Common Ground

The earlier concept linked performers, audience observation and room-scale light. The retained thread is nonverbal musical coordination and the possibility of a small tactile vocabulary. The wearable became a focused project in its own right.

Camera-observed audience behavior, speculative personas, unfinished interviews and room-scale aggregation are not presented as evidence for the paired prototype. Historical concept renders are also not substituted for real device photographs.

Project evidence index

Paths below name items in the retained Fermata archive. They are source identifiers, not public download links. Firmware and training source files are not published with this site.

Evidence current through 19 October 2026
Claim or artifactArchive sourceScope
Concept and scope reduction01 / Fermata_Journal_Update_2026-09-12 / Proposal.mdDesign motivation; not a user-study result.
Background research01 / Fermata_Research_Draft_2026-09-19 / Fermata_Research_Draft_EN.mdLiterature and comparison; historical primary research remains incomplete.
Later carrier PCB02 / Friend_PCB_Review_2026-09-27 / 检查结果.mdCollaborator-supplied board, ~43 × 33 mm. STEP and simplified routing review, not fabrication approval.
Early PCB v0.202 / Fermata_PCB_v0.2 / README_先读这个.md46 × 30 mm design stage; distinct driver/pin assumptions. Not the October worn hardware.
Actual prototype photograph06 / Final_Presentation_2026-10-19 / IMG_7143.HEIC.pngOriginal open-case assembly photograph. Display asset is resized / encoded for the web.
Enclosure studies03 / v1.0 Snap; v1.3.1 retained lid; v1.3.2 battery short-edge exitDifferent revision studies. Later CAD / slicer checks do not establish a physically verified final shell.
Current A/B firmware and UI04 / Fermata_Pair_v0.3.28 / README.md; results/STATUS.json; results/dual_ble_battery.pngA v326 / B v328 retain the v322 recognition model. UI image is a historical capture.
0/8 → 7/8 matches04 / Fermata_ML_Training / README.mdContinuous retrospective replay of eight target groups; three unassigned triggers remain.
v325 candidate comparison04 / Fermata_Gesture_v0.3.25 / results/comparison.json; embedded_parity.json12→19/23 matches; validation 10/11→9/11. Development data, not blind final accuracy.
BLE reconnect-loop diagnosis05 / 2026-10-11_B取出外壳对照 / 排查与修复记录.md41 disconnects in ~55 s, followed by a 60.25 s check. Placement and power also changed.
Seven physical button exchanges04 / Fermata_Pair_v0.3.26 / results/hardware_20261019/human_confirmation.jsonThree A and four B presses; logs plus author confirmation. Not seven study participants.
Post-enclosure gesture checks04 / Fermata_Pair_v0.3.26 / results/enclosure_20261019/测试记录.mdMisses and disconnection remain. No controlled comparison establishes the shell as the cause.
Debug-link isolation04 / Fermata_Pair_v0.3.28 / results/debug_disconnect_isolation.jsonComputer disconnect/reconnect checked while peer handshake continued.

Visual edition: traceable images and plots

Image provenance

The hero is a new imagegen visualization guided by the author’s actual prototype photograph. The on-wrist and open-case photos are documentary. The Blender images distinguish imported carrier/CAD geometry from newly reconstructed functional modules, with illustrative materials and no baked portfolio text. The exploded view combines the v1.3.2 base and v1.3.1 retained lid, with user-reported battery and LRA dimensions. The light strip sits on the original archived bridge, whose two feet meet the shell ledges. A separate cutaway shows the diffuser and lid window. The v4 bridge restores the nominal mounting height from the archive; LED thickness, adhesive and the optical gap remain reconstruction assumptions. Driver size, LED spacing and lead paths remain approximate; the model does not establish physical fit.

Model completeness, geometry and source hashes ↗

Recorded signal

Session 20261019_142008_test_cc691f, A v326 / recognizer v322, USB, desktop Test. One successful group was selected for the diagram: 729 samples over seven seconds, 53 masked samples. It illustrates distinct events without representing overall performance. Device ACK is logged on A; markers include human response delay.

Timeline provenance ↗

Training, runtime and recording

Raw records place acceleration before angular velocity; the model expects gyro first, in physical units. The implementation normalizes time to 128 positions and uses a fixed gyro scale of 400. Session splits, group weighting and a fixed training-only hard-negative pass reduce misleading clip-level comparisons. Current A/B firmware uses v322; v325 remains a candidate.

The server stores device microseconds, host monotonic receipt time and browser marker time separately. A gap above 30 ms breaks a model window; a reset or interruption above one second saves and ends the recording. Role selection and panel feedback/calibration commands are locked during capture; physical buttons remain active.

Four additions in this edition

A supported light assembly

The v4 assembly and local section preserve the archived bridge, diffuser, shell and lid geometry. Eighteen sampled bridge-foot contact positions agree with the original shell ledge height. This verifies the nominal CAD relationship, not printed fit or light uniformity. Driver size, wiring, LED package thickness and adhesive remain approximate.

Geometry provenance and assumptions ↗

Three views of the workbench

Observe and Mark show enlarged viewports into the unchanged 906 × 817 pixel UI capture. Trace is a rendered event ledger from a separate retained A USB session. The interactive waveform uses all 729 raw samples in the selected excerpt and a fixed ±1500 °/s vertical range. Two human cycle-end markers are present; an explicit group-onset marker is absent. A's motor and matching ACK are logged, but B's playback and a human response are not in this record.

Selected recording, timestamps and exact event lines ↗

Three bounded engineering cases

The window case compares historical replay after both labels and model fitting changed. The motor-mask case retains a null result: masked and unmasked replay logs were identical in the historical v316 DTW-era record. The delivery case separates v309 ACK_NO_HAPTIC evidence from seven later v326 physical button checks. Human confirmation describes the set of button tests, not individually timestamped sensations.

Case evidence, exact excerpts and source hashes ↗ · Separate physical-button ledger ↗

Demonstration / filming preparation

The four-step region is a planned filming storyboard, not recorded footage or an observed successful conversation. The requested film has not yet been shot. The local production guide specifies one continuous master take, wrist and reaction closeups, cue confirmation, firmware and take logs, and an edit sequence. Once captured, the central stage can become a real video while retaining the original take and session provenance.

Source files

The paired v328 firmware and aligned-training source are not published. Short excerpts from some of these files appear in the case study.

Visual direction & authorship

Fermata now has an independent instrument-inspired identity: cold ceramic white, graphite, cobalt, compact geometric sans typography and a custom paired-pause mark. Signal colors follow Attention, Wait and Received; motion, hardware and recording use a consistent custom SVG icon family. The interaction diagram is illustrative; the prototype photograph and UI capture are documentary; CAD views retain their revision labels.

Raphael (Boyan) Peng: concept, interaction, firmware/recognition development, enclosure work and testing. Later carrier PCB supplied by a collaborator. The case study credits this contribution without assigning unsupported sole PCB authorship.

Return to Fermata