Commit Graph

42 Commits

Author SHA1 Message Date
david 493255eb00 Fix justfile parsing: extract inline Python to reset-mcu.py script
Validate and Test / validate-patches (push) Failing after 13s
2026-06-24 17:33:00 -07:00
david d4856804ff Fix onboard audio: apply ALSA UCM HiFi verb before Pd start
Validate and Test / validate-patches (push) Failing after 13s
- Add alsaucm -c hw:0 set _verb HiFi to start-synth.sh (onboard mode)
- Add UCM verb to install.sh
- Add UCM verb to justfile fix-ucm recipe
- Without this, the DSP audio routing is not configured and no sound
  reaches the headphone output
2026-06-24 17:31:00 -07:00
david 191c70fd18 fix: replace cyclone env~ with vanilla line~ envelope, fix stripnote outlet
Validate and Test / validate-patches (push) Failing after 12s
- env~ is a cyclone external not available on board's Pd 0.55
- Replace with line~ + *~ 0.0055 for velocity-scaled AR envelope
- Fix stripnote outlet 1 (gate trigger) connected to envelope instead of outlet 0 (pitch)
- Change dac~ to dac~ 1 for mono output matching -outchannels 1
- Envelope: attack ~50ms, release ~50ms, sustain scaled by velocity
2026-06-24 16:47:05 -07:00
david 8d3666cdaa fix: replace hsl with loadbang floats for headless Pd
Validate and Test / validate-patches (push) Failing after 13s
hsl GUI objects don't initialize in -nogui mode, causing
cutoff at 0 Hz and volume at 0 → no audio output.
Use loadbang + float for headless-safe initialization.
2026-06-24 16:24:25 -07:00
david c0af9c6b6f feat: add pipeline diagnostic script, viz/midi log recipes, reset-mcu recipe
Validate and Test / validate-patches (push) Failing after 13s
- scripts/diagnostics/test-pipeline.py: full end-to-end test
- just diag-full: run pipeline diagnostic
- just viz-log/midi-log: watch service logs live
- just viz-stats/midi-stats: check counters
- just reset-mcu: reset MCU + reopen serial via router RPC
- just test-chord: send test MIDI chord locally
- just fix-perms: restore +x bits on all scripts
2026-06-24 15:02:39 -07:00
david f547201c98 fix: non-blocking response drain using setblocking(False)
Validate and Test / validate-patches (push) Failing after 12s
2026-06-24 05:23:19 -07:00
david 88ddf740cf fix: use REQUEST (type 0) + drain response after each send
Validate and Test / validate-patches (push) Failing after 13s
RouterBridge on MCU ignores NOTIFICATION (type 2) messages.
Must use REQUEST (type 0) for draw_frame, then drain the
response to prevent router buffer buildup.
2026-06-24 05:20:26 -07:00
david 86facfea38 clean: remove debug logging, final viz cleanup
Validate and Test / validate-patches (push) Failing after 12s
2026-06-24 05:14:33 -07:00
david 4f07a4007f fix: use NOTIFICATION (type 2) for draw_frame RPC
Validate and Test / validate-patches (push) Failing after 12s
Viz was sending REQUEST (type 0) but never reading responses.
Router response buffer filled up, blocking all subsequent RPCs.
NOTIFICATION (type 2) expects no response — no buffer buildup.
2026-06-24 05:09:53 -07:00
david 2af901bdca debug: add real-time logging to viz (note on/off, frame sent/drop)
Validate and Test / validate-patches (push) Failing after 12s
2026-06-24 05:03:32 -07:00
david 39e9b5c2fa fix: no reconnect storm on send failure, reduce refresh to 1 FPS
Validate and Test / validate-patches (push) Failing after 13s
- try_send: don't reconnect on failure, just skip and retry next cycle
- Background refresh: 5 FPS → 1 FPS to reduce router serial load
- Revert Bridge.run() - RouterBridge uses Zephyr RTOS thread
2026-06-24 04:59:09 -07:00
david f43d046153 fix: restore executable permission on viz script
Validate and Test / validate-patches (push) Failing after 13s
2026-06-24 04:55:37 -07:00
david 3b40592055 fix: robust router send with auto-reconnect, 10ms timeout
Validate and Test / validate-patches (push) Failing after 13s
- try_send() helper: reconnect on send failure
- 10ms socket timeout instead of 300ms (stalls poll loop)
- Refresh path also uses try_send
- Remove committed library bloat from repo (add .gitignore)
2026-06-24 04:46:59 -07:00
david f70a8701c9 fix: make router socket non-blocking to prevent poll loop stalls
Validate and Test / validate-patches (push) Failing after 13s
2026-06-24 04:45:15 -07:00
david 7af3874757 fix: event-driven viz with immediate rendering, zero decay, clean stats
Validate and Test / validate-patches (push) Failing after 12s
Rewrite led-matrix-viz.py to eliminate latency:
- Render and pack frame immediately on each MIDI event
- Send on next poll cycle (no POLLOUT dependency, no frame loop)
- Notes on/off purely from MIDI data — zero decay
- Background 5 FPS refresh for router drop recovery
- Clean stats: FPS, active_notes, midi_events, bytes_received, raw_packets
2026-06-24 04:09:41 -07:00
david 1d431c8902 debug: print note on/off to journal
Validate and Test / validate-patches (push) Failing after 13s
2026-06-24 04:08:24 -07:00
david 979e89e305 fix indentation and debug: add pipeline counters
Validate and Test / validate-patches (push) Failing after 13s
2026-06-24 04:07:17 -07:00
david 89da97c637 debug: log raw message content to journal
Validate and Test / validate-patches (push) Failing after 13s
2026-06-24 04:03:01 -07:00
david 515617ac94 debug: add bytes_received and raw_packets to viz stats
Validate and Test / validate-patches (push) Failing after 12s
2026-06-24 03:59:12 -07:00
david a94ac07a5c fix: pack frame at render time, send without POLLOUT dependency
Validate and Test / validate-patches (push) Failing after 13s
- pending_bytes stores already-packed msgpack, sendable immediately
- Try sendall() directly every iteration — no POLLOUT gate
- Refresh path resends last_sent_params (not raw frame tuple)
- Router socket uses settimeout instead of setblocking for simpler I/O
2026-06-24 03:56:50 -07:00
david 68d38de9a5 fix: rewrite viz as event-driven with zero-latency MIDI rendering
Validate and Test / validate-patches (push) Failing after 13s
- Remove frame loop latency: render and send immediately on MIDI event
- Remove decay: notes on/off based purely on MIDI note-on/note-off
- Background 5 FPS refresh: catch router-dropped frames
- active_notes uses set instead of dict with decay counters
- Simpler stats: FPS, active notes, midi events processed
2026-06-24 03:31:12 -07:00
david 5115518b5f fix: reduce viz decay to 3 frames, add max-age safety cap, add FPS stats
Validate and Test / validate-patches (push) Failing after 12s
- DECAY_FRAMES default 8→3 (100ms visual trail)
- MAX_NOTE_AGE safety cap: force-expire notes after 15 frames
- Track note age separately from decay to prevent stale notes
- Add FPS and active_notes to viz stats for diagnostics
- Fix router reconnect: unregister old fd, not new one
2026-06-24 03:27:10 -07:00
david ce4022fa1c fix: use correct pd version flag and semver regex
Validate and Test / validate-patches (push) Failing after 1m41s
- pd expects -version (single dash), not --version
- Use strict \d+\.\d+\.\d+ regex to extract full semver
2026-06-24 03:17:52 -07:00
david 290862a74e feat: add skills, version pinning, CI/CD, and generated-file headers
Validate and Test / validate-patches (push) Failing after 2m7s
- Create skills: rego-pd-validator, usb-gadget-configfs, led-matrix-msgpack-rpc
- Update pd-audio-synthesis skill with Uno Q specifics
- Add Pd version check (min 0.54.0) to start-synth.sh
- Add DO NOT EDIT headers to generated pd patches
- Add Gitea Actions CI workflow for patch validation
- Add ConditionPathExists guards to legacy systemd services
- Add 'just ci' recipe for CI
2026-06-24 03:16:28 -07:00
david 1876d8cd42 synth-diagnostic: just run tests, no service management
- run-tests.sh: no systemctl start/stop, just runs test-unit.py
- synth-diagnostic.service: removed Before=, keeps After=prometheus-exporter
  (no deadlock risk since run-tests.sh doesn't start services)
- justfile deploy: stop pipeline -> restart prometheus -> start
  synth-diagnostic -> restart pipeline

Pipeline starts independently at boot (no After=synth-diagnostic).
Diagnostic provides visibility at boot without blocking startup.
2026-06-24 02:59:14 -07:00
david 8e82286287 synth-diagnostic starts pipeline services, cleans up on failure
- run-tests.sh: starts pipeline services, runs test-unit.py,
  stops services on failure, leaves running on success
- synth-diagnostic is the single gate for pipeline startup
- deploy: stop pipeline → restart prometheus → start synth-diagnostic
  (synth-diagnostic starts pipeline on success)
2026-06-24 02:49:58 -07:00
david b445c272fb add boot-time synth-diagnostic.service
- synth-diagnostic.service: runs test-unit.py before pipeline services
- Type=oneshot, After=prometheus-exporter, Before=pipeline services
- Pipeline services: After=synth-diagnostic
- deploy: restart prometheus-exporter → start synth-diagnostic → restart pipeline
- install.sh: includes synth-diagnostic in SERVICES array
2026-06-24 02:48:40 -07:00
david 2e10839fc9 add diagnostic dashboard served from prometheus-exporter
- dashboard.html: standalone HTML, fetches :9090/metrics, auto-refresh
- Exporter serves dashboard at /dashboard and /dashboard.html
- Cards: Pipeline, Audio, Mixer, MIDI Bridge, LED Viz
- Live gauges, counters, service status dots, last-activity timestamps
2026-06-24 02:43:31 -07:00
david 74e0d3fa03 fix: use threading.Lock() instead of object() for _stats_lock 2026-06-24 02:42:06 -07:00
david f673da4b3b merge midi metrics into prometheus-exporter
midi-bridge: removed HTTP server on :9091, now writes /tmp/midi-stats.json
prometheus-exporter: reads /tmp/midi-stats.json, exposes all metrics on :9090/metrics
Single scrape endpoint for all pipeline components
2026-06-24 02:41:27 -07:00
david 7706517b88 fix: initialize stats_last_write inside main() to avoid UnboundLocalError 2026-06-24 02:39:37 -07:00
david ad55dbc5e0 add viz diagnostic metrics to prometheus-exporter
- Viz writes stats to /tmp/viz-stats.json (frames_sent, frames_dropped, queue_depth)
- Exporter reads viz-stats.json and exposes:
  - viz_frames_sent_total (counter)
  - viz_frames_dropped_total (counter)
  - viz_pending_queue (gauge)
  - viz_queue_full (gauge)
2026-06-24 02:38:51 -07:00
david 5c95aa6cd0 viz: proper POLLOUT queue to prevent frame drops
- FrameQueue (max 5) buffers frames when router is slow
- POLLOUT drains pending_frames queue
- No silent drops — full queue increments counter
- Router always registered POLLIN| POLLOUT
- Frame interval 30ms (33 FPS)
2026-06-24 02:37:46 -07:00
david 272a13f8d9 viz: increase FPS to 30, drain UDP aggressively
- Poll timeout capped at 10ms for responsiveness
- Drain all pending UDP data before parsing
- Auto-reconnect router on error
- FPS 15 -> 30
2026-06-24 02:33:17 -07:00
david caef6f04c8 midi-bridge: add prometheus metrics on :9091/metrics
- midi_messages_total: all MIDI messages
- midi_notes_on/off_total: note-on/off counts
- midi_last_status/note/velocity: last message tokens
- midi_last_time_unix: epoch of last message
- Removed MIDI counters from prometheus-exporter (bridge owns them)
2026-06-24 02:25:31 -07:00
david 163ad4145b add prometheus exporter + test suite
- prometheus-exporter.py: stdlib-only HTTP metrics on :9090/metrics
- Exposes: ALSA status, hw_ptr rate, service health, mixer controls
- MIDI counters: notes_on, notes_off, errors
- test-unit.py: 10-test suite covering full MIDI→Pd→Audio pipeline
- test-tone.pd, test-midi-log.pd: minimal debug patches
- systemd service for exporter
- install.sh/deploy updated to include exporter
2026-06-24 02:22:05 -07:00
david 3cc497f632 refactor: 3-module pd architecture + viz non-blocking fix
- midi-in.pd: netreceive -> route -> unpack -> pitch/velocity outlets
- audio-out.pd: inlet~ -> dac~ abstraction
- synth.pd: consumer patch wiring midi-in -> voice -> audio-out
- led-matrix-viz.py: router socket non-blocking, registered with poller
- pd.rego: skip outlet/abstraction false positives in validation
2026-06-24 02:08:57 -07:00
david f919af3d8b midi-bridge: normalize all MIDI channels to channel 1 2026-06-24 00:50:39 -07:00
david d239d58c44 onboard audio: JMISC HPH wiring, UCM fix, update scripts for git deploy 2026-06-23 21:25:51 -07:00
david f1b65eb4d9 fix led-matrix-viz: use select.poll() instead of settimeout, fix hang
The O_NONBLOCK flag set by setblocking(False) was not cleared by
settimeout(n) on this CPython/kernel combo, causing recvfrom to never
return data. Switched to explicit select.poll() with frame-interval
based timeout — simpler, more portable, and avoids the O_NONBLOCK trap.

Also fixes midi-bridge: add time.sleep(0.01) in no-data paths to
prevent 100% CPU spin from spurious POLLIN on f_midi rawmidi.
2026-06-23 00:34:33 -07:00
david dbd7c2cece auto-detect MIDI device, drop ALSA sequencer dependency, MPK Mini simulator
midi-bridge.py:
  - Auto-detect rawmidi device (gadget f_midi > env override > fallback)
  - Reconnect on ENODEV (device hotplug)
  - No longer needs MIDI_BRIDGE_DEV env var in common cases

start-synth.sh:
  - Remove all -alsamidi/-midiadddev flags (kernel lacks CONFIG_SND_SEQUENCER)
  - MIDI handled entirely by midi-bridge.service → UDP → netreceive
  - Host mode: same approach, no ALSA sequencer needed

mpk-mini-sim.pd:
  - New MPK Mini Mk II simulator (25 keys, 8 pads, 8 CC knobs)
  - Proper Pd #X obj format for all objects (bng, hsl, t, del, netsend, loadbang)
  - UDP output to board:8081, matching midi-bridge format

system: enable usb-gadget-audio.service at boot, load dwc3 module at boot
2026-06-22 23:10:38 -07:00
david 8cd796e3dd Initial commit: Arduino Uno Q USB Audio Synth project
- USB gadget (UAC1 + MIDI) with boot persistence
- USB host mode with auto-detection
- Pure Data synth patch with ALSA + UDP netreceive MIDI input
- MIDI rawmidi-to-UDP bridge (midi-bridge.py)
- LED matrix visualization (led-matrix-viz.py via arduino-router RPC)
- MCU sketch for LED matrix control (Arduino_RouterBridge + ArduinoGraphics)
- Conftest/OPA Rego policy validation suite for .pd files
- gen_synth_pd.py: programmatic .pd file generator
- System services: midi-bridge, led-matrix-viz, pd-synth-auto, usb-role-detect
- Justfile with deploy, enable, diagnostic recipes
- Diagnostic script (diag.sh)
2026-06-22 22:46:36 -07:00