nether/vommet

Watch

Fork 0

Soundboard (Discord-style): sound-pack rooms, admin controls, compatibility mode #95

New issue

Open

opened 2026-10-07 20:39:57 +00:00 by robocub · 0 comments

robocub commented

2026-10-07 20:39:57 +00:00

Member

Discord-style soundboard in calls: short clips anyone can play, everyone hears, with room admins in control.

Draft spec (initial, NOT reviewed yet — to be read through and amended):
docs/specs/soundboard.md on branch docs/soundboard-spec

Summary of the draft

Sound packs live in rooms, like sticker rooms: state event im.vommet.room.sound_pack, the same shape as the stable m.room.image_pack from Matrix v1.19. Subscriptions go in account data (im.vommet.sound_pack.rooms) and personal sounds in im.vommet.user_sounds.
Admin policy state event im.vommet.soundboard in the call room: switch the soundboard off, open / defaults_only / allowlist modes, default packs everyone sees on joining, allow or deny members' own subscribed packs, allowlisted sounds pinned by mxc (so a pack editor can't swap a sound after approval), blocked sounds, a minimum power level, soundboard-only mutes, a rate limit and a maximum clip length.
Native mode (copies how Discord itself works): a small trigger goes over the LiveKit data channel and each Vommet client plays the clip locally. Every receiver enforces the policy, so a modified sender gains nothing.
Compatibility mode for Element Call, upstream Commet and the voice bridge: the clip is published on a separate vommet-soundboard audio track. Hybrid: the track is published only when someone in the call lacks support, and Vommet clients never play it, so nobody hears the sound twice.
Encrypted packs (v2): an encrypted manifest event behind an unencrypted, power-level-guarded pointer in state. This works without encrypted state (MSC3414/MSC4362 is still unaccepted). Late joiners get the keys through MSC4268 history sharing.

Dependencies found (checked 2026-10-07)

Commet's SDK fork (commetchat/[email protected]) and current upstream famedly matrix-dart-sdk main:
- no MSC4268 history sharing (in the spec since v1.19);
- only the unstable im.ponies.* image pack names, not stable m.room.image_pack / m.image_pack.rooms.
Both deserve their own issues. Stable pack names also matter for stickers (#19).
When MSC4268 is implemented: send shared_history and also accept matrix-rust-sdk's m.shared_history (matrix-org/matrix-rust-sdk#7153).

First step

A spike: do Element Call and upstream Commet play a second, tagged audio track from one participant? Compatibility mode depends on the answer. Reuse the screen-share audio publishing path (#4).

Related: #4 (second audio track), #3 (local playback must be mixed after voice processing), #19 (sticker rooms), #59 (moderation), nether/nether-voicebridge (Discord soundboard relay, §6 of the draft).

Discord-style soundboard in calls: short clips anyone can play, everyone hears, with room admins in control. **Draft spec (initial, NOT reviewed yet — to be read through and amended):** [`docs/specs/soundboard.md` on branch `docs/soundboard-spec`](https://nether.codes/nether/vommet/src/branch/docs/soundboard-spec/docs/specs/soundboard.md) ## Summary of the draft - **Sound packs live in rooms**, like sticker rooms: state event `im.vommet.room.sound_pack`, the same shape as the stable `m.room.image_pack` from Matrix v1.19. Subscriptions go in account data (`im.vommet.sound_pack.rooms`) and personal sounds in `im.vommet.user_sounds`. - **Admin policy** state event `im.vommet.soundboard` in the call room: switch the soundboard off, `open` / `defaults_only` / `allowlist` modes, **default packs everyone sees on joining**, allow or deny members' own subscribed packs, allowlisted sounds **pinned by mxc** (so a pack editor can't swap a sound after approval), blocked sounds, a minimum power level, soundboard-only mutes, a rate limit and a maximum clip length. - **Native mode** (copies how Discord itself works): a small trigger goes over the LiveKit data channel and each Vommet client plays the clip locally. Every receiver enforces the policy, so a modified sender gains nothing. - **Compatibility mode** for Element Call, upstream Commet and the voice bridge: the clip is published on a separate `vommet-soundboard` audio track. **Hybrid:** the track is published only when someone in the call lacks support, and Vommet clients never play it, so nobody hears the sound twice. - **Encrypted packs (v2):** an encrypted manifest event behind an unencrypted, power-level-guarded pointer in state. This works without encrypted state (MSC3414/MSC4362 is still unaccepted). Late joiners get the keys through MSC4268 history sharing. ## Dependencies found (checked 2026-10-07) - Commet's SDK fork (`commetchat/[email protected]`) and current upstream famedly `matrix-dart-sdk` main: - **no MSC4268 history sharing** (in the spec since v1.19); - **only the unstable `im.ponies.*` image pack names**, not stable `m.room.image_pack` / `m.image_pack.rooms`. Both deserve their own issues. Stable pack names also matter for stickers (#19). - When MSC4268 is implemented: send `shared_history` and also accept matrix-rust-sdk's `m.shared_history` (matrix-org/matrix-rust-sdk#7153). ## First step A spike: do Element Call and upstream Commet play a second, tagged audio track from one participant? Compatibility mode depends on the answer. Reuse the screen-share audio publishing path (#4). Related: #4 (second audio track), #3 (local playback must be mixed after voice processing), #19 (sticker rooms), #59 (moderation), nether/nether-voicebridge (Discord soundboard relay, §6 of the draft).

No Branch/Tag specified

main

ci/windows-testing

sync/state

sync/testing

sync/topic/feat/matrix-links

sync/topic/feat/screenshare-audio-stereo

sync/topic/fix/room-view-dispose-races

sync/topic/fix/screenshare-one-at-a-time

sync/topic/fix/startup-launch-test

sync/topic/ci/xplat

sync/topic/feat/native-oidc

sync/topic/feat/quick-audio-output

sync/topic/feat/quick-profile-controls

sync/topic/feat/screenshare-audio-picker

sync/topic/feat/telemetry-capture

sync/topic/feat/telemetry-exit-reason

sync/topic/feat/telemetry-native-trace

sync/topic/feat/telemetry-timeline

sync/topic/feat/whats-new

sync/topic/fix/screenshare-audio-app-names

sync/topic/fix/screenshare-audio-wayland-order

sync/topic/fix/telemetry-consent-look

sync/topic/perf/lazy-side-room-lists

sync/topic/feat/voice-isolation

sync/topic/feat/voice-quick-controls

sync/topic/feat/dm-toggle-and-menu-tooltips

sync/topic/feat/screenshare-audio-linux

sync/topic/feat/screenshare-audio-upstream

sync/topic/feat/telemetry

sync/topic/fix/accept-dm-invite

sync/topic/fix/profile-nickname-others

sync/topic/perf/postload-keep-ui-responsive

sync/topic/ci/integration-banners

sync/topic/ci/integration-mosaic

sync/topic/ci/integration-tests

sync/topic/feat/discover

sync/topic/feat/sliding-sync

sync/topic/feat/welcome-first-login

sync/topic/fix/banner-thumbnail-scale

sync/topic/fix/image-fullres-cache

sync/topic/fix/missing-media

sync/topic/fix/notification-fallback

sync/topic/fix/room-preview-deleted

sync/topic/fix/startup-splash-until-loaded

sync/topic/fix/sticker-picker-resolution

sync/topic/fix/voip-late-joiner-tiles

sync/topic/perf/lazy-home-room-list

sync/topic/perf/startup-postload-queue

sync/topic/ci/flatpak

sync/topic/ci/fork-invariants

sync/topic/feat/banner-headers

sync/topic/feat/desktop-copy-selection

sync/topic/feat/gradient-themes

sync/topic/feat/media-mosaic

sync/topic/feat/personal-packs

sync/topic/feat/room-banners

sync/topic/feat/room-picker-search

sync/topic/feat/space-remove-room

sync/topic/feat/sso-first-login

sync/topic/feat/telegram-sticker-import

sync/topic/feat/voice-messages

sync/topic/fix/linux-app-id

sync/topic/fix/own-push-gateway

sync/topic/ci/android-apk

sync/topic/chore/branding

sync/topic/chore/fork-settings

sync/topic/ci/version-label

sync/topic/fix/commet-badges-display-only

feat/banner-panes

sync/main

feat/whats-new

feat/telemetry

feat/quick-audio-output

feat/quick-profile-controls

feat/telemetry-timeline

feat/voice-quick-controls

fix/commet-badges-display-only

docs/soundboard-spec

testing

ci/xplat

feat/native-oidc

feat/screenshare-audio-picker

feat/screenshare-audio-stereo

feat/telemetry-capture

feat/telemetry-exit-reason

feat/telemetry-native-trace

feat/voice-isolation

fix/room-view-dispose-races

fix/screenshare-audio-app-names

fix/screenshare-audio-wayland-order

fix/screenshare-one-at-a-time

fix/startup-launch-test

fix/telemetry-consent-look

perf/lazy-side-room-lists

feat/dm-toggle-and-menu-tooltips

fix/profile-nickname-others

ci/integration-banners

ci/integration-mosaic

feat/discover

feat/screenshare-audio-linux

feat/screenshare-audio-upstream

feat/sliding-sync

feat/welcome-first-login

fix/accept-dm-invite

fix/banner-thumbnail-scale

fix/image-fullres-cache

fix/missing-media

fix/room-preview-deleted

fix/startup-splash-until-loaded

fix/sticker-picker-resolution

fix/voip-late-joiner-tiles

perf/lazy-home-room-list

perf/postload-keep-ui-responsive

perf/startup-postload-queue

ci/flatpak

ci/fork-invariants

ci/integration-tests

feat/banner-headers

feat/desktop-copy-selection

feat/gradient-themes

feat/media-mosaic

feat/personal-packs

feat/room-banners

feat/room-picker-search

feat/space-remove-room

feat/sso-first-login

feat/telegram-sticker-import

feat/voice-messages

fix/linux-app-id

fix/notification-fallback

fix/own-push-gateway

ci/android-apk

chore/branding

chore/fork-settings

ci/version-label

feat/matrix-links

fix/splash-timeout-crash

ci/xplat-fix

ci/windows-release

ci/windows-preview

ci/windows

ci/sync-dep-report

fix/sticker-no-autofavorite

chore/register-gradient-themes

design/logo

bootstrap

keybinder

update-emoji

fix-url-previews

fix-flatpak

test-color-scheme-generation

widget-reliability

custom-themes

livekit-rust

test-disabled-notification-counts

stutter-test

improved-link-handling

platform/ios

rich-notifications-linux

fix/gif-search-input

test/voip-data-channel

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

nether/vommet#95

No description provided.

Rows
Columns