feat(mesh): upgrade to mesh-llm 0.76.0-rc8 and recommend Qwen3.8 27B - #6189
feat(mesh): upgrade to mesh-llm 0.76.0-rc8 and recommend Qwen3.8 27B#6189micspiral wants to merge 28 commits into
Conversation
Bump every mesh-llm git dependency in buzz-relay and buzz-desktop from v0.75.1 to v0.76.0-rc3, and make Qwen3.8 27B Q4_K_M the curated pick for 64GB-class machines. The rc carries the two changes that make Qwen3.8 safe to recommend: Mesh-LLM/mesh-llm#1283 routes Qwen3.8 identities to the qwen35 recurrent family (without it the identity compacts to a string matching neither qwen35 nor qwen36, so a hybrid recurrent model is classified as dense attention-KV), and #1342 restores recurrent shared prefixes. #1343 adds Qwen3.8-27B-Q4_K_M to the compiled MODEL_CATALOG. Because the large pick now exists in MODEL_CATALOG, the synthesized catalog entry Buzz carried for the gemma-4-26B pick is removed along with its size/file/description constants; the entry is canonicalized from the upstream catalog instead. The retired gemma-4-26B alias is kept in canonical_curated_model_id so machines that already selected it keep resolving to a model id Mesh's OpenAI ingress accepts. Dependency resolution notes: iroh moves 1.0.2 -> 1.0.3 to match the rc's requirement, and libsqlite3-sys moves 0.30.1 -> 0.35.0 because the rc's mesh-llm-log-store requires rusqlite 0.37 (only one package may link sqlite3). Verification: cargo check passes for buzz-relay and for buzz-desktop with --features mesh-llm; 2611 buzz-desktop tests pass; cargo fmt --check is clean. Two failures predate this change and reproduce on unmodified origin/main: the global_config inherited_shared_compute_translates_to_supported_agent_transport assertion (expects "auto", gets "mesh") and an items-after-test-module clippy lint in managed_agents/restore.rs. Not runtime-verified against a live Qwen3.8 mesh node from this branch. Co-authored-by: Michael Neale <michael.neale@gmail.com> Signed-off-by: Michael Neale <michael.neale@gmail.com>
buzz-agent's `BUZZ_AGENT_LLM_TIMEOUT_SECS` defaults to 240s. MeshLLM's OpenAI frontend gives a backend call 600s (`OpenAiFrontendConfig::DEFAULT_BACKEND_TIMEOUT`), so on shared compute the client aborts work the server is still legitimately doing. Requests to a local mesh are `stream: false`, so a cold multi-ten-thousand token prefill is one silent request. Measured on an M5 Max serving Qwen3.8-27B Q4_K_M: an 88,318-token cold prompt returns HTTP 200 after 503s at 176 tok/s prefill. At the 240s default the client gives up at four minutes, then retries with an escalated budget (240 -> 480 -> 960), piling load onto a box that is already prefilling the first attempt. Seat the mesh client budget at 660s, just above the frontend's 600s, so the mesh's own error surfaces rather than a client abort racing it. Remote providers are untouched and keep buzz-agent's 240s default. Like the other mesh seeds this is a default, not policy: an explicit user value survives via `insert_default_if_unset` plus the copy-forward list in `relay_mesh_process_env`. Co-authored-by: Michael Neale <michael.neale@gmail.com> Signed-off-by: Michael Neale <michael.neale@gmail.com>
Bump every mesh-llm git dependency in buzz-relay and buzz-desktop from the v0.76.0-rc3 tag to v0.76.0-rc4. rc4 is a low-risk move from rc3: git diff v0.76.0-rc3..v0.76.0-rc4 in Mesh-LLM/mesh-llm touches only generated console web assets and the release version bump, so the runtime behaviour Buzz depends on is the same code we already validated. It is the first release tag carrying the Qwen3.8 fixes as a downloadable artifact for every platform, which means nodes no longer need a source build to serve the curated large pick. The Qwen3.8 27B curated recommendation from the rc3 commit is unchanged. Verification: cargo check passes for buzz-relay and for buzz-desktop with --features mesh-llm. The one warning emitted (unreachable statement in commands/workspace.rs) predates this change. Co-authored-by: Michael Neale <michael.neale@gmail.com> Signed-off-by: Michael Neale <michael.neale@gmail.com>
777426b to
0cd224c
Compare
desktop-standalone was the only launch recipe that ignored the `mesh` variable. dev, staging and production all build FEATURES=(--features mesh-llm) when it is set; desktop-standalone invoked `tauri dev` with no features, so `just mesh=1 desktop-standalone` silently produced a non-mesh build and the app reported "mesh-llm feature not enabled" from desktop/src-tauri/src/mesh_llm_stubs.rs. Wire it up the same way as the other three recipes. Co-authored-by: Michael Neale <michael.neale@gmail.com> Signed-off-by: Michael Neale <michael.neale@gmail.com>
Bump every mesh-llm git dependency in buzz-relay and buzz-desktop from the v0.76.0-rc4 tag to v0.76.0-rc6, and regenerate both lockfiles at tag commit a8ddb455. Verification: cargo check -p buzz-relay --all-targets and cargo check --manifest-path desktop/src-tauri/Cargo.toml --features mesh-llm --all-targets pass. The desktop check retains the pre-existing unreachable-code warning in commands/workspace.rs. The buzz-relay package suite compiled rc6 and ran 892 passing tests, but its existing mesh demo forwarded-arm test timed out with HTTP 504 twice. Co-authored-by: Michael Neale <michael.neale@gmail.com> Signed-off-by: Michael Neale <michael.neale@gmail.com>
…ership Mesh admission is seeded from the relay's NIP-43 membership snapshot (kind:13534), which is built purely from the `relay_members` table. On a relay running with `BUZZ_REQUIRE_RELAY_MEMBERSHIP=false`, signing in never writes a `relay_members` row, so that snapshot lists at most whoever was added out of band. Ordinary participants are absent from it. Desktop treated that as an authoritative roster, so every node resolved an empty intersection, fell back to `trust_owners([self])`, and sat at "1 NODE" with an empty peer list forever. Two machines sharing compute on the same open relay could never see each other, through any number of restarts. Admission was only part of it: `availability_from_events` also required a snapshot and filtered status notes to `members.contains(reporter)`, so serve-target discovery was membership-gated too. Relaxing admission alone would still have left peers undiscoverable. Resolve the relay's membership mode from its NIP-11 document instead. The relay advertises NIP-43 only when membership is actually enforced, so the advertisement is a faithful signal. When it is absent, skip the snapshot requirement for routing and pass `trusted_owner_ids: None`, which the existing SDK path already maps to `TrustPolicy::Off` — stock MeshLLM behaviour, scoped by the relay-derived mesh topic. Membership emptiness deliberately does NOT drive this. On an enforcing relay a missing snapshot is a transient replication gap, and the existing code treats it as an error precisely so a blip cannot flap a live node down to self-only. Keying open-mesh off "no snapshot" would have turned that blip into a silent loss of admission enforcement. A failed NIP-11 probe therefore falls back to the enforcing behaviour: an unreachable relay can never relax admission. Closed-relay behaviour is unchanged, including the fail-closed error and the shrink hysteresis. `roster_reconcile_action` maps `Ok(None)` to `Keep`: a node already enforcing an allowlist keeps it, so a mid-flight NIP-11 change cannot de-restrict a running mesh. Freshness and owner-signed endpoint binding still gate routing on an open relay; only the membership intersection is lifted. Co-authored-by: Michael Neale <michael.neale@gmail.com> Signed-off-by: Michael Neale <michael.neale@gmail.com>
…-rc3 * origin/main: (86 commits) Centralize replaceable event persistence (#6660) feat(workflows): discover trigger filter values (#6712) feat(desktop): simplify the message action rail (#6529) fix(desktop): restore icon-only remote marker (#6491) fix(ci): prevent poisoned Rust caches (#6618) docs(security): route reports through private advisories (#6728) fix(composer): wrap Buzz chip labels without orphaning icons (#6581) fix(desktop): bound thread /query and surface load errors, not false-empty (#6447) fix(messages): route edits to the owning composer (#6575) fix(mobile): join starter channels after accepting invite (#5915) Add mobile profile editing (#6583) fix(desktop): align jump-to-latest pill with composer height (#6606) fix(desktop): emit singular `mention` feed category so alerts route correctly (#6665) fix(mobile): recover stale and shuffled messages (#6691) feat(mobile): browse and join open channels (#6243) show mention counts in channel notifications (#6696) fix(desktop): hide selection formatting tray on composer right-click (#6683) fix(desktop): stabilize members dialog scrolling (#6670) fix(desktop): keep member runtime status off the UI thread (#6445) perf(desktop): persist channel heads, collapse thread reads and reply sends (#6572) ...
…e, and probing Follow-up to the open-mesh change (d99cba5), closing three gaps found in review: 1. A stray membership snapshot on an open relay no longer gates routing. Admission runs TrustPolicy::Off there, but discovery still intersected status notes with any kind:13534 roster that happened to exist (added out of band), and the query layer applied the same authors filter — a hybrid where admission admits everyone while discovery hides non-roster peers. Both branches now check the relay mode: open relays ignore membership entirely and rely on freshness plus owner-signed endpoint binding. 2. Reconcile recovers a node isolated by the startup probe fallback. A transient NIP-11 probe failure at start falls back to the enforcing path and a self-only allowlist; treating Ok(None) as an unconditional Keep then pinned that node at "1 NODE" until an app restart — the original bug, reintroduced by one HTTP blip. A self-only roster admits nobody else, so restarting into open mesh relaxes nothing that protected anyone. An allowlist admitting other owners is still never relaxed mid-flight. 3. Successful NIP-11 probes are memoized per relay URL. The deployment mode does not flap at runtime, and discovery re-probed on every reconcile poll. Failures are not cached, so the fallback in (2) re-probes and recovers. Co-authored-by: Michael Neale <michael.neale@gmail.com> Signed-off-by: Michael Neale <michael.neale@gmail.com>
Bump every MeshLLM git dependency in buzz-relay and buzz-desktop from v0.76.0-rc6 to the released v0.76.0-rc7 tag at 5d07a20b, and regenerate both lockfiles. The transitive lockfile delta follows rc7's dependency graph; json5 is removed and the Windows/proc-macro families move to the versions rc7 selects. Review also closes two open-relay gaps: malformed NIP-11 mode evidence now keeps the fail-closed fallback, and persisted-agent bootstrap target resolution uses the relay mode instead of reapplying closed-membership filtering on open relays. Verification: both package suites compile against rc7. Desktop mesh-focused tests pass (88 passed, 1 ignored). The full desktop suite retains the pre-existing inherited shared-compute assertion failure (mesh vs auto); the relay suite retains the pre-existing mesh demo forwarded-arm HTTP 504 (908 passed, 1 failed, 48 ignored). Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
…-6189-fresh Co-authored-by: Michael Neale <michael.neale@gmail.com> Signed-off-by: Michael Neale <michael.neale@gmail.com>
Route agent-form shared-compute discovery through the same NIP-11 mode resolution used by mesh startup and routing. Open relays no longer trigger the closed-relay member-roster warning. Co-authored-by: Mic Neale <305999590+micspiral@users.noreply.github.com> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
wesbillman
left a comment
There was a problem hiding this comment.
Carl, an automated reviewer, commenting via Wes’s GitHub account.
Requesting changes at cbba75536e9226c760e49cb75281a3e79d20783c for two admission-contract gaps: a running open mesh never tightens after the relay begins enforcing membership, and malformed supported_nips elements can fail open. All reported CI checks are green at this head, but they do not cover these authority transitions and malformed-input boundaries.
Reject partially malformed supported_nips arrays instead of treating an ambiguous NIP-11 document as evidence that membership is disabled. Remove the permanent relay-mode cache so open runtimes can detect a relay that later enables membership enforcement. Keep established closed runtimes on their existing roster-only reconcile path. Only open and startup-fallback self-only runtimes re-probe mode; failed probes preserve the current policy, while a valid closed result restarts into the fetched allowlist. Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
The mode-aware resolver replaced the legacy closed-only helper in production. Keep the compatibility wrapper available to its existing closed-mode tests without leaving an unused production export. Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Exercise the real NIP-11 HTTP probe three times at one URL as its response changes from open to closed to malformed. This guards against restoring the permanent mode cache and proves malformed evidence cannot be interpreted as open. Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
|
thanks @wesbillman, addressed |
The MoA fleet sim used a synthetic tier mix. Buzz's shipped picker (block/buzz#6189, desktop/src-tauri/src/mesh_llm/catalog.rs) recommends exactly one model per rated-memory class, so a real fleet only ever advertises three names — and two of them are below SMALL_TIER_MAX_B. Pin what the shipped assembly path does on that ladder: laptops only (E4B x50) 50 nodes -> 1 worker mid only (9B x50) 50 -> 1 laptops + mid 100 -> 1 one big (27B x1) 1 -> 1 two big (27B x2) 2 -> 2 big fleet (27B x100) 100 -> 2 full ladder, one big 101 -> 3 full ladder, many big 900 -> 3 Two claims are asserted rather than printed: * An all-laptop Buzz fleet never convenes a committee. Every rung below 80 GB is small-tier (Qwen3.5-9B misses the 10.0 boundary by 1B), and an all-small pool collapses to its best member — the measured small-width regression in evals/moa-openrouter/RESULTS.md. * Two 80GB+ machines on the same 27B is the only shape on this ladder that reaches a real committee, via same-model self-fill. It is the homogeneous case the mid-scale eval measured at 48W/23T/2L, and RefinementPolicy::Auto enables the refine round for it. No production behaviour changes. Co-authored-by: Michael Neale <14976+michaelneale@users.noreply.github.com> Signed-off-by: Michael Neale <14976+michaelneale@users.noreply.github.com>
wesbillman
left a comment
There was a problem hiding this comment.
Carl, an automated reviewer, commenting via Wes’s GitHub account.
Re-reviewed head 34e31f7e against base cada3028. One admission blocker remains.
The malformed supported_nips path is fixed and now fails closed, but the open-to-closed transition can still retain a live open admission policy when the first closed membership snapshot is unavailable. Once NIP-11 has proven that the relay is closed, that state must survive roster-read failure so the existing TrustPolicy::Off runtime is replaced by a fail-closed/self-only runtime rather than kept open. Please add a regression test for open → closed → unavailable roster.
Non-blocking test-adequacy note: the desktop mesh unit tests are feature-gated out of normal CI, and just mesh-e2e filters on mesh_llm, so the new managed_agents::relay_mesh::tests timeout cases are not selected there either. Please give the feature-enabled tests an automated execution path; otherwise these admission and timeout regressions have little durable protection.
Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Keep relay-mode evidence distinct from roster availability so an open runtime restarts once NIP-11 proves membership enforcement, even when the first roster snapshot is unavailable. Run the feature-enabled desktop mesh tests in CI and correct the newly exercised wire-model expectation. Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
🔐 Codex Security Review
|
wesbillman
left a comment
There was a problem hiding this comment.
Carl, an automated reviewer, commenting via Wes’s GitHub account.
Re-reviewed head 0f1798e207bf9d16107cb35d4ab648dd683ccc6e against base 80177e4c8e97e7bf1f1a3760c4e3503aace22860.
The prior admission blocker is resolved. Once NIP-11 proves an open runtime's relay has tightened to membership enforcement, roster unavailability is now preserved as ClosedWithoutRoster and requests a process restart. Relaunch resolves the missing closed roster to Some([]), and normalized_roster applies a self-only TrustPolicy::Allowlist; a later roster recovery causes another restart into the recovered allowlist. Probe failure or malformed NIP-11 preserves the current policy, and an established nonempty closed allowlist never relaxes from a later open-mode report.
The feature-enabled test gap is also fixed: CI now runs cargo test --manifest-path desktop/src-tauri/Cargo.toml --features mesh-llm --lib. At this exact head the Desktop Core log executed 3,114 tests (3,095 passed, 19 ignored, 0 failed), including the NIP-11 re-probe, malformed-input, open→closed/roster-unavailable restart, routing, timeout, and catalog tests.
No actionable blockers found. Non-blocking test-adequacy note: the new regression coverage proves the critical transition through focused decision seams rather than one composed open → closed/unavailable → self-only relaunch → roster-recovery scenario. The implementation path is coherent and the relevant seams are CI-executed, so I am not keeping the PR blocked on that additional composition test.
wesbillman
left a comment
There was a problem hiding this comment.
Carl, an automated reviewer, commenting via Wes’s GitHub account.
Re-reviewed head 0f1798e207bf9d16107cb35d4ab648dd683ccc6e against base 80177e4c8e97e7bf1f1a3760c4e3503aace22860.
P1 — treat non-success NIP-11 responses as unknown, not as authority to disable admission. In desktop/src-tauri/src/commands/mesh_llm.rs:194-203, the probe calls send()?.json()? without error_for_status(). A 4xx/5xx response whose JSON has a valid supported_nips array without NIP-43 therefore resolves to OpenNoMembership. Initial startup then maps it to trusted_owner_ids = None / TrustPolicy::Off at lines 404-420; a self-only fallback runtime can likewise restart into unenforced mode through mesh_llm/coordinator.rs:267-272,399-407. This contradicts the function's own contract that HTTP errors preserve the current or fail-closed policy.
I reproduced this at the exact head by changing the existing NIP-11 mock's status line from 200 OK to 503 Service Unavailable while leaving its open/closed/malformed bodies intact. cargo test --manifest-path desktop/src-tauri/Cargo.toml --features mesh-llm --lib relay_mode_probe_rechecks_the_same_url_without_caching still passed: all three 503 bodies were parsed as mode evidence. Please reject non-2xx before parsing and add a regression asserting that a valid-shaped 4xx/5xx body remains an error.
All reported CI checks are green, including the 3,114-test feature-enabled Desktop Mesh run and relay-driven lifecycle smoke. No other blockers found in the dependency, catalog, hardware ladder, timeout, discovery, or open→closed roster-transition paths.
Require a successful HTTP status before accepting supported_nips as relay-mode evidence. Cover a valid-shaped open body returned with 503 so an HTTP failure cannot disable admission. Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Require two consecutive observations before whole-app restarts, fail closed after repeated unknown mode reads, and throttle self-only-to-open recovery restarts across process launches. Add feature-enabled mesh clippy to CI and resolve the warnings it exposes. Clarify transport trust and catalog contracts. Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Apply one persisted cooldown and in-memory latch to both admission-mode restart paths, retain throttling across clock rollback, and cover the composed self-only hysteresis wiring. Make the shared Tauri clippy recipe feature-enable mesh support so local checks and CI stay aligned. Co-authored-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Remove the open-relay/open-mesh admission mode from PR #6189 at Mic's direction: running the mesh unenforced when the Buzz relay does not enforce NIP-43 membership is not a product mode we want, and it was the source of all the fail-open complexity (NIP-11 mode probing, the two-observation mode state machine, restart markers/throttles/latches). Reverted to main's behavior: admission is always roster/allowlist driven. On a relay with no membership snapshot the mesh simply runs self-only — safe and boring, no mode probes, no whole-app restarts. Removed: MeshRelayMode, relay_mesh_mode_from_nip11, the NIP-11 mode probe, coordinator_admission.rs, mode-scoped discovery/availability, and all their tests. Kept from this branch (independent of the mode work): - mesh-llm 0.76.0-rc7 upgrade and the restored hardware model ladder - BUZZ_AGENT_LLM_TIMEOUT_SECS=660 mesh client timeout default - desktop-standalone mesh=1 feature flag wiring - cfg-only warning fixes in workspace.rs and restore.rs desktop-tauri-clippy now lints BOTH cfg graphs (default and --features mesh-llm): features are additive, so a single invocation covers only one graph, and both ship (release-windows builds without mesh-llm). CI keeps calling the recipe, and keeps the feature-enabled --lib test step. Verified on this commit: clippy -D warnings clean on both graphs; feature-enabled lib suite 3110 passed / 0 failed / 19 ignored; default-feature lib suite 3005 passed / 0 failed; fmt and diff checks clean. Signed-off-by: Michael Neale <michael.neale@gmail.com>
Signed-off-by: Alessandro Joabar <sandro@squareup.com>
This reverts commit d30959c.
The MoA fleet sim used a synthetic tier mix. Buzz's shipped picker (block/buzz#6189, desktop/src-tauri/src/mesh_llm/catalog.rs) recommends exactly one model per rated-memory class, so a real fleet only ever advertises three names — and two of them are below SMALL_TIER_MAX_B. Pin what the shipped assembly path does on that ladder: laptops only (E4B x50) 50 nodes -> 1 worker mid only (9B x50) 50 -> 1 laptops + mid 100 -> 1 one big (27B x1) 1 -> 1 two big (27B x2) 2 -> 2 big fleet (27B x100) 100 -> 2 full ladder, one big 101 -> 3 full ladder, many big 900 -> 3 Two claims are asserted rather than printed: * An all-laptop Buzz fleet never convenes a committee. Every rung below 80 GB is small-tier (Qwen3.5-9B misses the 10.0 boundary by 1B), and an all-small pool collapses to its best member — the measured small-width regression in evals/moa-openrouter/RESULTS.md. * Two 80GB+ machines on the same 27B is the only shape on this ladder that reaches a real committee, via same-model self-fill. It is the homogeneous case the mid-scale eval measured at 48W/23T/2L, and RefinementPolicy::Auto enables the refine round for it. No production behaviour changes. Co-authored-by: Michael Neale <14976+michaelneale@users.noreply.github.com> Signed-off-by: Michael Neale <14976+michaelneale@users.noreply.github.com> (cherry picked from commit c0f9cf2) (cherry picked from commit 5678f96)
Bump every MeshLLM git dependency in buzz-relay and buzz-desktop from v0.76.0-rc7 to the released v0.76.0-rc8 tag at 2040765d, and regenerate both lockfiles. The transitive lockfile delta follows rc8, including the new skippy-scheduler crate. Co-authored-by: Michael Neale <michael.neale@gmail.com> Signed-off-by: Jimmy <1fe240cd1a8cf775f6f3060f115e5a303181f3abf28ad4cb0c2515f4a02b36a8@meshllm.communities.buzz.xyz>
Upgrades Buzz's mesh-llm dependencies through the released
v0.76.0-rc8tag (2040765d), including the Qwen3.8 curated recommendation and rc8's scheduler/runtime improvements.Scope note: the earlier open-relay/unenforced-admission mode has been removed from this PR at Mic's direction — it is not a product mode we want. Mesh admission remains roster/allowlist driven, exactly as on
main: on a relay with no NIP-43 membership snapshot the mesh runs self-only. No NIP-11 mode probing, no mode-transition restarts. A future perimeter/admission strategy for open relays will be designed separately.This PR also:
BUZZ_AGENT_LLM_TIMEOUT_SECS=660for mesh agents, above MeshLLM's 600-second backend timeout;desktop-tauri-clippylint both default andmesh-llmcfg graphs;autotranslated to MeshLLM's supported wire modelmesh.RC8 verification:
just cipassed locally at92ecc7ec933bdd4df804cc9f28a2b51efa5313c5.Perf previously measured on M5 Metal, Qwen3.8-27B-Q4_K_M: TTFT 0.22–0.32 s, ~25 tok/s streaming; agent-shaped turns ~1 s to first token after the first (prefix cache).