Skip to content

feat(gallery): add Ornith 35B Q5 and Q6 variants - #12050

Closed
localai-org-maint-bot wants to merge 1 commit into
masterfrom
cron/model-gallery-20260914-run6
Closed

localai-org-maint-bot wants to merge 1 commit into
masterfrom
cron/model-gallery-20260914-run6

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

Add Q5_K_M and Q6_K builds of Ornith-1.5-35B-A3B to the gallery, filling the gap between its existing Q4 and Q8 builds. Both entries use the existing llama.cpp configuration and BF16 vision projector, and participate in automatic variant selection. Document explicit Q6 installation.

Notes for Reviewers

  • Source: https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B-GGUF
  • Pin new downloads to publisher revision 12393612fd4f730ff5aadc23e9b8f9648aa49ceb.
  • Cross-check all three artifact SHA256 values against HF API LFS metadata and x-linked-etag headers at that revision.
  • CGO_ENABLED=0 go test ./core/gallery -count=1 -ginkgo.focus='gallery/index.yaml|gallery variant lint' passes.
  • The full gallery suite reports 392 passed, 3 failed, and 9 skipped. The three failures are HTTP 403 responses from GitHub-hosted fixtures in request_test.go and backends_test.go.
  • Additional YAML validation confirms the new entries' checksums, revision pins, model/projector paths, backend, and variant references. git diff --check passes.
  • Inference was not run locally.

Signed commits

  • Human DCO sign-off is required; no AI sign-off was added.
  • Documentation updated in docs/content/features/model-gallery.md.

Add the missing intermediate quantizations with the BF16 vision
projector and link them from the existing Q4 entry. Pin the new
artifacts to the publisher revision and document variant selection.

Assisted-by: Codex:gpt-6
mudler added a commit that referenced this pull request Sep 18, 2026
Consolidates all 25 pending gallery bot PRs into a single merge to resolve
the conflict cascade — every PR branched from a different point in master
and they all touch gallery/index.yaml, so merging them individually was
blocked by constant conflicts.

Changes:
- gallery/index.yaml: +739 lines (new model entries and fixes)
- docs/content/features/model-gallery.md: +116 lines (new model docs)
- docs/content/features/audio-cpp.md: +12 lines (Sortformer checksum fix)

Entry count: 1597 -> 1890 (293 new entries, no duplicates, YAML validated).

Supersedes: #11986 #11992 #11994 #11996 #11999 #12002 #12017 #12019
#12021 #12025 #12027 #12029 #12032 #12036 #12037 #12038 #12041 #12042
#12043 #12047 #12050 #12064 #12065 #12066 #12118

Assisted-by: MAKI:regolo/glm5.2
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
mudler added a commit that referenced this pull request Sep 18, 2026
Consolidates all 25 pending gallery bot PRs into a single merge to resolve
the conflict cascade — every PR branched from a different point in master
and they all touch gallery/index.yaml, so merging them individually was
blocked by constant conflicts.

Changes:
- gallery/index.yaml: +739 lines (new model entries and fixes)
- docs/content/features/model-gallery.md: +116 lines (new model docs)
- docs/content/features/audio-cpp.md: +12 lines (Sortformer checksum fix)

Entry count: 1597 -> 1890 (293 new entries, no duplicates, YAML validated).

Supersedes: #11986 #11992 #11994 #11996 #11999 #12002 #12017 #12019
#12021 #12025 #12027 #12029 #12032 #12036 #12037 #12038 #12041 #12042
#12043 #12047 #12050 #12064 #12065 #12066 #12118

Assisted-by: MAKI:regolo/glm5.2
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
mudler added a commit that referenced this pull request Sep 18, 2026
Consolidates all 25 pending gallery bot PRs into a single merge to resolve
the conflict cascade — every PR branched from a different point in master
and they all touch gallery/index.yaml, so merging them individually was
blocked by constant conflicts.

Changes:
- gallery/index.yaml: +739 lines (new model entries and fixes)
- docs/content/features/model-gallery.md: +116 lines (new model docs)
- docs/content/features/audio-cpp.md: +12 lines (Sortformer checksum fix)

Entry count: 1597 -> 1890 (293 new entries, no duplicates, YAML validated).

Supersedes: #11986 #11992 #11994 #11996 #11999 #12002 #12017 #12019
#12021 #12025 #12027 #12029 #12032 #12036 #12037 #12038 #12041 #12042
#12043 #12047 #12050 #12064 #12065 #12066 #12118

Assisted-by: MAKI:regolo/glm5.2

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant