Skip to content

[ExecuTorch][WebGPU] Test coverage for the f16-accumulate steel GEMM#20801

Merged
meta-codesync[bot] merged 6 commits into
gh/JCNTH/16/basefrom
gh/JCNTH/16/head
Jul 9, 2026
Merged

[ExecuTorch][WebGPU] Test coverage for the f16-accumulate steel GEMM#20801
meta-codesync[bot] merged 6 commits into
gh/JCNTH/16/basefrom
gh/JCNTH/16/head

Conversation

@JCNTH

@JCNTH JCNTH commented Jul 9, 2026

Copy link
Copy Markdown

Stack from ghstack (oldest at bottom):

Adds golden coverage for the f16-accumulate (pwdqf16acc) steel GEMM, which runs under WGPU_BACKEND_STEEL_F16ACC when group_size % BK == 0.

Key changes:

  • test_quantized_linear.py / test_webgpu_native.cpp — add pwdqf16acc (96x2048x256, K=2048) and pwdqf16acc_down (128x8192x2048, deep-K worst case) under #ifdef WGPU_BACKEND_STEEL_F16ACC, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply steel_f16 (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
@exported-using-ghexport

Differential Revision: D111163651

Differential Revision: D111163651

[ghstack-poisoned]
@pytorch-bot

pytorch-bot Bot commented Jul 9, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/20801

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 12 Pending, 2 Unrelated Failures

As of commit de9852c with merge base f4b01a8 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following job failed but was likely due to flakiness present on trunk:

BROKEN TRUNK - The following job failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

  • pull / android / build-android (gh) (trunk failure)
    ImportError: /opt/hostedtoolcache/Python/3.11.15/x64/lib/python3.11/site-packages/executorch/extension/training/pybindings/_training_lib.cpython-311-x86_64-linux-gnu.so: undefined symbol: _ZN3c104impl3cow23materialize_cow_storageERNS_11StorageImplE

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@github-actions

github-actions Bot commented Jul 9, 2026

Copy link
Copy Markdown

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 9, 2026
[ghstack-poisoned]
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401485270
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
[ghstack-poisoned]
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401485270
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401485270
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
[ghstack-poisoned]
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
[ghstack-poisoned]
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
@meta-codesync meta-codesync Bot merged commit d47e216 into gh/JCNTH/16/base Jul 9, 2026
175 of 183 checks passed
@meta-codesync meta-codesync Bot deleted the gh/JCNTH/16/head branch July 9, 2026 21:41
@meta-codesync meta-codesync Bot temporarily deployed to cherry-pick-bot July 9, 2026 21:41 Inactive
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
JCNTH added a commit that referenced this pull request Jul 9, 2026
Pull Request resolved: #20801

Adds golden coverage for the f16-accumulate (`pwdqf16acc`) steel GEMM, which runs under `WGPU_BACKEND_STEEL_F16ACC` when `group_size % BK == 0`.

Key changes:
- `test_quantized_linear.py` / `test_webgpu_native.cpp` — add `pwdqf16acc` (96x2048x256, K=2048) and `pwdqf16acc_down` (128x8192x2048, deep-K worst case) under `#ifdef WGPU_BACKEND_STEEL_F16ACC`, goldened against the fp64 dequant-matmul truth. f16 accumulation error grows with K, so the tolerances are wider than the f16-multiply `steel_f16` (2.3e-4) and the deep-K shape gets the loosest gate; perplexity (the kernel diff) is the primary quality bar and this catches gross bit/index bugs.

Co-authored-with: Claude Code.
ghstack-source-id: 401515200
@exported-using-ghexport

Differential Revision: [D111163651](https://our.internmc.facebook.com/intern/diff/D111163651/)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants