[WIP][AMD][MI355x] dsv4-fp4-mi355x-vllm-agentic, install latest lmcache#2216
[WIP][AMD][MI355x] dsv4-fp4-mi355x-vllm-agentic, install latest lmcache#2216ruizhang0101 wants to merge 1 commit into
Conversation
|
Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase For PR verification, add the PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs 感谢你的贡献！请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md，然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人，你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板，包括保留英文语句 如需进行 PR 验证，请为此 PR 添加 PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动（flake），重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档 |
00897b8 to
4788c65
Compare
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29375661761 |
![claude[bot]](https://avatars.githubusercontent.com/in/1236702?s=60&v=4){kind=small}
4788c65 to
7d1d4e2
Compare
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29375704484 |
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29378716513 |
7d1d4e2 to
9b66fa6
Compare
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29385533117 |
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29432613472 |
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29450233700 |
1 similar comment
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29450233700 |
7dbae3d to
7f681e5
Compare
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29534525713 |
7f681e5 to
9b219b2
Compare
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29535114622 |
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29536630935 |
1 similar comment
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29536630935 |
27608f9 to
ffb8879
Compare
Signed-off-by: Rui Zhang <zrfishnoodles@gmail.com>
ffb8879 to
ae9a711
Compare
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=29547186370 |
2 participants
Summary
CXX=hipcc BUILD_WITH_HIP=1)--no-separate-object-groupand--no-l1-use-lazyto the LMCache MP server launch commandLMCACHE_READY_ATTEMPTSfrom 120 to 900vllm/vllm-openai-rocm:nightly-09663abde0f50944a8d5ea30120666024b503faa(rotated off Docker Hub retention, 404s) to the stablevllm/vllm-openai-rocm:v0.25.1release tagutils/matrix_logic/validation.py:ChangelogMatrixEntry.evals/multinode_evalswere typed as fixed-seq-len-only, rejecting agentic-coding eval entries once agentic eval-selection (include_agentic, [WIP] add SWE-bench Lite accuracy eval / 添加 SWE-bench Lite 准确率评估 #1947) landed on main. Widened toUnion[..., *AgenticMatrixEntry]matchingsingle_node/multi_node, and added the missingrun-eval/eval-onlyfields to both*AgenticMatrixEntryclasses.utils/matrix_logic/generate_sweep_configs.py: agentic entry dicts never stampedrun-evalat construction time, unlike their fixed-seq-len siblings — addedFields.RUN_EVAL.value: Falseso inline validation succeeds beforemark_eval_entriesoverwrites it.