-
Notifications
You must be signed in to change notification settings - Fork 1.4k
Open
Labels
area:installationbugSomething isn't workingSomething isn't workingdocumentationImprovements or additions to documentationImprovements or additions to documentationp2Non-showstopper bug or popular feature requestNon-showstopper bug or popular feature requestperformance
Description
Summary
The code review workflow installer template changed between late December 2025 and mid-January 2026. The newer template uses a plugin marketplace approach that is significantly slower and produces lower quality reviews compared to the previous simple prompt approach.
Evidence
I installed the Claude Code Review workflow in two repositories at different times:
Older template (Dec 31, 2025) - Fast, high quality
- name: Run Claude Code Review
uses: anthropics/claude-code-action@v1
with:
claude_code_oauth_token: ${{ secrets.CLAUDE_CODE_OAUTH_TOKEN }}
prompt: |
REPO: ${{ github.repository }}
PR NUMBER: ${{ github.event.pull_request.number }}
Please review this pull request and provide feedback on:
- Code quality and best practices
- Potential bugs or issues
- Performance considerations
- Security concerns
- Test coverage
Use the repository's CLAUDE.md for guidance on style and conventions.
Be constructive and helpful in your feedback.
Use `gh pr comment` with your Bash tool to leave your review as a comment on the PR.
claude_args: '--allowed-tools "Bash(gh pr comment:*),Bash(gh pr diff:*),Bash(gh pr view:*)"'Newer template (Jan 13, 2026) - Slow, lower quality
- name: Run Claude Code Review
uses: anthropics/claude-code-action@v1
with:
claude_code_oauth_token: ${{ secrets.CLAUDE_CODE_OAUTH_TOKEN }}
plugin_marketplaces: 'https://github.com/anthropics/claude-code.git'
plugins: 'code-review@claude-code-plugins'
prompt: '/code-review:code-review ${{ github.repository }}/pull/${{ github.event.pull_request.number }}'
claude_args: '--allowedTools "mcp__github_inline_comment__create_inline_comment,Bash(gh pr comment:*),Bash(gh pr diff:*),Bash(gh pr view:*),Bash(gh api:*)"'Issues with the newer template
- Performance: Reviews take ~10 minutes vs ~4 minutes with the older approach
- Plugin overhead: Loading the plugin marketplace and
code-review@claude-code-pluginsadds startup time - MCP tool latency:
mcp__github_inline_comment__create_inline_commentis slower than directghCLI commands - Vague prompt: Skill invocation (
/code-review:code-review) lacks explicit review criteria, leading to less focused output - Typo:
--allowedTools(camelCase) should be--allowed-tools(kebab-case) - Extra triggers: 4 PR events vs 2 adds unnecessary runs
Suggestion
Consider reverting the installer template to the simpler direct prompt approach, or at minimum:
- Fix the
--allowedToolstypo - Remove the MCP inline comment tool in favor of
ghCLI - Add explicit review criteria to the prompt instead of relying on the plugin's defaults
Environment
- claude-code-action@v1
- Workflows installed via GitHub App installer
Metadata
Metadata
Assignees
Labels
area:installationbugSomething isn't workingSomething isn't workingdocumentationImprovements or additions to documentationImprovements or additions to documentationp2Non-showstopper bug or popular feature requestNon-showstopper bug or popular feature requestperformance