Skip to content

Conversation

@pcarleton
Copy link
Member

Summary

Makes the results directory output optional. By default, no results directory is created - only console output is shown.

Changes

  • Add -o, --output-dir <path> option to both client and server commands
  • When not specified: no results directory is created
  • When specified: results are saved to that directory with timestamped subdirectories

Motivation

Previously, every test run created a results/<scenario>-<timestamp>/ directory, requiring results/ to be added to .gitignore in every repo where conformance tests are run. The results files (checks.json, stdout.txt, stderr.txt) were rarely needed for debugging.

Usage

# Default: no results saved
conformance client --command '...' --scenario initialize

# Save results to a specific directory  
conformance client --command '...' --scenario initialize -o ./my-results

Add -o, --output-dir option to both client and server commands.
By default, no results directory is created - only console output.
When -o is specified, results are saved to that directory with
timestamped subdirectories.

This eliminates the need to add 'results/' to .gitignore in every
repo where conformance tests are run.

Claude-Generated-By: Claude Code (cli/claude-opus-4-5=100%)
Claude-Steers: 0
Claude-Permission-Prompts: 2
Claude-Escapes: 0
@pkg-pr-new
Copy link

pkg-pr-new bot commented Jan 14, 2026

Open in StackBlitz

npx https://pkg.pr.new/modelcontextprotocol/conformance/@modelcontextprotocol/conformance@107

commit: b9bc062

Copy link
Collaborator

@felixweinberger felixweinberger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@pcarleton pcarleton merged commit 6287509 into main Jan 14, 2026
8 checks passed
@pcarleton pcarleton deleted the pcarleton/results-optional branch January 14, 2026 20:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants