Skip to content

fix(client): robustness improvements for retry, streaming#14

Merged
lostmygithubaccount merged 1 commit intomainfrom
cody/robustness
Apr 5, 2026
Merged

fix(client): robustness improvements for retry, streaming#14
lostmygithubaccount merged 1 commit intomainfrom
cody/robustness

Conversation

@lostmygithubaccount
Copy link
Copy Markdown
Member

Summary

  • Add pseudo-jitter to exponential backoff delay to prevent thundering herd on retries
  • Expand retryable status codes from just 503 to include 429, 502, 503, 504
  • Add 30s read timeout to streaming requests (was unlimited)
  • Add 10MB buffer size limit to SSE parser to prevent unbounded memory growth

Generated with Claude Code

…ng timeout, buffer limit

- Add pseudo-jitter to exponential backoff to prevent thundering herd
- Retry on 429, 502, 503, 504 (was only 503)
- Add 30s read timeout to streaming client
- Add 10MB buffer size limit to SSE parser to prevent unbounded growth

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@lostmygithubaccount lostmygithubaccount enabled auto-merge (squash) April 5, 2026 23:46
@lostmygithubaccount lostmygithubaccount merged commit bceaf15 into main Apr 5, 2026
1 check passed
@lostmygithubaccount lostmygithubaccount deleted the cody/robustness branch April 5, 2026 23:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant