Skip to content

Expose zero-only decimal CSV inference metadata - #13

Merged
osipovartem merged 1 commit into
variant-get-nested-extensionfrom
arrow-csv-zero-only-decimal
Oct 8, 2026
Merged

osipovartem merged 1 commit into
variant-get-nested-extensionfrom
arrow-csv-zero-only-decimal

Conversation

@osipovartem

Copy link
Copy Markdown

Summary

  • Mark all-zero decimal fields in opt-in Arrow CSV inference with chunk-local metadata.
  • This lets downstream streaming inferencers combine zero-only chunks with exact scale-38 decimals without falsely requiring an integer digit.
  • The marker is not merge-stable under generic Field::try_merge; consumers must inspect it before merging fields.

Validation

  • cargo +1.95.0 test -p arrow-csv --lib --quiet: 96/96 passed.
  • cargo +1.95.0 clippy -p arrow-csv --all-targets --quiet: passed with pre-existing warnings outside this diff.
  • git diff --check: passed.
  • Independent read-only review: approved.

@osipovartem
osipovartem merged commit d8ea6ae into variant-get-nested-extension Oct 8, 2026
19 of 26 checks passed
@github-actions github-actions Bot added the arrow label Oct 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant