Skip to content

[spark] Fix analyze failure for timestamp ntz columns - #9485

Merged
JingsongLi merged 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/tz-analyze
Sep 2, 2026
Merged

[spark] Fix analyze failure for timestamp ntz columns#9485
JingsongLi merged 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/tz-analyze

Conversation

@ArnavBalyan

Copy link
Copy Markdown
Member

Purpose

  • Analyzing a table with timestamp ntz columns causes ClassCastException.
  • Spark reports timestamp ntz statistics as microsecond long values, but converter attempts to serialize them directly as timestamps.
  • Convert the statistics to Paimon timestamps before persisting them.

Tests

  • UT

@JingsongLi

Copy link
Copy Markdown
Contributor

+1

@JingsongLi
JingsongLi merged commit 58bc214 into apache:master Sep 2, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants