Skip to content

chore: bump iceberg-rust dependency to latest [iceberg]#3606

Draft
mbutrovich wants to merge 8 commits intoapache:mainfrom
mbutrovich:iceberg-rust-update
Draft

chore: bump iceberg-rust dependency to latest [iceberg]#3606
mbutrovich wants to merge 8 commits intoapache:mainfrom
mbutrovich:iceberg-rust-update

Conversation

@mbutrovich
Copy link
Contributor

@mbutrovich mbutrovich commented Feb 26, 2026

Which issue does this PR close?

N/A.

Rationale for this change

Take advantage of upstream reader performance optimizations:

What changes are included in this PR?

  • Bump iceberg dependency in Cargo.toml
  • Add Parquet metadata size hint that defaults to DataFusion's
  • Serialize file sizes for Iceberg data files and delete files. Unfortunately, this surfaces an Iceberg bug (Missing size rewrite in rewrite_table_path for delete file iceberg#12554) so we still have to issue a stat() on delete files. I am fixing in upstream Iceberg

How are these changes tested?

Existing tests. I also ran IcebergReadFromS3Suite locally (since it's not run in CI) to verify that reading a delete file's size in an object store works.

@mbutrovich
Copy link
Contributor Author

Let's get DF52 in first, then I'll jump to an even newer iceberg-rust commit since they just picked up DF52 as well.

@mbutrovich mbutrovich marked this pull request as draft February 26, 2026 21:40
@mbutrovich
Copy link
Contributor Author

Draft since I want to pick up the DF52 changes in iceberg-rust, and hopefully apache/iceberg-rust#2181 will merge soon too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant