Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add $all_entries metadata table to Iceberg #24543

Merged
merged 1 commit into from
Dec 24, 2024

Conversation

ebyhr
Copy link
Member

@ebyhr ebyhr commented Dec 20, 2024

Description

Add $all_entries metadata table to Iceberg.
Docs will be added in #24542

Release notes

## Iceberg
* Add `$all_entries` metadata table. ({issue}`24543`)

@cla-bot cla-bot bot added the cla-signed label Dec 20, 2024
@github-actions github-actions bot added the iceberg Iceberg connector label Dec 20, 2024
@ebyhr ebyhr force-pushed the ebi/iceberg-all-entries branch from e896c7c to 869a7b1 Compare December 20, 2024 08:09
@ebyhr ebyhr force-pushed the ebi/iceberg-all-entries branch from 869a7b1 to 7cb5833 Compare December 23, 2024 06:46
import static org.apache.iceberg.MetadataTableType.ENTRIES;

// https://iceberg.apache.org/docs/latest/spark-queries/#all-entries
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't get why the same table would be needed under a different name.
Could you please elaborate on the need for it ?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

$entries returns the entries of the current snapshot. $all_entries returns entries for all snapshots.
$all_entries covers $entries, but $entries allows inspecting the current status without filtering.

@ebyhr ebyhr force-pushed the ebi/iceberg-all-entries branch from 7cb5833 to d783cb1 Compare December 24, 2024 03:07
@ebyhr ebyhr merged commit 47720cb into trinodb:master Dec 24, 2024
31 of 42 checks passed
@ebyhr ebyhr deleted the ebi/iceberg-all-entries branch December 24, 2024 03:33
@github-actions github-actions bot added this to the 469 milestone Dec 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed iceberg Iceberg connector
Development

Successfully merging this pull request may close these issues.

2 participants