Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a Delta Lake product test to check Trino compatibility with UniForm Iceberg #19430

Closed
findinpath opened this issue Oct 18, 2023 · 1 comment
Labels
delta-lake Delta Lake connector test

Comments

@findinpath
Copy link
Contributor

With the newest release of Delta Lake 3.0.0, there can be created Delta Lake tables which can be read by Iceberg clients as well.

Follow the guideline mentioned below to create a UniForm table

https://docs.delta.io/3.0.0/delta-uniform.html

Add data (partitioned & unpartitioned) to it and verify converted_delta_version to see whether the async Iceberg metadata file generation was done and subsequently use Iceberg's connector register_table to register for reading the Iceberg table.

Depends on trinodb/docker-images#183

The product tests should be run on Databricks as wel.

@findinpath findinpath added test delta-lake Delta Lake connector labels Oct 18, 2023
@findinpath
Copy link
Contributor Author

Trino can read Delta Lake tables, so there is no need to check whether UniForm Delta table can be read as an Iceberg table.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
delta-lake Delta Lake connector test
Development

No branches or pull requests

1 participant