Skip to content

Comments

Added implementation to delete file and CLI to add file#2997

Open
subkanthi wants to merge 10 commits intoapache:mainfrom
subkanthi:delete_file
Open

Added implementation to delete file and CLI to add file#2997
subkanthi wants to merge 10 commits intoapache:mainfrom
subkanthi:delete_file

Conversation

@subkanthi
Copy link

@subkanthi subkanthi commented Feb 1, 2026

Closes #2787

Rationale for this change

To be in parity with java and rust to support delete files.

Are these changes tested?

Yes

Are there any user-facing changes?

Yes

@subkanthi subkanthi marked this pull request as draft February 1, 2026 20:54
@subkanthi subkanthi marked this pull request as ready for review February 7, 2026 04:20
@subkanthi subkanthi marked this pull request as draft February 7, 2026 04:20
@subkanthi subkanthi marked this pull request as ready for review February 11, 2026 17:43
@subkanthi subkanthi marked this pull request as draft February 11, 2026 18:15
@subkanthi subkanthi marked this pull request as ready for review February 11, 2026 18:24
@subkanthi subkanthi changed the title Added implementation to delete file. Added implementation to delete file and CLI to add file Feb 11, 2026

result: dict[str, DataFile] = {}
for manifest in snapshot.manifests(io):
if manifest.content == ManifestContent.DATA:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we also drop related deletes?

return [f.result() for f in futures if f.result()]


def _get_data_files_from_snapshot(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we use metadata tables for this? I'd like to avoid functions like these since they do not parallelize

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add delete_files

2 participants