Skip to content

DEL-2244: Allow SchemaMode::Merge with tainted columns - #2

Merged
eshaanmangal-tf merged 1 commit into
tf-0.22.2from
em/DEL-2244
Sep 8, 2026
Merged

eshaanmangal-tf merged 1 commit into
tf-0.22.2from
em/DEL-2244

Conversation

@eshaanmangal-tf

@eshaanmangal-tf eshaanmangal-tf commented Sep 8, 2026 •

Copy link
Copy Markdown
Collaborator

What changes are proposed in this pull request?

How was this change tested?


Note

Medium Risk
Changes which write operations are permitted under an env-based compatibility override; incorrect guards could let a filtered schema be committed and drop ignored columns from the table.

Overview
Narrows write restrictions when DELTA_KERNEL_IGNORE_COLUMNS is active: blind appends are allowed again; only operations that would persist table metadata from the filtered logical schema stay blocked.

Previously, any write failed if columns were ignored. The change introduces ensure_schema_mutations_supported() on TableConfiguration, which errors when ignored columns are non-empty, and wires it into CREATE TABLE (create_table.rs), ALTER TABLE (alter_table.rs), and try_new_with_schema (used when ALTER commits evolved metadata). The old check is removed from ensure_write_supported(), so Operation::Write can succeed for append-only paths that do not rewrite metaData.

README documents the new split (CREATE/ALTER disabled, appends OK) and warns not to use writer schema evolution (SchemaMode::Merge) under this override, since merging could still interact badly with the compatibility filter.

Reviewed by Cursor Bugbot for commit b199a1c. Bugbot is set up for automated code reviews on this repo. Configure here.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown

PR title does not match the required pattern. Please ensure you follow the conventional commits spec.

Your title should start with feat:, fix:, chore:, docs:, perf:, refactor:, test:, or ci:, and if it's a breaking change that should be suffixed with a ! (like feat!:), and then a 1-72 character brief description of your change.

Title: DEL-2244: Allow SchemaMode::Merge with tainted columns

@eshaanmangal-tf
eshaanmangal-tf merged commit 7b8bf38 into tf-0.22.2 Sep 8, 2026
12 of 45 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant