Skip to content

pipe column orderings into pruning predicate creation #15821

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 12 commits into
base: main
Choose a base branch
from

Conversation

adriangb
Copy link
Contributor

@adriangb adriangb commented Apr 23, 2025

Comment on lines +303 to +307
let pruning_predicate = PruningPredicate::try_new(
Arc::clone(predicate),
self.schema(),
vec![ColumnOrdering::Unknown; self.schema().fields().len()],
)?;
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We could add a new signature to avoid API churn, but I wanted to make it explicit for now to see all of the callsites

@adriangb adriangb force-pushed the column-orders-parquet-stats branch from 3e15afe to 8c2ceb1 Compare April 23, 2025 06:27
@etseidl
Copy link

etseidl commented Apr 25, 2025

@adriangb please check out pydantic#28

@github-actions github-actions bot added the core Core DataFusion crate label Apr 28, 2025
@adriangb adriangb marked this pull request as ready for review April 28, 2025 19:39
@alamb alamb mentioned this pull request Apr 29, 2025
25 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Core DataFusion crate datasource Changes to the datasource crate optimizer Optimizer rules
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Pruning of floating point Parquet columns is incorrect when NaN is present
2 participants