Commit daa69c7
[C++] Align ORC predicate pushdown error handling with Parquet
Change ORC predicate pushdown from conservative fallback strategy to
error propagation, matching Parquet's behavior. Previously, FilterStripes()
caught exceptions and fell back to reading all stripes. Now errors propagate
directly via ARROW_ASSIGN_OR_RAISE for fail-fast behavior.
Changes:
- Remove try/catch block in FilterStripes() that handled bad_alloc and
invalid_argument exceptions
- Remove fallback logic that returned all stripes on error
- Simplify control flow (~20 lines removed)
- Update FilterStripes() documentation to clarify error propagation
- ARROW_ORC_DISABLE_PREDICATE_PUSHDOWN env var still provides escape hatch
Tests:
- Add ErrorPropagationAlignedWithParquet test
- Add EnvironmentVariableDisablesPushdown test
- Add GracefulDegradationForMissingStats test
- All 39 existing ORC tests pass
This makes ORC and Parquet behave consistently when predicate evaluation
fails, surfacing errors immediately rather than silently degrading performance.
Co-Authored-By: Claude Sonnet 4.5 <[email protected]>1 parent 2e54bb5 commit daa69c7
File tree
3 files changed
+110
-18
lines changed- cpp/src/arrow/dataset
3 files changed
+110
-18
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
342 | 342 | | |
343 | 343 | | |
344 | 344 | | |
345 | | - | |
346 | | - | |
347 | | - | |
| 345 | + | |
| 346 | + | |
348 | 347 | | |
349 | | - | |
350 | | - | |
| 348 | + | |
| 349 | + | |
351 | 350 | | |
352 | | - | |
353 | | - | |
354 | | - | |
355 | | - | |
356 | | - | |
357 | | - | |
358 | | - | |
359 | | - | |
360 | | - | |
361 | | - | |
362 | | - | |
363 | | - | |
364 | | - | |
| 351 | + | |
| 352 | + | |
365 | 353 | | |
366 | 354 | | |
367 | 355 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
97 | 97 | | |
98 | 98 | | |
99 | 99 | | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
100 | 104 | | |
101 | 105 | | |
102 | 106 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
574 | 574 | | |
575 | 575 | | |
576 | 576 | | |
| 577 | + | |
| 578 | + | |
| 579 | + | |
| 580 | + | |
| 581 | + | |
| 582 | + | |
| 583 | + | |
| 584 | + | |
| 585 | + | |
| 586 | + | |
| 587 | + | |
| 588 | + | |
| 589 | + | |
| 590 | + | |
| 591 | + | |
| 592 | + | |
| 593 | + | |
| 594 | + | |
| 595 | + | |
| 596 | + | |
| 597 | + | |
| 598 | + | |
| 599 | + | |
| 600 | + | |
| 601 | + | |
| 602 | + | |
| 603 | + | |
| 604 | + | |
| 605 | + | |
| 606 | + | |
| 607 | + | |
| 608 | + | |
| 609 | + | |
| 610 | + | |
| 611 | + | |
| 612 | + | |
| 613 | + | |
| 614 | + | |
| 615 | + | |
| 616 | + | |
| 617 | + | |
| 618 | + | |
| 619 | + | |
| 620 | + | |
| 621 | + | |
| 622 | + | |
| 623 | + | |
| 624 | + | |
| 625 | + | |
| 626 | + | |
| 627 | + | |
| 628 | + | |
| 629 | + | |
| 630 | + | |
| 631 | + | |
| 632 | + | |
| 633 | + | |
| 634 | + | |
| 635 | + | |
| 636 | + | |
| 637 | + | |
| 638 | + | |
| 639 | + | |
| 640 | + | |
| 641 | + | |
| 642 | + | |
| 643 | + | |
| 644 | + | |
| 645 | + | |
| 646 | + | |
| 647 | + | |
| 648 | + | |
| 649 | + | |
| 650 | + | |
| 651 | + | |
| 652 | + | |
| 653 | + | |
| 654 | + | |
| 655 | + | |
| 656 | + | |
| 657 | + | |
| 658 | + | |
| 659 | + | |
| 660 | + | |
| 661 | + | |
| 662 | + | |
| 663 | + | |
| 664 | + | |
| 665 | + | |
| 666 | + | |
| 667 | + | |
| 668 | + | |
| 669 | + | |
| 670 | + | |
| 671 | + | |
| 672 | + | |
| 673 | + | |
| 674 | + | |
| 675 | + | |
| 676 | + | |
577 | 677 | | |
578 | 678 | | |
0 commit comments