v0.3.6

[linhr]

Overview

You can find the release summary in the documentation.

The PySail Python package is available on PyPI.

What's Changed

• feat: add elt function by @davidlghellin in feat: add elt function #820
• feat: inline and inline_outer funcs, fix: emty and all-null array datatype by @SparkApplicationMaster in feat: inline and inline_outer funcs, fix: emty and all-null array datatype #841
• feat: add try_parse_url function by @rafafrdz in feat: add try_parse_url function #824
• feat: kustomize + support pod template for Sail workers by @shehabgamin in feat: kustomize + support pod template for Sail workers #833
• feat: stack function by @SparkApplicationMaster in feat: stack function #843
• fix: robots meta tag for docs by @shehabgamin in fix: robots meta tag for docs #845
• revert: robots meta tag for docs by @shehabgamin in revert: robots meta tag for docs #846
• fix: try_multiply function by @SparkApplicationMaster in fix: try_multiply function #847
• deps(npm): bump the all group with 11 updates by @dependabot[bot] in deps(npm): bump the all group with 11 updates #850
• deps(cargo): bump the all group with 6 updates by @dependabot[bot] in deps(cargo): bump the all group with 6 updates #851
• feat: add make_dt_interval function by @davidlghellin in feat: add make_dt_interval function #835
• chore: touch up docs by @shehabgamin in chore: touch up docs #852
• fix: session key without user ID by @linhr in fix: session key without user ID #849
• refactor: handle side-effect of replaceWhere for Delta Lake by @lonless9 in refactor: handle side-effect of replaceWhere for Delta Lake #848
• feat: time travel for Delta Lake by @lonless9 in feat: time travel for Delta Lake #854
• feat: binary file reader by @shehabgamin in feat: binary file reader #853
• chore: docs update by @linhr in chore: docs update #858
• feat: add version function by @rafafrdz in feat: add version function #855
• feat: months_between func, chore: refactor datetime funcs by @SparkApplicationMaster in feat: months_between func, chore: refactor datetime funcs #859
• feat: add user and session_user functions by @rafafrdz in feat: add user and session_user functions #860
• chore: add basic function docs, missing functions, and aggregate functions to window list by @shehabgamin in chore: add basic function docs, missing functions, and aggregate functions to window list #861
• fix: string escape by @linhr in fix: string escape #868
• chore: disable tracer by @shehabgamin in chore: disable tracer #869
• fix: map_from_arrays, from values column indices by @SparkApplicationMaster in fix: map_from_arrays, from values column indices #878
• fix: utc in timestamp literal by @shehabgamin in fix: utc in timestamp literal #872
• chore: use Claude Sonnet 4 for Claude Code by @linhr in chore: use Claude Sonnet 4 for Claude Code #879
• docs: sql features, literals (update) by @everettroeth in docs: sql features, literals (update) #864
• deps(npm): bump the all group with 5 updates by @dependabot[bot] in deps(npm): bump the all group with 5 updates #882
• fix: exponential type parsing by @shehabgamin in fix: exponential type parsing #873
• chore: reorganize udf functions for consistency by @rafafrdz in chore: reorganize udf functions for consistency #880
• feat: set up streaming events by @linhr in feat: set up streaming events #832
• fix: fetch DuckDB arrow data in tests by @linhr in fix: fetch DuckDB arrow data in tests #884
• deps(cargo): bump the all group with 2 updates by @dependabot[bot] in deps(cargo): bump the all group with 2 updates #881
• feat: mcp batch create views by @shehabgamin in feat: mcp batch create views #875
• fix: avoid repartitioning child for PySpark UDTF by @linhr in fix: avoid repartitioning child for PySpark UDTF #662
• feat: applyInArrow by @SparkApplicationMaster in feat: applyInArrow #886
• refactor: readme touchup by @shehabgamin in refactor: readme touchup #888
• docs: introduction (added word "multimodal") by @everettroeth in docs: introduction (added word "multimodal") #889
• feat: cogrouped applyInArrow by @SparkApplicationMaster in feat: cogrouped applyInArrow #887
• fix: df.replace() method by @SparkApplicationMaster in fix: df.replace() method #891
• fix: parsing real by @shehabgamin in fix: parsing real #892
• fix: arrow-batched UDF with no args by @SparkApplicationMaster in fix: arrow-batched UDF with no args #895
• docs: update SQL literal guide by @linhr in docs: update SQL literal guide #896
• chore: add README images by @linhr in chore: add README images #897
• chore: optimize README by @linhr in chore: optimize README #898
• deps(npm): bump eslint-plugin-vue from 10.4.0 to 10.5.0 by @dependabot[bot] in deps(npm): bump eslint-plugin-vue from 10.4.0 to 10.5.0 #903
• chore: upgrade Delta dependencies by @linhr in chore: upgrade Delta dependencies #899
• deps: upgrade eslint by @linhr in deps: upgrade eslint #906
• docs: sql features - data types added by @everettroeth in docs: sql features - data types added #893
• chore: datafusion 50 by @shehabgamin in chore: datafusion 50 #799
• refactor: move functions to a separate crate by @linhr in refactor: move functions to a separate crate #908
• refactor: remove hard PyO3 dependency for error cause by @linhr in refactor: remove hard PyO3 dependency for error cause #910
• refactor: move plan extensions by @linhr in refactor: move plan extensions #912
• fix: approx_count_distinct return type by @SparkApplicationMaster in fix: approx_count_distinct return type #914
• fix: sorting by aggregate expressions by @linhr in fix: sorting by aggregate expressions #915
• feat: delete operation for Delta Lake by @lonless9 in feat: delete operation for Delta Lake #856
• chore: set up config for join reorder optimizer by @shehabgamin in chore: set up config for join reorder optimizer #810
• fix: handle side-effect of delete operation for Delta Lake by @lonless9 in fix: handle side-effect of delete operation for Delta Lake #916
• docs: update data type guides by @linhr in docs: update data type guides #918
• fix: map_from_entries wrong result on null input by @SparkApplicationMaster in fix: map_from_entries wrong result on null input #920
• fix: explicitly find and pass llvm-profdata path to grcov by @lonless9 in fix: explicitly find and pass llvm-profdata path to grcov #923
• docs: identifiers in SQL by @linhr in docs: identifiers in SQL #922
• fix: map_from_entries error on lists with null entries by @SparkApplicationMaster in fix: map_from_entries error on lists with null entries #926
• feat: implement join reorder physical optimizer with the DPHyp algorithm by @lonless9 in feat: implement join reorder physical optimizer with the DPHyp algorithm #917
• docs: improve intro page order by @linhr in docs: improve intro page order #924
• feat: file metadata cache for Parquet by @linhr in feat: file metadata cache for Parquet #928
• chore: prepare v0.3.6 by @linhr in chore: prepare v0.3.6 #929

New Contributors

• @everettroeth made their first contribution in docs: sql features, literals (update) #864

Full Changelog: v0.3.5...v0.3.6

---

This discussion was created from the release v0.3.6.