-
Notifications
You must be signed in to change notification settings - Fork 28.9k
Pull requests: apache/spark
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[SPARK-53574][SQL][FOLLOWUP] still reset the default AnalysisContext
SQL
#52482
opened Sep 29, 2025 by
cloud-fan
Loading…
[SPARK-53743][SS] Remove the usage of fetchWithArrow in ListState.put/appendList
PYTHON
SQL
STRUCTURED STREAMING
#52479
opened Sep 29, 2025 by
HeartSaVioR
Loading…
[SPARK-53738][SQL] PlannedWrite should preserve custom sort order when query output contains literal
SQL
#52474
opened Sep 27, 2025 by
pan3793
Loading…
[WIP][SPARK-53737] Add Real-time Mode trigger
SQL
STRUCTURED STREAMING
#52473
opened Sep 27, 2025 by
jerrypeng
Loading…
[SPARK-53734][SQL] Prefer table column over LCA when resolving array index
SQL
#52472
opened Sep 26, 2025 by
mihailotim-db
Loading…
[SPARK-53733][SQL] Delay
resolveColsLastResort
until all previous UnresolvedAlias
es are resolved
SQL
#52471
opened Sep 26, 2025 by
mihailotim-db
Loading…
[SPARK-53718][SQL] Add a new Optimizer rule to flatten nested MapConcat expressions
SQL
#52469
opened Sep 26, 2025 by
MRKKmrkk
Loading…
[SPARK-53696][PYTHON]Default to bytes for BinaryType in PySpark arrow UDF
BUILD
CONNECT
CORE
DOCS
PYTHON
SQL
#52467
opened Sep 26, 2025 by
xianzhe-databricks
•
Draft
[SPARK-53720][SQL] Simplify extracting Table from DataSourceV2Relation
SQL
STRUCTURED STREAMING
#52460
opened Sep 25, 2025 by
aokolnychyi
Loading…
[SPARK-53690][SS] Fix exponential formatting of avgOffsetsBehindLatest in Kafka sources object in progress json
SQL
STRUCTURED STREAMING
#52445
opened Sep 25, 2025 by
jayantdb
Loading…
[SPARK-53406][SQL] Avoid unnecessary shuffle join in direct passthrough shuffle id
SQL
#52443
opened Sep 25, 2025 by
shujingyang-db
Loading…
[SPARK-53691][PS][INFRA][TESTS] Further reorganize tests for Pandas API
BUILD
INFRA
#52433
opened Sep 24, 2025 by
zhengruifeng
Loading…
[SPARK-53687][SQL][SS][SDP] Introduce WATERMARK clause in SQL statement
DOCS
SQL
STRUCTURED STREAMING
#52428
opened Sep 24, 2025 by
HeartSaVioR
Loading…
[SPARK-53686][SQL] DESC column should print out default value
SQL
#52427
opened Sep 24, 2025 by
shujingyang-db
Loading…
[SPARK-53676][PYTHON] Extend to support column name
CONNECT
PYTHON
SQL
#52420
opened Sep 23, 2025 by
malthe
Loading…
[SPARK-53666][DOCS] Add script to generate llms.txt file for Spark main website
BUILD
INFRA
#52412
opened Sep 22, 2025 by
allisonwang-db
•
Draft
[DO-NOT-MERGE][DRAFT] Test workflow for python 3.11 and spark connect 3.5
CONNECT
INFRA
PYTHON
STRUCTURED STREAMING
#52408
opened Sep 22, 2025 by
shujingyang-db
•
Draft
[SPARK-53659][SQL] Infer Variant shredding schema when writing to Parquet
SQL
#52406
opened Sep 22, 2025 by
cashmand
Loading…
[SPARK-53658][CONNECT] Accept literal data_type field in ExecutePlanResponse
CONNECT
PYTHON
SQL
#52405
opened Sep 22, 2025 by
heyihong
Loading…
[SPARK-53656][SS] Refactor MemoryStream to use SparkSession instead of SQLContext
SQL
STRUCTURED STREAMING
#52402
opened Sep 22, 2025 by
ganeshashree
Loading…
Previous Next
ProTip!
Mix and match filters to narrow down what you’re looking for.