Skip to content

Commit ee61090

Browse files
authored
Add Spark 3.5.7 release notes (#637)
<img width="1475" height="1189" alt="spark-3 5 7-download" src="https://github.com/user-attachments/assets/8a331c60-a85d-4c96-ba89-aeaf8c20ce0b" /> <img width="1434" height="334" alt="spark-3 5 7 -news" src="https://github.com/user-attachments/assets/c83e97ba-e35c-43f7-91a0-0df43b1d1782" /> <img width="1473" height="700" alt="spark-3 5 7-documentation-versions" src="https://github.com/user-attachments/assets/9dc52631-7731-489a-9019-78e735572a38" /> <img width="1398" height="1124" alt="spark-3 5 7-release-notes" src="https://github.com/user-attachments/assets/045f5de4-5974-417d-968f-a6faa4ca6b77" />
1 parent d781ac9 commit ee61090

File tree

270 files changed

+1371
-785
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

270 files changed

+1371
-785
lines changed

documentation.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,7 @@ navigation:
1414
<ul>
1515
<li><a href="{{site.baseurl}}/docs/4.0.1/">Spark 4.0.1</a></li>
1616
<li><a href="{{site.baseurl}}/docs/4.0.0/">Spark 4.0.0</a></li>
17+
<li><a href="{{site.baseurl}}/docs/3.5.7/">Spark 3.5.7</a></li>
1718
<li><a href="{{site.baseurl}}/docs/3.5.6/">Spark 3.5.6</a></li>
1819
<li><a href="{{site.baseurl}}/docs/3.5.5/">Spark 3.5.5</a></li>
1920
<li><a href="{{site.baseurl}}/docs/3.5.4/">Spark 3.5.4</a></li>

js/downloads.js

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ var packagesV14 = [hadoop3p, hadoop3pscala213, hadoopFree, sources];
2424
var packagesV15 = [hadoop34p, hadoop34pSparkConnect, hadoopFree, sources];
2525

2626
addRelease("4.0.1", new Date("09/06/2025"), packagesV15, true);
27-
addRelease("3.5.6", new Date("05/29/2025"), packagesV14, true);
27+
addRelease("3.5.7", new Date("09/24/2025"), packagesV14, true);
2828

2929
function append(el, contents) {
3030
el.innerHTML += contents;
Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
---
2+
layout: post
3+
title: Spark 3.5.7 released
4+
categories:
5+
- News
6+
tags: []
7+
status: publish
8+
type: post
9+
published: true
10+
meta:
11+
_edit_last: '4'
12+
_wpas_done_all: '1'
13+
---
14+
We are happy to announce the availability of <a href="{{site.baseurl}}/releases/spark-release-3-5-7.html" title="Spark Release 3.5.7">Spark 3.5.7</a>! Visit the <a href="{{site.baseurl}}/releases/spark-release-3-5-7.html" title="Spark Release 3.5.7">release notes</a> to read about the new features, or <a href="{{site.baseurl}}/downloads.html">download</a> the release today.
Lines changed: 51 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,51 @@
1+
---
2+
layout: post
3+
title: Spark Release 3.5.7
4+
categories: []
5+
tags: []
6+
status: publish
7+
type: post
8+
published: true
9+
meta:
10+
_edit_last: '4'
11+
_wpas_done_all: '1'
12+
---
13+
14+
Spark 3.5.7 is the seventh maintenance release containing security and correctness fixes. This release is based on the branch-3.5 maintenance branch of Spark. We strongly recommend all 3.5 users to upgrade to this stable release.
15+
16+
### Notable changes
17+
18+
- [[SPARK-52721]](https://issues.apache.org/jira/browse/SPARK-52721): Wrong message parameter for CANNOT_PARSE_DATATYPE
19+
- [[SPARK-52749]](https://issues.apache.org/jira/browse/SPARK-52749): Replace preview1 to dev1 in its PyPI package name
20+
- [[SPARK-53518]](https://issues.apache.org/jira/browse/SPARK-53518): catalogString of User Defined Type should not be truncated
21+
- [[SPARK-46941]](https://issues.apache.org/jira/browse/SPARK-46941): Can't insert window group limit node for top-k computation if contains SizeBasedWindowFunction
22+
- [[SPARK-49872]](https://issues.apache.org/jira/browse/SPARK-49872): Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)
23+
- [[SPARK-52023]](https://issues.apache.org/jira/browse/SPARK-52023): udaf returning Option can cause data corruption and crashes
24+
- [[SPARK-52032]](https://issues.apache.org/jira/browse/SPARK-52032): ORC filter pushdown causes incorrect results with eqNullSafe (<=>) in DataFrame filter
25+
- [[SPARK-52240]](https://issues.apache.org/jira/browse/SPARK-52240): VectorizedDeltaLengthByteArrayReader throws ParquetDecodingException: Failed to read X bytes
26+
- [[SPARK-52339]](https://issues.apache.org/jira/browse/SPARK-52339): Relations may appear equal even though they are different
27+
- [[SPARK-52516]](https://issues.apache.org/jira/browse/SPARK-52516): Memory Leak with coalesce foreachpartitions and v2 datasources
28+
- [[SPARK-52611]](https://issues.apache.org/jira/browse/SPARK-52611): Fix SQLConf version for excludeSubqueryRefsFromRemoveRedundantAliases configuration
29+
- [[SPARK-52684]](https://issues.apache.org/jira/browse/SPARK-52684): Make CACHE TABLE Commands atomic while encounting execution errors
30+
- [[SPARK-52737]](https://issues.apache.org/jira/browse/SPARK-52737): SHS performance regression when visiting homepage
31+
- [[SPARK-52776]](https://issues.apache.org/jira/browse/SPARK-52776): ProcfsMetricsGetter splits the comm field if it contains space characters
32+
- [[SPARK-52791]](https://issues.apache.org/jira/browse/SPARK-52791): Inferring a UDT errors when first element is null
33+
- [[SPARK-52809]](https://issues.apache.org/jira/browse/SPARK-52809): Don't hold reader and iterator references for all partitions in task completion listeners for metric update
34+
- [[SPARK-52873]](https://issues.apache.org/jira/browse/SPARK-52873): Hint causes semi join results to vary
35+
- [[SPARK-53054]](https://issues.apache.org/jira/browse/SPARK-53054): The Scala Spark Connect DataFrameReader does not use the correct default format
36+
- [[SPARK-53094]](https://issues.apache.org/jira/browse/SPARK-53094): Cube-related data quality problem
37+
- [[SPARK-53155]](https://issues.apache.org/jira/browse/SPARK-53155): Global lower agggregation should not be removed
38+
- [[SPARK-53435]](https://issues.apache.org/jira/browse/SPARK-53435): race condition in CachedRDDBuilder
39+
- [[SPARK-53560]](https://issues.apache.org/jira/browse/SPARK-53560): Crash looping when retrying uncommitted batch in Kafka source and AvailableNow trigger
40+
- [[SPARK-53581]](https://issues.apache.org/jira/browse/SPARK-53581): Potential thread-safety issue for mapTaskIds.add() in IndexShuffleBlockResolver
41+
42+
### Dependency changes
43+
44+
While being a maintenance release we did still upgrade some dependencies in this release they are:
45+
- [[SPARK-52635]](https://issues.apache.org/jira/browse/SPARK-52635): Upgrade ORC to 1.9.7
46+
- [[SPARK-53532]](https://issues.apache.org/jira/browse/SPARK-53532): Upgrade Jetty to 9.4.58.v20250814
47+
48+
You can consult JIRA for the [detailed changes](https://s.apache.org/spark-3.5.7).
49+
50+
We would like to acknowledge all community members for contributing patches to this release.
51+

site/404.html

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -178,6 +178,9 @@ <h2 id="oops">Oops!</h2>
178178
<h5>Latest News</h5>
179179
<ul class="list-unstyled">
180180

181+
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
182+
<span class="small">(Sep 24, 2025)</span></li>
183+
181184
<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
182185
<span class="small">(Sep 06, 2025)</span></li>
183186

@@ -187,9 +190,6 @@ <h5>Latest News</h5>
187190
<li><a href="/news/spark-3-5-6-released.html">Spark 3.5.6 released</a>
188191
<span class="small">(May 29, 2025)</span></li>
189192

190-
<li><a href="/news/spark-4-0-0-released.html">Spark 4.0.0 released</a>
191-
<span class="small">(May 23, 2025)</span></li>
192-
193193
</ul>
194194
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
195195
</div>

site/committers.html

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -725,6 +725,9 @@ <h3>Policy on backporting bug fixes</h3>
725725
<h5>Latest News</h5>
726726
<ul class="list-unstyled">
727727

728+
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
729+
<span class="small">(Sep 24, 2025)</span></li>
730+
728731
<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
729732
<span class="small">(Sep 06, 2025)</span></li>
730733

@@ -734,9 +737,6 @@ <h5>Latest News</h5>
734737
<li><a href="/news/spark-3-5-6-released.html">Spark 3.5.6 released</a>
735738
<span class="small">(May 29, 2025)</span></li>
736739

737-
<li><a href="/news/spark-4-0-0-released.html">Spark 4.0.0 released</a>
738-
<span class="small">(May 23, 2025)</span></li>
739-
740740
</ul>
741741
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
742742
</div>

site/community.html

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -374,6 +374,9 @@ <h3>Powered by</h3>
374374
<h5>Latest News</h5>
375375
<ul class="list-unstyled">
376376

377+
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
378+
<span class="small">(Sep 24, 2025)</span></li>
379+
377380
<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
378381
<span class="small">(Sep 06, 2025)</span></li>
379382

@@ -383,9 +386,6 @@ <h5>Latest News</h5>
383386
<li><a href="/news/spark-3-5-6-released.html">Spark 3.5.6 released</a>
384387
<span class="small">(May 29, 2025)</span></li>
385388

386-
<li><a href="/news/spark-4-0-0-released.html">Spark 4.0.0 released</a>
387-
<span class="small">(May 23, 2025)</span></li>
388-
389389
</ul>
390390
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
391391
</div>

site/contributing.html

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -721,6 +721,9 @@ <h2>Code of conduct</h2>
721721
<h5>Latest News</h5>
722722
<ul class="list-unstyled">
723723

724+
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
725+
<span class="small">(Sep 24, 2025)</span></li>
726+
724727
<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
725728
<span class="small">(Sep 06, 2025)</span></li>
726729

@@ -730,9 +733,6 @@ <h5>Latest News</h5>
730733
<li><a href="/news/spark-3-5-6-released.html">Spark 3.5.6 released</a>
731734
<span class="small">(May 29, 2025)</span></li>
732735

733-
<li><a href="/news/spark-4-0-0-released.html">Spark 4.0.0 released</a>
734-
<span class="small">(May 23, 2025)</span></li>
735-
736736
</ul>
737737
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
738738
</div>

site/developer-tools.html

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -707,6 +707,9 @@ <h2>Generative tooling usage</h2>
707707
<h5>Latest News</h5>
708708
<ul class="list-unstyled">
709709

710+
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
711+
<span class="small">(Sep 24, 2025)</span></li>
712+
710713
<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
711714
<span class="small">(Sep 06, 2025)</span></li>
712715

@@ -716,9 +719,6 @@ <h5>Latest News</h5>
716719
<li><a href="/news/spark-3-5-6-released.html">Spark 3.5.6 released</a>
717720
<span class="small">(May 29, 2025)</span></li>
718721

719-
<li><a href="/news/spark-4-0-0-released.html">Spark 4.0.0 released</a>
720-
<span class="small">(May 23, 2025)</span></li>
721-
722722
</ul>
723723
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
724724
</div>

site/documentation.html

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -159,6 +159,7 @@ <h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></s
159159
<ul>
160160
<li><a href="/docs/4.0.1/">Spark 4.0.1</a></li>
161161
<li><a href="/docs/4.0.0/">Spark 4.0.0</a></li>
162+
<li><a href="/docs/3.5.7/">Spark 3.5.7</a></li>
162163
<li><a href="/docs/3.5.6/">Spark 3.5.6</a></li>
163164
<li><a href="/docs/3.5.5/">Spark 3.5.5</a></li>
164165
<li><a href="/docs/3.5.4/">Spark 3.5.4</a></li>
@@ -386,6 +387,9 @@ <h3>Research Papers</h3>
386387
<h5>Latest News</h5>
387388
<ul class="list-unstyled">
388389

390+
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
391+
<span class="small">(Sep 24, 2025)</span></li>
392+
389393
<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
390394
<span class="small">(Sep 06, 2025)</span></li>
391395

@@ -395,9 +399,6 @@ <h5>Latest News</h5>
395399
<li><a href="/news/spark-3-5-6-released.html">Spark 3.5.6 released</a>
396400
<span class="small">(May 29, 2025)</span></li>
397401

398-
<li><a href="/news/spark-4-0-0-released.html">Spark 4.0.0 released</a>
399-
<span class="small">(May 23, 2025)</span></li>
400-
401402
</ul>
402403
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
403404
</div>

0 commit comments

Comments
 (0)