Skip to content

Commit 78c1c28

Browse files
authored
Prep 1.0.1 release (#996)
1 parent c27bd6f commit 78c1c28

File tree

5 files changed

+147
-4
lines changed

5 files changed

+147
-4
lines changed

README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@
3939
<tbody align="center">
4040
<tr>
4141
<td >2.3</td>
42-
<td rowspan=3><a href="https://github.com/dotnet/spark/releases/tag/v1.0.0">v1.0.0</a></td>
42+
<td rowspan=3><a href="https://github.com/dotnet/spark/releases/tag/v1.0.1">v1.0.1</a></td>
4343
</tr>
4444
<tr>
4545
<td>2.4*</td>

benchmark/scala/pom.xml

+1-1
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
<modelVersion>4.0.0</modelVersion>
44
<groupId>com.microsoft.spark</groupId>
55
<artifactId>microsoft-spark-benchmark</artifactId>
6-
<version>1.0.0</version>
6+
<version>1.0.1</version>
77
<inceptionYear>2019</inceptionYear>
88
<properties>
99
<encoding>UTF-8</encoding>
+143
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,143 @@
1+
# .NET for Apache Spark 1.0.1 Release Notes
2+
This is a maintenance release which contains backported PRs to support Spark 2.4.8.
3+
4+
### New Features/Improvements
5+
6+
* Add spark.dotnet.ignoreSparkPatchVersionCheck conf to ignore patch version in DotnetRunner ([#990](https://github.com/dotnet/spark/pull/990))
7+
8+
### Bug Fixes
9+
10+
* Fix signer information mismatch issue ([#989](https://github.com/dotnet/spark/pull/989))
11+
12+
### Infrastructure / Documentation / Etc.
13+
14+
* Update dotnet-interactive deprecated feed ([#991](https://github.com/dotnet/spark/pull/991), [#995](https://github.com/dotnet/spark/pull/995))
15+
16+
17+
### Breaking Changes
18+
19+
* None
20+
21+
### Known Issues
22+
23+
* Broadcast variables do not work with [dotnet-interactive](https://github.com/dotnet/interactive) ([#561](https://github.com/dotnet/spark/pull/561))
24+
* UDFs defined using class objects with closures does not work with [dotnet-interactive](https://github.com/dotnet/interactive) ([#619](https://github.com/dotnet/spark/pull/619))
25+
* In [dotnet-interactive](https://github.com/dotnet/interactive) blocking Spark methods that require external threads to unblock them does not work. ie `StreamingQuery.AwaitTermination` requires `StreamingQuery.Stop` to unblock ([#736](https://github.com/dotnet/spark/pull/736))
26+
* `GroupedMap` does not work on Spark 3.0.0 ([#654](https://github.com/dotnet/spark/issues/654))
27+
28+
### Supported Spark Versions
29+
30+
The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with:
31+
32+
<table>
33+
<thead>
34+
<tr>
35+
<th>Spark Version</th>
36+
<th>microsoft-spark JAR</th>
37+
</tr>
38+
</thead>
39+
<tbody align="center">
40+
<tr>
41+
<td>2.3.*</td>
42+
<td>microsoft-spark-2-3_2.11-1.0.1.jar</td>
43+
</tr>
44+
<tr>
45+
<td>2.4.0</td>
46+
<td rowspan=7>microsoft-spark-2-4_2.11-1.0.1.jar</td>
47+
</tr>
48+
<tr>
49+
<td>2.4.1</td>
50+
</tr>
51+
<tr>
52+
<td>2.4.3</td>
53+
</tr>
54+
<tr>
55+
<td>2.4.4</td>
56+
</tr>
57+
<tr>
58+
<td>2.4.5</td>
59+
</tr>
60+
<tr>
61+
<td>2.4.6</td>
62+
</tr>
63+
<tr>
64+
<td>2.4.7</td>
65+
</tr>
66+
<tr>
67+
<td>2.4.8</td>
68+
</tr>
69+
<tr>
70+
<td>2.4.2</td>
71+
<td><a href="https://github.com/dotnet/spark/issues/60">Not supported</a></td>
72+
</tr>
73+
<tr>
74+
<td>3.0.0</td>
75+
<td rowspan=2>microsoft-spark-3-0_2.12-1.0.1.jar</td>
76+
</tr>
77+
<tr>
78+
<td>3.0.1</td>
79+
</tr>
80+
</tbody>
81+
</table>
82+
83+
### Supported Delta Versions
84+
85+
The following table outlines the supported Delta versions along with the Microsoft.Spark.Extensions version to use with:
86+
87+
<table>
88+
<thead>
89+
<tr>
90+
<th>Delta Version</th>
91+
<th>Microsoft.Spark.Extensions.Delta</th>
92+
</tr>
93+
</thead>
94+
<tbody align="center">
95+
<tr>
96+
<td>0.1.0</td>
97+
<td rowspan=8>1.0.1</td>
98+
</tr>
99+
<tr>
100+
<td>0.2.0</td>
101+
</tr>
102+
<tr>
103+
<td>0.3.0</td>
104+
</tr>
105+
<tr>
106+
<td>0.4.0</td>
107+
</tr>
108+
<tr>
109+
<td>0.5.0</td>
110+
</tr>
111+
<tr>
112+
<td>0.6.0</td>
113+
</tr>
114+
<tr>
115+
<td>0.6.1</td>
116+
</tr>
117+
<tr>
118+
<td>0.7.0</td>
119+
</tr>
120+
</tbody>
121+
</table>
122+
123+
### Supported Hyperspace Versions
124+
125+
The following table outlines the supported Hyperspace versions along with the Microsoft.Spark.Extensions version to use with:
126+
127+
<table>
128+
<thead>
129+
<tr>
130+
<th>Hyperspace Version</th>
131+
<th>Microsoft.Spark.Extensions.Hyperspace</th>
132+
</tr>
133+
</thead>
134+
<tbody align="center">
135+
<tr>
136+
<td>0.1.0</td>
137+
<td rowspan=2>1.0.1</td>
138+
</tr>
139+
<tr>
140+
<td>0.2.0</td>
141+
</tr>
142+
</tbody>
143+
</table>

eng/Versions.props

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
<?xml version="1.0" encoding="utf-8"?>
22
<Project ToolsVersion="4.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
33
<PropertyGroup>
4-
<VersionPrefix>1.0.0</VersionPrefix>
4+
<VersionPrefix>1.0.1</VersionPrefix>
55
<PreReleaseVersionLabel>prerelease</PreReleaseVersionLabel>
66
<RestoreSources>
77
$(RestoreSources);

src/scala/pom.xml

+1-1
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@
77
<version>${microsoft-spark.version}</version>
88
<properties>
99
<encoding>UTF-8</encoding>
10-
<microsoft-spark.version>1.0.0</microsoft-spark.version>
10+
<microsoft-spark.version>1.0.1</microsoft-spark.version>
1111
</properties>
1212

1313
<modules>

0 commit comments

Comments
 (0)