0.4.0 Release (#189)

Author: imback82

README.md

@@ -39,7 +39,7 @@
     <tbody align="center">
         <tr>
             <td >2.3.*</td>
-            <td rowspan=4><a href="https://github.com/dotnet/spark/releases/tag/v0.3.0">v0.3.0</a></td>
+            <td rowspan=4><a href="https://github.com/dotnet/spark/releases/tag/v0.4.0">v0.4.0</a></td>
         </tr>
         <tr>
             <td>2.4.0</td>

benchmark/scala/pom.xml

@@ -3,7 +3,7 @@
   <modelVersion>4.0.0</modelVersion>
   <groupId>com.microsoft.spark</groupId>
   <artifactId>microsoft-spark-benchmark</artifactId>
-  <version>0.3.0</version>
+  <version>0.4.0</version>
   <inceptionYear>2019</inceptionYear>
   <properties>
     <encoding>UTF-8</encoding>

docs/release-notes/0.3/release-0.3.md

@@ -26,11 +26,11 @@ The following table outlines the supported Spark versions along with the microso
     <tbody align="center">
         <tr>
             <td>2.3.*</td>
-            <td>microsoft-spark-2.3.x-0.2.0.jar</td>
+            <td>microsoft-spark-2.3.x-0.3.0.jar</td>
         </tr>
         <tr>
             <td>2.4.0</td>
-            <td rowspan=3>microsoft-spark-2.4.x-0.2.0.jar</td>
+            <td rowspan=3>microsoft-spark-2.4.x-0.3.0.jar</td>
         </tr>
         <tr>
             <td>2.4.1</td>

docs/release-notes/0.4/release-0.4.md

@@ -0,0 +1,51 @@
+# .NET for Apache Spark 0.4 Release Notes
+
+### New Features and Improvements
+
+* Revamped loading assemblies used inside UDFs ([#180](https://github.com/dotnet/spark/pull/180))
+* Support for Vector UDFs ([#127](https://github.com/dotnet/spark/pull/127))
+* Support for Grouped Map UDFs ([#143](https://github.com/dotnet/spark/pull/143))
+* Resolve the signer mismatch issue ([#186](https://github.com/dotnet/spark/pull/186))
+* Ability to launch a debugger from the worker ([#150](https://github.com/dotnet/spark/pull/150))
+* Compatibility check for Microsoft.Spark.dll in the worker ([#170](https://github.com/dotnet/spark/pull/170))
+* Update Apache.Arrow to v0.14.1 ([#167](https://github.com/dotnet/spark/pull/167))
+* Support for RuntimeConfig in SparkSession ([#184](https://github.com/dotnet/spark/pull/184))
+* Support for `Trigger` in `DataStreamWriter` ([#153](https://github.com/dotnet/spark/pull/153))
+* The ability to use `--archives` option to deploy the worker binaries and assemblies that UDFs depend on ([#187](https://github.com/dotnet/spark/pull/187))
+
+### Breaking Changes
+* Due to the changes in loading assemblies ([#180](https://github.com/dotnet/spark/pull/180)), the Microsoft.Spark.Worker executable is no longer compatible with the previous versions.
+* The `--class org.apache.spark.deploy.DotnetRunner` option in `spark-submit` is changed to **`--class org.apache.spark.deploy.dotnet.DotnetRunner`** to resolve the signer mismatch issue ([#186](https://github.com/dotnet/spark/pull/186)).
+
+### Supported Spark Versions
+
+The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with:
+
+<table>
+    <thead>
+        <tr>
+            <th>Spark Version</th>
+            <th>microsoft-spark JAR</th>
+        </tr>
+    </thead>
+    <tbody align="center">
+        <tr>
+            <td>2.3.*</td>
+            <td>microsoft-spark-2.3.x-0.4.0.jar</td>
+        </tr>
+        <tr>
+            <td>2.4.0</td>
+            <td rowspan=3>microsoft-spark-2.4.x-0.4.0.jar</td>
+        </tr>
+        <tr>
+            <td>2.4.1</td>
+        </tr>
+        <tr>
+            <td>2.4.3</td>
+        </tr>
+        <tr>
+            <td>2.4.2</td>
+            <td><a href="https://github.com/dotnet/spark/issues/60">Not supported</a></td>
+        </tr>
+    </tbody>
+</table>

eng/Versions.props

@@ -1,7 +1,7 @@
 <?xml version="1.0" encoding="utf-8"?>
 <Project ToolsVersion="4.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
   <PropertyGroup>
-    <VersionPrefix>0.3.0</VersionPrefix>
+    <VersionPrefix>0.4.0</VersionPrefix>
     <PreReleaseVersionLabel>prerelease</PreReleaseVersionLabel>
     <RestoreSources>
       $(RestoreSources);

src/scala/microsoft-spark-2.3.x/pom.xml

@@ -4,7 +4,7 @@
   <parent>
     <groupId>com.microsoft.scala</groupId>
     <artifactId>microsoft-spark</artifactId>
-    <version>0.3.0</version>
+    <version>0.4.0</version>
   </parent>
   <artifactId>microsoft-spark-2.3.x</artifactId>
   <inceptionYear>2019</inceptionYear>

src/scala/microsoft-spark-2.4.x/pom.xml

@@ -4,7 +4,7 @@
   <parent>
     <groupId>com.microsoft.scala</groupId>
     <artifactId>microsoft-spark</artifactId>
-    <version>0.3.0</version>
+    <version>0.4.0</version>
   </parent>
   <artifactId>microsoft-spark-2.4.x</artifactId>
   <inceptionYear>2019</inceptionYear>

src/scala/pom.xml

@@ -4,7 +4,7 @@
   <groupId>com.microsoft.scala</groupId>
   <artifactId>microsoft-spark</artifactId>
   <packaging>pom</packaging>
-  <version>0.3.0</version>
+  <version>0.4.0</version>
   <properties>
     <encoding>UTF-8</encoding>
   </properties>