diff --git a/.github/workflows/scala.yml b/.github/workflows/scala.yml index de443cb..0e6f41a 100644 --- a/.github/workflows/scala.yml +++ b/.github/workflows/scala.yml @@ -13,7 +13,7 @@ jobs: strategy: matrix: os: [ubuntu-latest, macOS-latest] - profile: ['spark34'] + profile: ['spark35'] timeout-minutes: 15 steps: diff --git a/README.md b/README.md index 762b7e3..502607b 100644 --- a/README.md +++ b/README.md @@ -9,7 +9,7 @@ This library contains the source code for the Apache Spark Connector for SQL Ser [Apache Spark](https://spark.apache.org/) is a unified analytics engine for large-scale data processing. -There are three version sets of the connector available through Maven, a 2.4.x, a 3.0.x and a 3.1.x compatible version. All versions can be found [here](https://search.maven.org/search?q=spark-mssql-connector) and can be imported using the coordinates below: +All available versions can be found [here](https://search.maven.org/search?q=spark-mssql-connector) and can be imported using the coordinates below: | Connector | Maven Coordinate | Scala Version | |----------------------------------|--------------------------------------------------------|---------------| @@ -18,6 +18,7 @@ There are three version sets of the connector available through Maven, a 2.4.x, | Spark 3.1.x compatible connector | `com.microsoft.azure:spark-mssql-connector_2.12:1.2.0` | 2.12 | | Spark 3.3.x compatible connector | `com.microsoft.azure:spark-mssql-connector_2.12:1.3.0` | 2.12 | | Spark 3.4.x compatible connector | `com.microsoft.azure:spark-mssql-connector_2.12:1.4.0` | 2.12 | +| Spark 3.5.x compatible connector | `com.microsoft.azure:spark-mssql-connector_2.12:1.5.0` | 2.12 | ## Current Releases @@ -27,6 +28,8 @@ The latest Spark 3.0.x compatible connector is on v1.1.0. The latest Spark 3.1.x compatible connector is on v1.2.0. +The latest Spark 3.5.x compatible connector is on v1.5.0. + For main changes from previous releases and known issues please refer to [CHANGELIST](docs/CHANGELIST.md) ## Supported Features @@ -37,13 +40,13 @@ For main changes from previous releases and known issues please refer to [CHANGE * Reliable connector support for Sql Server Single Instance -| Component | Versions Supported | -|--------------------------------------|----------------------------| -| Apache Spark | 2.4.x, 3.0.x, 3.1.x, 3.3.x | -| Scala | 2.11, 2.12 | -| Microsoft JDBC Driver for SQL Server | 8.4.1 | -| Microsoft SQL Server | SQL Server 2008 or later | -| Azure SQL Databases | Supported | +| Component | Versions Supported | +|--------------------------------------|------------------------------------------| +| Apache Spark | 2.4.x, 3.0.x, 3.1.x, 3.3.x, 3.4.x, 3.5.x | +| Scala | 2.11, 2.12 | +| Microsoft JDBC Driver for SQL Server | 8.4.1 | +| Microsoft SQL Server | SQL Server 2008 or later | +| Azure SQL Databases | Supported | *Note: Azure Synapse (Azure SQL DW) use is not tested with this connector. While it may work, there may be unintended consequences.* diff --git a/pom.xml b/pom.xml index 780bd73..ee68997 100644 --- a/pom.xml +++ b/pom.xml @@ -2,9 +2,9 @@ 4.0.0 com.microsoft.azure - spark-mssql-connector + spark-mssql-connector_${scala.binary.version} jar - 1.4.0 + 1.5.0 ${project.groupId}:${project.artifactId} The Apache Spark Connector for SQL Server and Azure SQL is a high-performance connector that enables you to use transactional data in big data analytics and persists results for ad-hoc queries or reporting. https://github.com/microsoft/sql-spark-connector @@ -201,14 +201,14 @@ - spark34 + spark35 true 2.12 2.12.11 - 3.4.0 + 3.5.1 diff --git a/test/scala_test/pom.xml b/test/scala_test/pom.xml index 5382818..7c351fb 100644 --- a/test/scala_test/pom.xml +++ b/test/scala_test/pom.xml @@ -123,14 +123,14 @@ - spark34 + spark35 true 2.12 2.12.11 - 3.4.0 + 3.5.1