Skip to content

Commit

Permalink
Clarified docs about Scala version
Browse files Browse the repository at this point in the history
  • Loading branch information
rjrudin committed Nov 8, 2024
1 parent 1fcec39 commit 0c3fc03
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 2 deletions.
3 changes: 2 additions & 1 deletion docs/getting-started/pyspark.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,8 @@ obtaining the connector and deploying an example application to MarkLogic.
The [PySpark installation guide](https://spark.apache.org/docs/latest/api/python/getting_started/install.html) describes
how to install PySpark. As noted in that guide, you will need to install Python 3 first if you do not already have it
installed. [pyenv](https://github.com/pyenv/pyenv#installation) is a popular choice for doing so, as it simplifies
installing and switching between multiple versions of Python.
installing and switching between multiple versions of Python. Additionally, be sure to select a PySpark installation
that depends on Scala 2.12 and not Scala 2.13.

Once you have installed PySpark, run the following from a command line to ensure PySpark is installed correctly:

Expand Down
3 changes: 2 additions & 1 deletion docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,8 @@ from any data source that Spark supports and then writing it to MarkLogic.

The connector has the following system requirements:

* Apache Spark 3.3.0 or higher. The connector has been tested with the latest versions of Spark 3.3.x of 3.4.x.
* Apache Spark 3.5.3 is recommended, but earlier versions of Spark 3.4.x and 3.3.x should work as well. When choosing
[a Spark distribution](https://spark.apache.org/downloads.html), you must select a distribution that uses Scala 2.12 and not Scala 2.13.
* For writing data, MarkLogic 9.0-9 or higher.
* For reading data, MarkLogic 10.0-9 or higher.

Expand Down

0 comments on commit 0c3fc03

Please sign in to comment.