|
19 | 19 |
|
20 | 20 | Spark NLP is a state-of-the-art Natural Language Processing library built on top of Apache Spark. It provides **simple**, **performant** & **accurate** NLP annotations for machine learning pipelines that **scale** easily in a distributed environment.
|
21 | 21 |
|
22 |
| -Spark NLP comes with **83000+** pretrained **pipelines** and **models** in more than **200+** languages. |
| 22 | +Spark NLP comes with **100000+** pretrained **pipelines** and **models** in more than **200+** languages. |
23 | 23 | It also offers tasks such as **Tokenization**, **Word Segmentation**, **Part-of-Speech Tagging**, Word and Sentence **Embeddings**, **Named Entity Recognition**, **Dependency Parsing**, **Spell Checking**, **Text Classification**, **Sentiment Analysis**, **Token Classification**, **Machine Translation** (+180 languages), **Summarization**, **Question Answering**, **Table Question Answering**, **Text Generation**, **Image Classification**, **Image to Text (captioning)**, **Automatic Speech Recognition**, **Zero-Shot Learning**, and many more [NLP tasks](#features).
|
24 | 24 |
|
25 | 25 | **Spark NLP** is the only open-source NLP library in **production** that offers state-of-the-art transformers such as **BERT**, **CamemBERT**, **ALBERT**, **ELECTRA**, **XLNet**, **DistilBERT**, **RoBERTa**, **DeBERTa**, **XLM-RoBERTa**, **Longformer**, **ELMO**, **Universal Sentence Encoder**, **Llama-2**, **M2M100**, **BART**, **Instructor**, **E5**, **Google T5**, **MarianMT**, **OpenAI GPT2**, **Vision Transformers (ViT)**, **OpenAI Whisper**, **Llama**, **Mistral**, **Phi**, **Qwen2**, and many more not only to **Python** and **R**, but also to **JVM** ecosystem (**Java**, **Scala**, and **Kotlin**) at **scale** by extending **Apache Spark** natively.
|
@@ -133,7 +133,7 @@ Spark NLP *6.1.0* has been built on top of Apache Spark 3.4 while fully supports
|
133 | 133 |
|
134 | 134 | | Spark NLP | Apache Spark 3.5.x | Apache Spark 3.4.x | Apache Spark 3.3.x | Apache Spark 3.2.x | Apache Spark 3.1.x | Apache Spark 3.0.x | Apache Spark 2.4.x | Apache Spark 2.3.x |
|
135 | 135 | |-----------|--------------------|--------------------|--------------------|--------------------|--------------------|--------------------|--------------------|--------------------|
|
136 |
| -| 6.0.x | YES | YES | YES | YES | YES | YES | NO | NO | |
| 136 | +| 6.x.x and up | YES | YES | YES | YES | YES | YES | NO | NO | |
137 | 137 | | 5.5.x | YES | YES | YES | YES | YES | YES | NO | NO |
|
138 | 138 | | 5.4.x | YES | YES | YES | YES | YES | YES | NO | NO |
|
139 | 139 | | 5.3.x | YES | YES | YES | YES | YES | YES | NO | NO |
|
@@ -167,10 +167,11 @@ Spark NLP 6.1.0 has been tested and is compatible with the following runtimes:
|
167 | 167 | | 14.2 / 14.2 ML | 14.2 ML & GPU |
|
168 | 168 | | 14.3 / 14.3 ML | 14.3 ML & GPU |
|
169 | 169 | | 15.0 / 15.0 ML | 15.0 ML & GPU |
|
170 |
| -| 15.1 / 15.0 ML | 15.1 ML & GPU | |
171 |
| -| 15.2 / 15.0 ML | 15.2 ML & GPU | |
172 |
| -| 15.3 / 15.0 ML | 15.3 ML & GPU | |
173 |
| -| 15.4 / 15.0 ML | 15.4 ML & GPU | |
| 170 | +| 15.1 / 15.1 ML | 15.1 ML & GPU | |
| 171 | +| 15.2 / 15.2 ML | 15.2 ML & GPU | |
| 172 | +| 15.3 / 15.3 ML | 15.3 ML & GPU | |
| 173 | +| 15.4 / 15.4 ML | 15.4 ML & GPU | |
| 174 | +| 16.4 / 16.4 ML | 16.4 ML & GPU | |
174 | 175 |
|
175 | 176 | We are compatible with older runtimes. For a full list check databricks support in our official [documentation](https://sparknlp.org/docs/en/install#databricks-support)
|
176 | 177 |
|
|
0 commit comments