Spark nlp on Databricks - looking for known issues/best practices

trkrishnan
New Contributor III

I m currently looking for information on whether Spark NLP can run fine on Databricks platform.

Can someone please share 

- known issues/bugs encountered

- any fixes or config settings required in environment

- best practices to follow

Hubert-Dudek
Databricks MVP

Yes it is working. On cluster tab please go to libraries and install new:

pypl -> spark-nlp

maven -> com.johnsnowlabs.nlp:spark-nlp_2.11

More details about spark-nlp can be watched on that video from data+AI summit organized by databricks

https://databricks.com/session_na21/advanced-natural-language-processing-with-apache-spark-nlp


My blog: https://databrickster.medium.com/

View solution in original post

trkrishnan
New Contributor III

Thanks a lot for the quick response