Spark nlp on Databricks - looking for known issues/best practices

[trkrishnan]

I m currently looking for information on whether Spark NLP can run fine on Databricks platform.

Can someone please share 

- known issues/bugs encountered

- any fixes or config settings required in environment

- best practices to follow

[Hubert-Dudek · Accepted solution]

Yes it is working. On cluster tab please go to libraries and install new:

pypl -> spark-nlp

maven -> com.johnsnowlabs.nlp:spark-nlp_2.11

More details about spark-nlp can be watched on that video from data+AI summit organized by databricks

https://databricks.com/session_na21/advanced-natural-language-processing-with-apache-spark-nlp

[trkrishnan]

Thanks a lot for the quick response