John Snow Labs’ Spark NLP Library

A John Snow Labs’ Spark NLP Library is an NLP library for Apache Spark.

• Example(s):
  • Spark NLP 4.0.
  • …
• Counter-Example(s):
  • spaCy NLP System.
  • NLTK.
• See: AllenNLP, John Snow Legal NLP.

---

---

References

• https://nlp.johnsnowlabs.com/

2018

• https://www.oreilly.com/ideas/comparing-production-grade-nlp-libraries-training-spark-nlp-and-spacy-pipelines
  • QUOTE: ... Spark-NLP was open sourced in October 2017. It is a native extension of Apache Spark as a Spark library. It brings a suite of Spark ML Pipeline stages, in the shape of estimators and transformers, to process distributed data sets. Spark NLP Annotators go from fundamentals like tokenization, normalization, and part of speech tagging, to advanced sentiment analysis, spell checking, assertion status, and others. These are put to work within the Spark ML framework. The library is written in Scala, runs within the JVM, and takes advantage of Spark optimizations and execution planning. The library currently has API’s in Scala and in Python. …

---