NLP Flow

NLP Flow complements the standard Apache NiFi cross-platform data flow application with custom processors for creating powerful natural language processing pipelines.

With NLP Flow you can create pipelines to process unstructured natural language text. These pipelines can facilitate the ingestion and processing and text. For instance, text can be ingested from a file system, processed through entity extraction, and the resulting entities can be persisted to a database for analysis. Getting started instructions are available in the Quick Start.

Download NLP Flow |  See an example NLP Flow pipeline

Highlights of NLP Flow

  • Built on the proven and trusted Apache NiFi data flow platform.
  • Provides custom processors for interacting with our NLP Building Blocks.
  • Free download and free to use! Use of external or third party services in conjunction with NLP Flow may require separate licensing or usage charges for those services.

NLP Flow Apache NiFi Processors

NLP Flow contains several custom processors for creating NLP pipelines. The processors are described below.

NLP Building Blocks Processors

ProcessorDescriptionAdded in Version
RenkuLanguageDetectionEngineProvides language detection capabilities via Renku Language Detection Engine.1.0.0
ProseSentenceExtractionEngineProvides sentence extraction capabilities via Prose Sentence Extraction Engine.1.0.0
SonnetTokenizationEngineProvides string tokenization capabilities via Sonnet Tokenization Engine.1.0.0
IdylE3EntityExtractionEngineProvides named-entity extraction capabilities via Idyl E3 Entity Extraction Engine.1.0.0

Entity Store and Persistence Processors

ProcessorDescriptionAdded in Version
RyaIngestProvides entity storage into Apache Rya.1.2.0
AllegroGraphIngestProvides entity storage into AllegroGraph.1.3.0
AmazonNeptuneIngestProvides entity storage into Amazon Neptune.1.3.0

Entity Filtering and Querying Processors

ProcessorDescriptionAdded in Version
EntityQueryLanguageProvides entity filtering via EQL (Entity Query Language).1.0.0

Entity Transformation and Utility Processors

ProcessorDescriptionAdded in Version
ConvertEntityResponseToNQuadsConverts an Idyl E3 entity extraction response into N-quads for ingestion into a triple store.1.3.0

Apache, NiFi, Apache NiFi and the project logo are trademarks of The Apache Software Foundation.