Package | Description |
---|---|
opennlp.tools.cmdline.tokenizer | |
opennlp.tools.formats.brat | |
opennlp.tools.tokenize |
Contains classes related to finding token or words in a string.
|
Modifier and Type | Method and Description |
---|---|
protected TokenizerModel |
TokenizerModelLoader.loadModel(InputStream modelIn) |
Constructor and Description |
---|
BratNameSampleStream(SentenceModel sentModel,
TokenizerModel tokenModel,
ObjectStream<BratDocument> samples)
Creates a new
BratNameSampleStream . |
BratNameSampleStream(SentenceModel sentModel,
TokenizerModel tokenModel,
ObjectStream<BratDocument> samples,
Set<String> nameTypes)
Creates a new
BratNameSampleStream . |
Modifier and Type | Method and Description |
---|---|
static TokenizerModel |
TokenizerME.train(ObjectStream<TokenSample> samples,
TokenizerFactory factory,
TrainingParameters mlParams)
Trains a model for the
TokenizerME . |
Constructor and Description |
---|
TokenizerME(TokenizerModel model) |
TokenizerME(TokenizerModel model,
Factory factory)
Deprecated.
use
TokenizerFactory to extend the Tokenizer
functionality |
Copyright © 2021 The Apache Software Foundation. All rights reserved.