Class | Description |
---|---|
OffsetTokenizer |
Simple class to tokenize a string (similar to
java.util.StringTokenizer ), except
that this tokenizer returns
TokenAnnotation objects, which, in
addition to the token text string, also contain the start and end offsets of the token in the
original string. |
TokenAnnotation |
offset tokenizer functionality
Updated by JCasGen Tue Mar 25 16:39:54 EDT 2008
XML source: /OtherStuff/IBM/eclipse-apacheuima/conceptMapper/src/org/apache/uima/conceptMapper/support/tokenizer/TokenAnnotation.xml
|
TokenAnnotation_Type |
offset tokenizer functionality
Updated by JCasGen Tue Mar 25 16:39:54 EDT 2008
|
Copyright © 2006–2015 The Apache Software Foundation. All rights reserved.