gov.nih.nlm.nls.tc.FilterApi
Class SentenceTokenizer

java.lang.Object
  gov.nih.nlm.nls.tc.FilterApi.SentenceTokenizer

public class SentenceTokenizer
extends java.lang.Object

This class provides methods to tokenize sentence. A sentence is determined by the end of sentence word, which is defined as:

• Last word of the entire input text
• Ends with exclamation mark and next word starts with a Capita char.
• Ends with question mark and next word starts with a Capita char.
• Ends with period and next word starts with a Capita char.
  • Ends with ".." must be end of a sentence
  • Not an abbreviation (multiple '.')
  • Not in exception list (such as title, states, units, time, etc..)

History:

Version:

V-2011

Author:

NLM Lexical Systems Group

See Also:

Design Document

Constructor Summary

SentenceTokenizer()

Method Summary

static void	main(java.lang.String[] args)
static java.util.Vector<java.lang.String>	ToSentences(java.lang.String inStr)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SentenceTokenizer

public SentenceTokenizer()

Method Detail

ToSentences

public static java.util.Vector<java.lang.String> ToSentences(java.lang.String inStr)

main

public static void main(java.lang.String[] args)