public class StripToken
extends java.lang.Object
History:
StrTokenObject
,
Design documentConstructor and Description |
---|
StripToken() |
Modifier and Type | Method and Description |
---|---|
static java.util.Vector<StrTokenObject> |
CleanUpEnd(java.util.Vector<StrTokenObject> list)
Remove the end elements of a tokenized collection of StrTokenObject if
it is a character in the bad end list string defined in StrTokenObject.
|
static java.util.Vector<StrTokenObject> |
CleanUpEnd(java.util.Vector<StrTokenObject> list,
java.lang.String badEndList)
Remove the end elements of a tokenized collection of StrTokenObject if
it is a character in the bad end list string.
|
static java.util.Vector<StrTokenObject> |
CleanUpToken(java.util.Vector<StrTokenObject> list)
Clean up elements in the tokenized Vector.
|
static java.util.Vector<StrTokenObject> |
CleanUpToken(java.util.Vector<StrTokenObject> list,
java.lang.String confList)
Clean up elements in the tokenized Vector.
|
static java.lang.String |
ComposeString(java.util.Vector<StrTokenObject> list)
Compose a string from a list of tokenized StrTokenObjects.
|
static void |
main(java.lang.String[] args)
Test driver for this class
|
static java.util.Vector<StrTokenObject> |
Tokenize(java.lang.String inStr)
Tokenize a string and assigned token type to each token.
|
static java.util.Vector<StrTokenObject> |
Tokenize(java.lang.String inStr,
java.lang.String restoreD,
java.lang.String strippingD,
java.lang.String strippableD)
Tokenize a string and assigned token type to each token.
|
static java.util.Vector<StrTokenObject> |
Tokenize(java.lang.String inStr,
java.lang.String restoreD,
java.lang.String strippingD,
java.lang.String strippableD,
java.lang.String spaceD)
Tokenize a string and assigned token type to each token.
|
public static java.util.Vector<StrTokenObject> Tokenize(java.lang.String inStr)
inStr
- a String to be tokenizedpublic static java.util.Vector<StrTokenObject> Tokenize(java.lang.String inStr, java.lang.String restoreD, java.lang.String strippingD, java.lang.String strippableD, java.lang.String spaceD)
inStr
- a String to be tokenizedrestoreD
- a String contains delimiters that will be restored
after tokenizedstrippingD
- a String contains delimiters that it's previous
token will be stripped out if they are in conflict list or their
type are stripped.strippableD
- a String contains delimiters that will be restored
if it's previous token is not stripped out.spaceD
- a String contains space delimiters.public static java.util.Vector<StrTokenObject> Tokenize(java.lang.String inStr, java.lang.String restoreD, java.lang.String strippingD, java.lang.String strippableD)
inStr
- a String to be tokenizedrestoreD
- a String contains delimiters that will be restored
after tokenizedstrippingD
- a String contains delimiters that it's previous
token will be stripped out if they are in conflict list or their
type are stripped.strippableD
- a String contains delimiters that will be restored
if it's previous token is not stripped out.public static java.util.Vector<StrTokenObject> CleanUpToken(java.util.Vector<StrTokenObject> list)
list
- a tokenized vector.StrTokenObject
public static java.util.Vector<StrTokenObject> CleanUpToken(java.util.Vector<StrTokenObject> list, java.lang.String confList)
list
- a tokenized vector.confList
- a string contians all conflict characters.
A conflict character is a character need to be stripped if
the following token is stripping type.public static java.util.Vector<StrTokenObject> CleanUpEnd(java.util.Vector<StrTokenObject> list)
list
- a vector of tokenized StrTokenObjects that will be removed
end element (character) if it is in a badEndList.StrTokenObject
public static java.util.Vector<StrTokenObject> CleanUpEnd(java.util.Vector<StrTokenObject> list, java.lang.String badEndList)
list
- a vector of tokenized StrTokenObjects that will be removed
end element (character) if it is in a badEndList.badEndList
- a String that contains all bad end characters.
The default value for badEndList is " -,:;".public static java.lang.String ComposeString(java.util.Vector<StrTokenObject> list)
list
- a collection of StrTokenObjectpublic static void main(java.lang.String[] args)
args
- arguments