Tokenization

I. Tokenize Function

A tokenize function breaks a string up into separated by any of the characters in the specified string of delimiters. The Java class StringTokenizer( ) serves perfectly for this need.