StringTokenizer - CodeProject
Why do you need to write a Tokenizer class at all? The Java tokenizer takes a list of characters to split on, the resulting token list is the fields between these characters. All you get is a way of enumerating through this list and getting at the tokens....