SYNOPSIS # isa Plucene::Analysis::CharTokenizer DESCRIPTION A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens. METHODS