Plucene::Analysis::WhitespaceTokenizer(3) white space tokenizer

SYNOPSIS


# isa Plucene::Analysis::CharTokenizer

DESCRIPTION

A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens.

METHODS