SYNOPSIS

# isa Plucene::Analysis::Analyzer
my Plucene::Analysis::WhitespaceTokenizer $wt
= Plucene::Analysis::WhitespaceAnalyzer->new(@args);

DESCRIPTION

This is an Analyzer that uses WhitespaceTokenizer.

METHODS

tokenstream

        my Plucene::Analysis::WhitespaceTokenizer $wt 
                = Plucene::Analysis::WhitespaceAnalyzer->new(@args);

Creates a TokenStream which tokenizes all the text in the provided Reader.