Class ClassicFilter

  • All Implemented Interfaces:
    java.io.Closeable, java.lang.AutoCloseable

    public class ClassicFilter
    extends TokenFilter
    Normalizes tokens extracted with ClassicTokenizer.
    • Field Detail

      • APOSTROPHE_TYPE

        private static final java.lang.String APOSTROPHE_TYPE
      • ACRONYM_TYPE

        private static final java.lang.String ACRONYM_TYPE
    • Constructor Detail

      • ClassicFilter

        public ClassicFilter​(TokenStream in)
        Construct filtering in.
    • Method Detail

      • incrementToken

        public final boolean incrementToken()
                                     throws java.io.IOException
        Returns the next token in the stream, or null at EOS.

        Removes 's from the end of words.

        Removes dots from acronyms.

        Specified by:
        incrementToken in class TokenStream
        Returns:
        false for end of stream; true otherwise
        Throws:
        java.io.IOException