PatternTokenizer Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Tokenizer that uses regex pattern matching to construct distinct tokens. This tokenizer is implemented using Apache Lucene.
public class PatternTokenizer : Azure.Search.Documents.Indexes.Models.LexicalTokenizerpublic class PatternTokenizer : Azure.Search.Documents.Indexes.Models.LexicalTokenizer, System.ClientModel.Primitives.IJsonModel<Azure.Search.Documents.Indexes.Models.PatternTokenizer>, System.ClientModel.Primitives.IPersistableModel<Azure.Search.Documents.Indexes.Models.PatternTokenizer>type PatternTokenizer = class
inherit LexicalTokenizertype PatternTokenizer = class
inherit LexicalTokenizer
interface IJsonModel<PatternTokenizer>
interface IPersistableModel<PatternTokenizer>Public Class PatternTokenizer
Inherits LexicalTokenizerPublic Class PatternTokenizer
Inherits LexicalTokenizer
Implements IJsonModel(Of PatternTokenizer), IPersistableModel(Of PatternTokenizer)- Inheritance
- Implements
Constructors
| PatternTokenizer(String) |
Initializes a new instance of PatternTokenizer. |
Properties
| Flags |
Regular expression flags for Pattern. |
| Group |
The zero-based ordinal of the matching group in the regular expression pattern to extract into tokens. Use -1 if you want to use the entire pattern to split the input into tokens, irrespective of matching groups. Default is -1. |
| Name |
The name of the tokenizer. It must only contain letters, digits, spaces, dashes or underscores, can only start and end with alphanumeric characters, and is limited to 128 characters. (Inherited from LexicalTokenizer) |
| Pattern |
A regular expression pattern to match token separators. Default is an expression that matches one or more non-word characters. |
Methods
| JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions) |
