LexicalTokenizer Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Base type for tokenizers. Please note LexicalTokenizer is the base class. According to the scenario, a derived class of the base class might need to be assigned here, or this property needs to be casted to one of the possible derived classes. The available derived classes include ClassicTokenizer, EdgeNGramTokenizer, KeywordTokenizer, MicrosoftLanguageStemmingTokenizer, MicrosoftLanguageTokenizer, NGramTokenizer, PathHierarchyTokenizer, PatternTokenizer, LuceneStandardTokenizer and UaxUrlEmailTokenizer.
public class LexicalTokenizerpublic class LexicalTokenizer : System.ClientModel.Primitives.IJsonModel<Azure.Search.Documents.Indexes.Models.LexicalTokenizer>, System.ClientModel.Primitives.IPersistableModel<Azure.Search.Documents.Indexes.Models.LexicalTokenizer>type LexicalTokenizer = classtype LexicalTokenizer = class
interface IJsonModel<LexicalTokenizer>
interface IPersistableModel<LexicalTokenizer>Public Class LexicalTokenizerPublic Class LexicalTokenizer
Implements IJsonModel(Of LexicalTokenizer), IPersistableModel(Of LexicalTokenizer)- Inheritance
-
LexicalTokenizer
- Derived
- Implements
Properties
| Name |
The name of the tokenizer. It must only contain letters, digits, spaces, dashes or underscores, can only start and end with alphanumeric characters, and is limited to 128 characters. |
Methods
| JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions) |
Explicit Interface Implementations
| IJsonModel<LexicalTokenizer>.Create(Utf8JsonReader, ModelReaderWriterOptions) |
Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model. |
| IJsonModel<LexicalTokenizer>.Write(Utf8JsonWriter, ModelReaderWriterOptions) |
Writes the model to the provided Utf8JsonWriter. |
| IPersistableModel<LexicalTokenizer>.Create(BinaryData, ModelReaderWriterOptions) |
Converts the provided BinaryData into a model. |
| IPersistableModel<LexicalTokenizer>.GetFormatFromOptions(ModelReaderWriterOptions) |
Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service. |
| IPersistableModel<LexicalTokenizer>.Write(ModelReaderWriterOptions) |
Writes the model into a BinaryData. |
