Share via


KeywordTokenizer Class

Definition

Emits the entire input as a single token. This tokenizer is implemented using Apache Lucene.

public class KeywordTokenizer : Azure.Search.Documents.Indexes.Models.LexicalTokenizer, System.ClientModel.Primitives.IJsonModel<Azure.Search.Documents.Indexes.Models.KeywordTokenizer>, System.ClientModel.Primitives.IPersistableModel<Azure.Search.Documents.Indexes.Models.KeywordTokenizer>
type KeywordTokenizer = class
    inherit LexicalTokenizer
    interface IJsonModel<KeywordTokenizer>
    interface IPersistableModel<KeywordTokenizer>
Public Class KeywordTokenizer
Inherits LexicalTokenizer
Implements IJsonModel(Of KeywordTokenizer), IPersistableModel(Of KeywordTokenizer)
Inheritance
KeywordTokenizer
Implements

Constructors

KeywordTokenizer(String)

Initializes a new instance of KeywordTokenizer.

Properties

BufferSize

The read buffer size in bytes. Default is 256. Setting this property on new instances of KeywordTokenizer may result in an error when sending new requests to the Azure Cognitive Search service.

MaxTokenLength

The maximum token length. Default is 256. Tokens longer than the maximum length are split. The maximum token length that can be used is 300 characters.

Name

The name of the tokenizer. It must only contain letters, digits, spaces, dashes or underscores, can only start and end with alphanumeric characters, and is limited to 128 characters.

(Inherited from LexicalTokenizer)

Methods

JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions)

Explicit Interface Implementations

IJsonModel<KeywordTokenizer>.Create(Utf8JsonReader, ModelReaderWriterOptions)

Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model.

IJsonModel<KeywordTokenizer>.Write(Utf8JsonWriter, ModelReaderWriterOptions)

Writes the model to the provided Utf8JsonWriter.

IJsonModel<LexicalTokenizer>.Create(Utf8JsonReader, ModelReaderWriterOptions)

Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model.

(Inherited from LexicalTokenizer)
IJsonModel<LexicalTokenizer>.Write(Utf8JsonWriter, ModelReaderWriterOptions)

Writes the model to the provided Utf8JsonWriter.

(Inherited from LexicalTokenizer)
IPersistableModel<KeywordTokenizer>.Create(BinaryData, ModelReaderWriterOptions)

Converts the provided BinaryData into a model.

IPersistableModel<KeywordTokenizer>.GetFormatFromOptions(ModelReaderWriterOptions)

Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service.

IPersistableModel<KeywordTokenizer>.Write(ModelReaderWriterOptions)

Writes the model into a BinaryData.

IPersistableModel<LexicalTokenizer>.Create(BinaryData, ModelReaderWriterOptions)

Converts the provided BinaryData into a model.

(Inherited from LexicalTokenizer)
IPersistableModel<LexicalTokenizer>.GetFormatFromOptions(ModelReaderWriterOptions)

Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service.

(Inherited from LexicalTokenizer)
IPersistableModel<LexicalTokenizer>.Write(ModelReaderWriterOptions)

Writes the model into a BinaryData.

(Inherited from LexicalTokenizer)

Applies to