Foundation Models Text Generation API, gRPC: TokenizerService
Written by
Updated at April 11, 2024
Service for tokenizing input content.
Call | Description |
---|---|
Tokenize | RPC method for tokenizing text. |
TokenizeCompletion | RPC method for tokenizing content of CompletionRequest |
Calls TokenizerService
Tokenize
RPC method for tokenizing text.
rpc Tokenize (TokenizeRequest) returns (TokenizeResponse)
TokenizeRequest
Field | Description |
---|---|
model_uri | string The identifier of the model to be used for tokenization. |
text | string Text to be tokenized. |
TokenizeResponse
Field | Description |
---|---|
tokens[] | Token A list of tokens obtained from tokenization. |
model_version | string Model version (changes with model releases). |
TokenizeCompletion
RPC method for tokenizing content of CompletionRequest
rpc TokenizeCompletion (CompletionRequest) returns (TokenizeResponse)
CompletionRequest
Field | Description |
---|---|
model_uri | string The ID of the model to be used for completion generation. |
completion_options | CompletionOptions Configuration options for completion generation. |
messages[] | Message A list of messages representing the context for the completion model. |
TokenizeResponse
Field | Description |
---|---|
tokens[] | Token A list of tokens obtained from tokenization. |
model_version | string Model version (changes with model releases). |