Yandex Cloud
Search
Contact UsTry it for free
  • Customer Stories
  • Documentation
  • Blog
  • All Services
  • System Status
    • Featured
    • Infrastructure & Network
    • Data Platform
    • Containers
    • Developer tools
    • Serverless
    • Security
    • Monitoring & Resources
    • AI for business
    • Business tools
  • All Solutions
    • By industry
    • By use case
    • Economics and Pricing
    • Security
    • Technical Support
    • Start testing with double trial credits
    • Cloud credits to scale your IT product
    • Gateway to Russia
    • Cloud for Startups
    • Center for Technologies and Society
    • Yandex Cloud Partner program
    • Price calculator
    • Pricing plans
  • Customer Stories
  • Documentation
  • Blog
© 2025 Direct Cursus Technology L.L.C.
Yandex AI Studio
  • Getting started with Model Gallery
    • About Yandex AI Studio
    • Yandex Workflows
    • Quotas and limits
    • Terms and definitions
  • Switching from the AI Assistant API to Responses API
  • Compatibility with OpenAI
    • Overview
    • API authentication
        • Overview
          • Overview
          • Tokenize
          • TokenizeCompletion
  • Access management
  • Pricing policy
  • Audit Trails events
  • Public materials
  • Release notes
  1. API references
  2. Text Generation API
  3. gRPC
  4. Tokenizer
  5. Overview

Foundation Models Text Generation API, gRPC: TokenizerService

Written by
Yandex Cloud
Updated at October 17, 2024

Service for tokenizing input content.

MethodsMethods

Method

Description

Tokenize

RPC method for tokenizing text.

TokenizeCompletion

RPC method for tokenizing content of CompletionRequest

Was the article helpful?

Previous
Completion
Next
Tokenize
© 2025 Direct Cursus Technology L.L.C.