Quotas and limits in Yandex Foundation Models
Written by
Updated at June 20, 2024
Yandex Foundation Models is at the Preview stage.
YandexGPT API has the following limits:
- Quotas are organizational restrictions that can be changed by technical support on request.
- Limits are technical limitations due to Yandex Cloud architectural features. The limits cannot be changed.
If you need more resources, contact support
Quotas
Text vectorization
Type of limit | Value |
---|---|
Number of text vectorization requests per second | 10 |
Text generation
Type of limit | YandexGPT Pro and fine-tuned models | YandexGPT Lite |
---|---|---|
Number of concurrent generations | 1 | 1 |
Number of requests per second, asynchronous mode (request) | 10 | 10 |
Number of requests per second, asynchronous mode (getting a response) | 50 | 50 |
Number of requests per hour, asynchronous mode (request) | 5,000 | 5,000 |
Number of tokenization requests per second | 50 | 50 |
Number of free requests per hour for users without a billing account. Available only in the management console | 10 | 10 |
Text classification
Type of limit | Value |
---|---|
Number of text classification requests per second | 1 |
Image generation
Type of limit | Value |
---|---|
Number of generation requests per minute | 10 |
Number of generation requests per day | 500 |
Number of result requests per second | 50 |
Limits
Text vectorization
Type of limit | Value |
---|---|
Number of input tokens | 2,000 |
Output vector size | 256 |
Text generation
Type of limit | YandexGPT Pro and fine-tuned models | YandexGPT Lite |
---|---|---|
Number of tokens per response | 2,000 | 2,000 |
Maximum number of token per response in the management console | 500 | 500 |
Total number of tokens | 8000 | 8000 |
Image generation
Type of limit | Value |
---|---|
Maximum prompt length | 500 characters |
Number of free requests per minute for users without a billing account. Available only in the management console | 2 |
Number of free requests per day for users without a billing account. Available only in the management console | 10 |