Batch Inference Service API, gRPC: BatchInferenceService.List
Lists tasks in folder
gRPC request
rpc List (ListBatchInferencesRequest) returns (ListBatchInferencesResponse)
ListBatchInferencesRequest
{
"folder_id": "string",
"page_size": "int64",
"page_token": "string",
"status": "Status"
}
Field |
Description |
folder_id |
string Required field. Folder ID for which the list of tasks will be provided. |
page_size |
int64 |
page_token |
string |
status |
enum Status Batch inference status for filtering
|
ListBatchInferencesResponse
{
"tasks": [
{
"task_id": "string",
"operation_id": "string",
"folder_id": "string",
"model_uri": "string",
"source_dataset_id": "string",
// Includes only one of the fields `completion_request`
"completion_request": {
"model_uri": "string",
"source_dataset_id": "string",
"completion_options": {
"temperature": "google.protobuf.DoubleValue",
"max_tokens": "google.protobuf.Int64Value",
"reasoning_options": {
"mode": "ReasoningMode"
}
},
"data_logging_enabled": "bool",
// Includes only one of the fields `json_object`, `json_schema`
"json_object": "bool",
"json_schema": {
"schema": "google.protobuf.Struct"
}
// end of the list of possible fields
},
// end of the list of possible fields
"status": "Status",
"result_dataset_id": "string",
"labels": "map<string, string>",
"created_by": "string",
"created_at": "google.protobuf.Timestamp",
"started_at": "google.protobuf.Timestamp",
"finished_at": "google.protobuf.Timestamp"
}
],
"next_page_token": "string"
}
Field |
Description |
tasks[] |
|
next_page_token |
string |
BatchInferenceTask
Field |
Description |
task_id |
string |
operation_id |
string |
folder_id |
string |
model_uri |
string |
source_dataset_id |
string |
completion_request |
Includes only one of the fields |
status |
enum Status
|
result_dataset_id |
string |
labels |
object (map<string, string>) |
created_by |
string |
created_at |
|
started_at |
|
finished_at |
BatchCompletionRequest
Field |
Description |
model_uri |
string Required field. |
source_dataset_id |
string Required field. |
completion_options |
|
data_logging_enabled |
bool |
json_object |
bool Includes only one of the fields Unsupported |
json_schema |
Includes only one of the fields Unsupported |
CompletionOptions
Field |
Description |
temperature |
|
max_tokens |
|
reasoning_options |
ReasoningOptions
Field |
Description |
mode |
enum ReasoningMode
|
JsonSchema
Field |
Description |
schema |