Fault-tolerant query execution in a Managed Service for Trino cluster

Managed Service for Trino clusters support the fault-tolerant execution mechanism. By default, when resources are insufficient or a query fails with an error, the worker will stop processing the query and you will need to run it again manually. With fault-tolerant execution enabled, the query or its component task will be retried in the event of failure.

To ensure fault-tolerant execution of queries, Exchange Manager regularly exports intermediate results to an Object Storage service bucket. If a query fails, the coordinator will assign the retry to another worker, which can use the previously processed data.

Fault-tolerant execution is only supported for the following connectors:

• Delta Lake
• Hive
• Iceberg
• Oracle Preview
• PostgreSQL
• MS SQL Server Preview

To enable fault-tolerant execution, select the Retry object type parameter under Retry policy when creating or updating a cluster:

• Task: Retries the intermediate task within the query that caused worker failure.

  Warning

  For high volumes of simple queries, retrying tasks may lead to longer delay in complex batch queries. We recommend creating a dedicated Managed Service for Trino cluster with task retry settings for complex batch queries.

• Query: Retries the entire query which caused worker failure.

For more information about fault-tolerant query execution, see the official documentation.