Managed Service for Greenplum® API, gRPC: ClusterService.Expand
- gRPC request
- ExpandRequest
- operation.Operation
- AddClusterHostsMetadata
- Cluster
- GreenplumConfig
- Access
- Monitoring
- MasterSubclusterConfig
- Resources
- SegmentSubclusterConfig
- MaintenanceWindow
- AnytimeMaintenanceWindow
- WeeklyMaintenanceWindow
- MaintenanceOperation
- ClusterConfigSet
- GreenplumConfigSet6_22
- GreenplumConfig6_22
- GreenplumConfigSet6
- GreenplumConfig6
- ConnectionPoolerConfigSet
- ConnectionPoolerConfig
- BackgroundActivitiesConfig
- TableSizes
- BackgroundActivityStartAt
- AnalyzeAndVacuum
- QueryKillerScripts
- QueryKiller
- PXFConfigSet
- PXFConfig
- CloudStorage
- LoggingConfig
Expands the specified Greenplum® cluster.
gRPC request
rpc Expand (ExpandRequest) returns (operation.Operation)
ExpandRequest
{
"cluster_id": "string",
"segment_host_count": "int64",
"add_segments_per_host_count": "int64",
"duration": "int64",
"parallel": "int64",
"close_cluster": "bool",
"delay_redistribution": "bool"
}
|
Field |
Description |
|
cluster_id |
string Required field. ID of the Greenplum Cluster resource to update. |
|
segment_host_count |
int64 Number of hosts for add to the segment subcluster |
|
add_segments_per_host_count |
int64 Number of segments per host to add |
|
duration |
int64 Redistribute duration, in seconds |
|
parallel |
int64 Redistribute process parallelism, 0 - for automatic detection |
|
close_cluster |
bool Deny all client connections during the expand operation |
|
delay_redistribution |
bool Perform redistribution process by small chunks as background activity |
operation.Operation
{
"id": "string",
"description": "string",
"created_at": "google.protobuf.Timestamp",
"created_by": "string",
"modified_at": "google.protobuf.Timestamp",
"done": "bool",
"metadata": {
"cluster_id": "string"
},
// Includes only one of the fields `error`, `response`
"error": "google.rpc.Status",
"response": {
"id": "string",
"folder_id": "string",
"created_at": "google.protobuf.Timestamp",
"name": "string",
"config": {
"version": "string",
"backup_window_start": "google.type.TimeOfDay",
"backup_retain_period_days": "google.protobuf.Int64Value",
"access": {
"data_lens": "bool",
"web_sql": "bool",
"data_transfer": "bool",
"yandex_query": "bool"
},
"zone_id": "string",
"subnet_id": "string",
"assign_public_ip": "bool"
},
"description": "string",
"labels": "map<string, string>",
"environment": "Environment",
"monitoring": [
{
"name": "string",
"description": "string",
"link": "string"
}
],
"master_config": {
"resources": {
"resource_preset_id": "string",
"disk_size": "int64",
"disk_type_id": "string"
}
},
"segment_config": {
"resources": {
"resource_preset_id": "string",
"disk_size": "int64",
"disk_type_id": "string"
}
},
"master_host_count": "int64",
"segment_host_count": "int64",
"segment_in_host": "int64",
"network_id": "string",
"health": "Health",
"status": "Status",
"maintenance_window": {
// Includes only one of the fields `anytime`, `weekly_maintenance_window`
"anytime": "AnytimeMaintenanceWindow",
"weekly_maintenance_window": {
"day": "WeekDay",
"hour": "int64"
}
// end of the list of possible fields
},
"planned_operation": {
"info": "string",
"delayed_until": "google.protobuf.Timestamp"
},
"security_group_ids": [
"string"
],
"user_name": "string",
"deletion_protection": "bool",
"host_group_ids": [
"string"
],
"cluster_config": {
// Includes only one of the fields `greenplum_config_set_6_22`, `greenplum_config_set_6`
"greenplum_config_set_6_22": {
"effective_config": {
"max_connections": "google.protobuf.Int64Value",
"max_slot_wal_keep_size": "google.protobuf.Int64Value",
"gp_workfile_limit_per_segment": "google.protobuf.Int64Value",
"gp_workfile_limit_per_query": "google.protobuf.Int64Value",
"gp_workfile_limit_files_per_query": "google.protobuf.Int64Value",
"max_prepared_transactions": "google.protobuf.Int64Value",
"gp_workfile_compression": "google.protobuf.BoolValue",
"max_statement_mem": "google.protobuf.Int64Value",
"log_statement": "LogStatement",
"gp_add_column_inherits_table_setting": "google.protobuf.BoolValue"
},
"user_config": {
"max_connections": "google.protobuf.Int64Value",
"max_slot_wal_keep_size": "google.protobuf.Int64Value",
"gp_workfile_limit_per_segment": "google.protobuf.Int64Value",
"gp_workfile_limit_per_query": "google.protobuf.Int64Value",
"gp_workfile_limit_files_per_query": "google.protobuf.Int64Value",
"max_prepared_transactions": "google.protobuf.Int64Value",
"gp_workfile_compression": "google.protobuf.BoolValue",
"max_statement_mem": "google.protobuf.Int64Value",
"log_statement": "LogStatement",
"gp_add_column_inherits_table_setting": "google.protobuf.BoolValue"
},
"default_config": {
"max_connections": "google.protobuf.Int64Value",
"max_slot_wal_keep_size": "google.protobuf.Int64Value",
"gp_workfile_limit_per_segment": "google.protobuf.Int64Value",
"gp_workfile_limit_per_query": "google.protobuf.Int64Value",
"gp_workfile_limit_files_per_query": "google.protobuf.Int64Value",
"max_prepared_transactions": "google.protobuf.Int64Value",
"gp_workfile_compression": "google.protobuf.BoolValue",
"max_statement_mem": "google.protobuf.Int64Value",
"log_statement": "LogStatement",
"gp_add_column_inherits_table_setting": "google.protobuf.BoolValue"
}
},
"greenplum_config_set_6": {
"effective_config": {
"max_connections": "google.protobuf.Int64Value",
"max_slot_wal_keep_size": "google.protobuf.Int64Value",
"gp_workfile_limit_per_segment": "google.protobuf.Int64Value",
"gp_workfile_limit_per_query": "google.protobuf.Int64Value",
"gp_workfile_limit_files_per_query": "google.protobuf.Int64Value",
"max_prepared_transactions": "google.protobuf.Int64Value",
"gp_workfile_compression": "google.protobuf.BoolValue",
"max_statement_mem": "google.protobuf.Int64Value",
"log_statement": "LogStatement",
"gp_add_column_inherits_table_setting": "google.protobuf.BoolValue",
"gp_enable_global_deadlock_detector": "google.protobuf.BoolValue",
"gp_global_deadlock_detector_period": "google.protobuf.Int64Value"
},
"user_config": {
"max_connections": "google.protobuf.Int64Value",
"max_slot_wal_keep_size": "google.protobuf.Int64Value",
"gp_workfile_limit_per_segment": "google.protobuf.Int64Value",
"gp_workfile_limit_per_query": "google.protobuf.Int64Value",
"gp_workfile_limit_files_per_query": "google.protobuf.Int64Value",
"max_prepared_transactions": "google.protobuf.Int64Value",
"gp_workfile_compression": "google.protobuf.BoolValue",
"max_statement_mem": "google.protobuf.Int64Value",
"log_statement": "LogStatement",
"gp_add_column_inherits_table_setting": "google.protobuf.BoolValue",
"gp_enable_global_deadlock_detector": "google.protobuf.BoolValue",
"gp_global_deadlock_detector_period": "google.protobuf.Int64Value"
},
"default_config": {
"max_connections": "google.protobuf.Int64Value",
"max_slot_wal_keep_size": "google.protobuf.Int64Value",
"gp_workfile_limit_per_segment": "google.protobuf.Int64Value",
"gp_workfile_limit_per_query": "google.protobuf.Int64Value",
"gp_workfile_limit_files_per_query": "google.protobuf.Int64Value",
"max_prepared_transactions": "google.protobuf.Int64Value",
"gp_workfile_compression": "google.protobuf.BoolValue",
"max_statement_mem": "google.protobuf.Int64Value",
"log_statement": "LogStatement",
"gp_add_column_inherits_table_setting": "google.protobuf.BoolValue",
"gp_enable_global_deadlock_detector": "google.protobuf.BoolValue",
"gp_global_deadlock_detector_period": "google.protobuf.Int64Value"
}
},
// end of the list of possible fields
"pool": {
"effective_config": {
"mode": "PoolMode",
"size": "google.protobuf.Int64Value",
"client_idle_timeout": "google.protobuf.Int64Value",
"idle_in_transaction_timeout": "google.protobuf.Int64Value"
},
"user_config": {
"mode": "PoolMode",
"size": "google.protobuf.Int64Value",
"client_idle_timeout": "google.protobuf.Int64Value",
"idle_in_transaction_timeout": "google.protobuf.Int64Value"
},
"default_config": {
"mode": "PoolMode",
"size": "google.protobuf.Int64Value",
"client_idle_timeout": "google.protobuf.Int64Value",
"idle_in_transaction_timeout": "google.protobuf.Int64Value"
}
},
"background_activities": {
"table_sizes": {
"starts": [
{
"hours": "int64",
"minutes": "int64"
}
]
},
"analyze_and_vacuum": {
"start": {
"hours": "int64",
"minutes": "int64"
},
"analyze_timeout": "google.protobuf.Int64Value",
"vacuum_timeout": "google.protobuf.Int64Value"
},
"query_killer_scripts": {
"idle": {
"enable": "google.protobuf.BoolValue",
"max_age": "google.protobuf.Int64Value",
"ignore_users": [
"string"
]
},
"idle_in_transaction": {
"enable": "google.protobuf.BoolValue",
"max_age": "google.protobuf.Int64Value",
"ignore_users": [
"string"
]
},
"long_running": {
"enable": "google.protobuf.BoolValue",
"max_age": "google.protobuf.Int64Value",
"ignore_users": [
"string"
]
}
}
},
"pxf_config": {
"effective_config": {
"connection_timeout": "google.protobuf.Int64Value",
"upload_timeout": "google.protobuf.Int64Value",
"max_threads": "google.protobuf.Int64Value",
"pool_allow_core_thread_timeout": "google.protobuf.BoolValue",
"pool_core_size": "google.protobuf.Int64Value",
"pool_queue_capacity": "google.protobuf.Int64Value",
"pool_max_size": "google.protobuf.Int64Value",
"xmx": "google.protobuf.Int64Value",
"xms": "google.protobuf.Int64Value"
},
"user_config": {
"connection_timeout": "google.protobuf.Int64Value",
"upload_timeout": "google.protobuf.Int64Value",
"max_threads": "google.protobuf.Int64Value",
"pool_allow_core_thread_timeout": "google.protobuf.BoolValue",
"pool_core_size": "google.protobuf.Int64Value",
"pool_queue_capacity": "google.protobuf.Int64Value",
"pool_max_size": "google.protobuf.Int64Value",
"xmx": "google.protobuf.Int64Value",
"xms": "google.protobuf.Int64Value"
},
"default_config": {
"connection_timeout": "google.protobuf.Int64Value",
"upload_timeout": "google.protobuf.Int64Value",
"max_threads": "google.protobuf.Int64Value",
"pool_allow_core_thread_timeout": "google.protobuf.BoolValue",
"pool_core_size": "google.protobuf.Int64Value",
"pool_queue_capacity": "google.protobuf.Int64Value",
"pool_max_size": "google.protobuf.Int64Value",
"xmx": "google.protobuf.Int64Value",
"xms": "google.protobuf.Int64Value"
}
}
},
"cloud_storage": {
"enable": "bool"
},
"master_host_group_ids": [
"string"
],
"segment_host_group_ids": [
"string"
],
"service_account_id": "string",
"logging": {
"enabled": "bool",
// Includes only one of the fields `folder_id`, `log_group_id`
"folder_id": "string",
"log_group_id": "string",
// end of the list of possible fields
"command_center_enabled": "bool",
"greenplum_enabled": "bool",
"pooler_enabled": "bool"
}
}
// end of the list of possible fields
}
An Operation resource. For more information, see Operation.
|
Field |
Description |
|
id |
string ID of the operation. |
|
description |
string Description of the operation. 0-256 characters long. |
|
created_at |
Creation timestamp. |
|
created_by |
string ID of the user or service account who initiated the operation. |
|
modified_at |
The time when the Operation resource was last modified. |
|
done |
bool If the value is |
|
metadata |
Service-specific metadata associated with the operation. |
|
error |
The error result of the operation in case of failure or cancellation. Includes only one of the fields The operation result. |
|
response |
The normal response of the operation in case of success. Includes only one of the fields The operation result. |
AddClusterHostsMetadata
|
Field |
Description |
|
cluster_id |
string ID of the Greenplum Cluster resource that is being updated. |
Cluster
A Greenplum® cluster resource.
|
Field |
Description |
|
id |
string ID of the Greenplum® cluster. |
|
folder_id |
string ID of the folder that the Greenplum® cluster belongs to. |
|
created_at |
Time when the cluster was created. |
|
name |
string Required field. Name of the Greenplum® cluster. |
|
config |
Greenplum® cluster configuration. |
|
description |
string Description of the Greenplum® cluster. |
|
labels |
object (map<string, string>) Custom labels for the Greenplum® cluster as |
|
environment |
enum Environment Deployment environment of the Greenplum® cluster.
|
|
monitoring[] |
Description of monitoring systems relevant to the Greenplum® cluster. |
|
master_config |
Configuration of the Greenplum® master subcluster. |
|
segment_config |
Configuration of the Greenplum® segment subcluster. |
|
master_host_count |
int64 Number of hosts in the master subcluster. |
|
segment_host_count |
int64 Number of hosts in the segment subcluster. |
|
segment_in_host |
int64 Number of segments per host. |
|
network_id |
string ID of the cloud network that the cluster belongs to. |
|
health |
enum Health Aggregated cluster health.
|
|
status |
enum Status Current state of the cluster.
|
|
maintenance_window |
A Greenplum® cluster maintenance window. Should be defined by either one of the two options. |
|
planned_operation |
Maintenance operation planned at nearest |
|
security_group_ids[] |
string User security groups. |
|
user_name |
string Owner user name. |
|
deletion_protection |
bool Determines whether the cluster is protected from being deleted. |
|
host_group_ids[] |
string Host groups hosting VMs of the cluster. |
|
cluster_config |
Greenplum® and Odyssey® configuration. |
|
cloud_storage |
Cloud storage settings |
|
master_host_group_ids[] |
string Host groups hosting VMs of the master subcluster. |
|
segment_host_group_ids[] |
string Host groups hosting VMs of the segment subcluster. |
|
service_account_id |
string Service account that will be used to access a Yandex Cloud resources |
|
logging |
Cloud logging configuration |
GreenplumConfig
|
Field |
Description |
|
version |
string Version of the Greenplum® server software. |
|
backup_window_start |
Time to start the daily backup, in the UTC timezone. |
|
backup_retain_period_days |
Retention policy of automated backups. |
|
access |
Access policy for external services. |
|
zone_id |
string ID of the availability zone the cluster belongs to. |
|
subnet_id |
string ID of the subnet the cluster belongs to. This subnet should be a part of the cloud network the cluster belongs to (see Cluster.network_id). |
|
assign_public_ip |
bool Determines whether the cluster has a public IP address. After the cluster has been created, this setting cannot be changed. |
Access
|
Field |
Description |
|
data_lens |
bool Allows data export from the cluster to DataLens. |
|
web_sql |
bool Allows SQL queries to the cluster databases from the management console. |
|
data_transfer |
bool Allows access for DataTransfer. |
|
yandex_query |
bool Allow access for YandexQuery. |
Monitoring
Monitoring system metadata.
|
Field |
Description |
|
name |
string Name of the monitoring system. |
|
description |
string Description of the monitoring system. |
|
link |
string Link to the monitoring system charts for the Greenplum® cluster. |
MasterSubclusterConfig
|
Field |
Description |
|
resources |
Computational resources allocated to Greenplum® master subcluster hosts. |
Resources
|
Field |
Description |
|
resource_preset_id |
string ID of the preset for computational resources allocated to a host. Available presets are listed in the documentation. |
|
disk_size |
int64 Volume of the storage used by the host, in bytes. |
|
disk_type_id |
string Type of the storage used by the host: |
SegmentSubclusterConfig
|
Field |
Description |
|
resources |
Computational resources allocated to Greenplum® segment subcluster hosts. |
MaintenanceWindow
|
Field |
Description |
|
anytime |
An any-time maintenance window. Includes only one of the fields |
|
weekly_maintenance_window |
A weekly maintenance window. Includes only one of the fields |
AnytimeMaintenanceWindow
An any-time maintenance window.
|
Field |
Description |
|
Empty |
|
WeeklyMaintenanceWindow
A weekly maintenance window.
|
Field |
Description |
|
day |
enum WeekDay Day of the week.
|
|
hour |
int64 Hour of the day in the UTC timezone. |
MaintenanceOperation
|
Field |
Description |
|
info |
string The description of the operation. |
|
delayed_until |
Delay time for the maintenance operation. |
ClusterConfigSet
|
Field |
Description |
|
greenplum_config_set_6_22 |
Includes only one of the fields |
|
greenplum_config_set_6 |
Includes only one of the fields |
|
pool |
Odyssey® pool settings. |
|
background_activities |
Managed Greenplum® background tasks configuration. |
|
pxf_config |
GreenplumConfigSet6_22
|
Field |
Description |
|
effective_config |
Required field. Effective settings for a Greenplum® cluster (a combination of settings defined in |
|
user_config |
User-defined settings for a Greenplum® cluster. |
|
default_config |
Default configuration for a Greenplum® cluster. |
GreenplumConfig6_22
|
Field |
Description |
|
max_connections |
Maximum number of inbound connections on master segment |
|
max_slot_wal_keep_size |
Specify the maximum size of WAL files that replication slots are allowed to retain in the pg_wal directory at checkpoint time. |
|
gp_workfile_limit_per_segment |
Sets the maximum total disk size that all running queries are allowed to use for creating temporary spill files at each segment. |
|
gp_workfile_limit_per_query |
Sets the maximum disk size an individual query is allowed to use for creating temporary spill files at each segment. |
|
gp_workfile_limit_files_per_query |
Sets the maximum number of temporary spill files (also known as workfiles) allowed per query per segment. |
|
max_prepared_transactions |
Sets the maximum number of transactions that can be in the "prepared" state simultaneously |
|
gp_workfile_compression |
Specifies whether the temporary files created, when a hash aggregation or hash join operation spills to disk, are compressed. |
|
max_statement_mem |
Sets the maximum memory limit for a query. Helps avoid out-of-memory errors on a segment host during query processing as a result of setting statement_mem too high. |
|
log_statement |
enum LogStatement Controls which SQL statements are logged. DDL logs all data definition commands like CREATE, ALTER, and DROP commands.
|
|
gp_add_column_inherits_table_setting |
https://docs.vmware.com/en/VMware-Tanzu-Greenplum/6/greenplum-database/GUID-ref_guide-config_params-guc-list.html#gp_add_column_inherits_table_setting |
GreenplumConfigSet6
|
Field |
Description |
|
effective_config |
Required field. Effective settings for a Greenplum (a combination of settings defined |
|
user_config |
User-defined settings for a Greenplum. |
|
default_config |
Default configuration for a Greenplum. |
GreenplumConfig6
|
Field |
Description |
|
max_connections |
Maximum number of inbound connections on master segment |
|
max_slot_wal_keep_size |
Specify the maximum size of WAL files that replication slots are allowed to retain in the pg_wal directory at checkpoint time. |
|
gp_workfile_limit_per_segment |
Sets the maximum total disk size that all running queries are allowed to use for creating temporary spill files at each segment. |
|
gp_workfile_limit_per_query |
Sets the maximum disk size an individual query is allowed to use for creating temporary spill files at each segment. |
|
gp_workfile_limit_files_per_query |
Sets the maximum number of temporary spill files (also known as workfiles) allowed per query per segment. |
|
max_prepared_transactions |
Sets the maximum number of transactions that can be in the "prepared" state simultaneously |
|
gp_workfile_compression |
Specifies whether the temporary files created, when a hash aggregation or hash join operation spills to disk, are compressed. |
|
max_statement_mem |
Sets the maximum memory limit for a query. Helps avoid out-of-memory errors on a segment host during query processing as a result of setting statement_mem too high. |
|
log_statement |
enum LogStatement Controls which SQL statements are logged. DDL logs all data definition commands like CREATE, ALTER, and DROP commands.
|
|
gp_add_column_inherits_table_setting |
https://docs.vmware.com/en/VMware-Tanzu-Greenplum/6/greenplum-database/GUID-ref_guide-config_params-guc-list.html#gp_add_column_inherits_table_setting |
|
gp_enable_global_deadlock_detector |
Controls whether the Greenplum Database Global Deadlock Detector is enabled to manage concurrent UPDATE and DELETE operations on heap tables to improve performance. See Inserting, Updating, and Deleting Datain the Greenplum Database Administrator Guide. The default is off, the Global Deadlock Detector is deactivated. |
|
gp_global_deadlock_detector_period |
Specifies the executing interval (in seconds) of the global deadlock detector background worker process. |
ConnectionPoolerConfigSet
|
Field |
Description |
|
effective_config |
Required field. Effective settings for an Odyssey® pooler (a combination of settings defined in |
|
user_config |
User-defined settings for an Odyssey® pooler. |
|
default_config |
Default configuration for an Odyssey® pooler. |
ConnectionPoolerConfig
|
Field |
Description |
|
mode |
enum PoolMode Route server pool mode.
|
|
size |
The number of servers in the server pool. Clients are placed in a wait queue when all servers are busy. Set to zero to disable the limit. |
|
client_idle_timeout |
Client pool idle timeout, in seconds. Drop stale client connection after this much seconds of idleness, which is not in transaction. Set to zero to disable. |
|
idle_in_transaction_timeout |
Client pool idle in transaction timeout, in seconds. Drop client connection in transaction after this much seconds of idleness. Set to zero to disable. |
BackgroundActivitiesConfig
|
Field |
Description |
|
table_sizes |
Enables scripts that collects tables sizes to |
|
analyze_and_vacuum |
Configuration for |
|
query_killer_scripts |
Configuration for long running queries killer. |
TableSizes
|
Field |
Description |
|
starts[] |
BackgroundActivityStartAt
|
Field |
Description |
|
hours |
int64 |
|
minutes |
int64 |
AnalyzeAndVacuum
|
Field |
Description |
|
start |
|
|
analyze_timeout |
Maximum duration of the |
|
vacuum_timeout |
Maximum duration of the |
QueryKillerScripts
|
Field |
Description |
|
idle |
Configuration of script that kills long running queries that are in |
|
idle_in_transaction |
Configuration of script that kills long running queries that are in |
|
long_running |
Configuration of script that kills long running queries (in any state). |
QueryKiller
|
Field |
Description |
|
enable |
|
|
max_age |
Maximum duration for this type of queries (in seconds). |
|
ignore_users[] |
string Ignore these users when considering queries to terminate |
PXFConfigSet
|
Field |
Description |
|
effective_config |
Required field. |
|
user_config |
User-defined settings. |
|
default_config |
Default configuration. |
PXFConfig
|
Field |
Description |
|
connection_timeout |
Timeout for connection to the Apache Tomcat® server when making read requests. Specify values in seconds. |
|
upload_timeout |
Timeout for connection to the Apache Tomcat® server when making write requests. Specify the values in seconds. |
|
max_threads |
Maximum number of the Apache Tomcat® threads. To prevent situations when requests get stuck or fail due to running out of memory or malfunctioning of the Java garbage collector, specify the number of the Apache Tomcat® threads. Learn more about adjusting the number of threads in the VMware Greenplum® Platform Extension Framework |
|
pool_allow_core_thread_timeout |
Determines whether the timeout for core streaming threads is permitted. |
|
pool_core_size |
Number of core streaming threads per pool. |
|
pool_queue_capacity |
Maximum number of requests you can add to a pool queue for core streaming threads. If |
|
pool_max_size |
Maximum allowed number of core streaming threads. |
|
xmx |
Initial size, in megabytes, of the JVM heap for the PXF daemon. |
|
xms |
Maximum size, in megabytes, of the JVM heap for the PXF daemon. |
CloudStorage
Cloud Storage Settings
|
Field |
Description |
|
enable |
bool enable Cloud Storage for cluster |
LoggingConfig
|
Field |
Description |
|
enabled |
bool |
|
folder_id |
string Includes only one of the fields |
|
log_group_id |
string Includes only one of the fields |
|
command_center_enabled |
bool send Yandex Command Center logs |
|
greenplum_enabled |
bool send Greenplum logs |
|
pooler_enabled |
bool send Pooler logs |