Managed Service for Greenplum® API, REST: Cluster.Create
- HTTP request
- Body parameters
- GreenplumConfig
- TimeOfDay
- Access
- MasterSubclusterConfigSpec
- Resources
- SegmentSubclusterConfigSpec
- MaintenanceWindow
- WeeklyMaintenanceWindow
- ConfigSpec
- GreenplumConfig6
- ConnectionPoolerConfig
- BackgroundActivitiesConfig
- TableSizes
- BackgroundActivityStartAt
- AnalyzeAndVacuum
- QueryKillerScripts
- QueryKiller
- PXFConfig
- CloudStorage
- LoggingConfig
- Response
- CreateClusterMetadata
- Status
- Cluster
- GreenplumConfig
- TimeOfDay
- Access
- Monitoring
- MasterSubclusterConfig
- Resources
- SegmentSubclusterConfig
- MaintenanceWindow
- WeeklyMaintenanceWindow
- MaintenanceOperation
- ClusterConfigSet
- GreenplumConfigSet6
- GreenplumConfig6
- ConnectionPoolerConfigSet
- ConnectionPoolerConfig
- BackgroundActivitiesConfig
- TableSizes
- BackgroundActivityStartAt
- AnalyzeAndVacuum
- QueryKillerScripts
- QueryKiller
- PXFConfigSet
- PXFConfig
- CloudStorage
- LoggingConfig
Creates a Greenplum® cluster in the specified folder.
HTTP request
POST https://mdb.api.cloud.yandex.net/managed-greenplum/v1/clusters
Body parameters
{
"folderId": "string",
"name": "string",
"description": "string",
"labels": "object",
"environment": "string",
"config": {
"version": "string",
"backupWindowStart": {
"hours": "integer",
"minutes": "integer",
"seconds": "integer",
"nanos": "integer"
},
"backupRetainPeriodDays": "string",
"access": {
"dataLens": "boolean",
"webSql": "boolean",
"dataTransfer": "boolean",
"yandexQuery": "boolean"
},
"zoneId": "string",
"subnetId": "string",
"assignPublicIp": "boolean",
"fullVersion": "string"
},
"masterConfig": {
"resources": {
"resourcePresetId": "string",
"diskSize": "string",
"diskTypeId": "string"
}
},
"segmentConfig": {
"resources": {
"resourcePresetId": "string",
"diskSize": "string",
"diskTypeId": "string"
}
},
"masterHostCount": "string",
"segmentInHost": "string",
"segmentHostCount": "string",
"userName": "string",
"userPassword": "string",
"networkId": "string",
"securityGroupIds": [
"string"
],
"deletionProtection": "boolean",
"hostGroupIds": [
"string"
],
"maintenanceWindow": {
// Includes only one of the fields `anytime`, `weeklyMaintenanceWindow`
"anytime": "object",
"weeklyMaintenanceWindow": {
"day": "string",
"hour": "string"
}
// end of the list of possible fields
},
"configSpec": {
// Includes only one of the fields `greenplumConfig_6`
"greenplumConfig_6": {
"maxConnections": "string",
"maxSlotWalKeepSize": "string",
"gpWorkfileLimitPerSegment": "string",
"gpWorkfileLimitPerQuery": "string",
"gpWorkfileLimitFilesPerQuery": "string",
"maxPreparedTransactions": "string",
"gpWorkfileCompression": "boolean",
"maxStatementMem": "string",
"logStatement": "string",
"gpAddColumnInheritsTableSetting": "boolean",
"gpEnableGlobalDeadlockDetector": "boolean",
"gpGlobalDeadlockDetectorPeriod": "string",
"gpMaxSlices": "string",
"gpCachedSegworkersThreshold": "string",
"lockTimeout": "string",
"idleInTransactionSessionTimeout": "string",
"runawayDetectorActivationPercent": "string",
"gpVmemProtectSegworkerCacheLimit": "string",
"gpEnableZstdMemoryAccounting": "boolean",
"gpMaxPlanSize": "string",
"gpAutostatsMode": "string",
"gpAutostatsOnChangeThreshold": "string",
"gpResourceGroupMemoryLimit": "number",
"logConnections": "boolean",
"logDisconnections": "boolean",
"logHostname": "boolean",
"logStatementStats": "boolean",
"logMinDurationStatement": "string",
"masterSharedBuffers": "string",
"maxLocksPerTransaction": "string",
"segmentSharedBuffers": "string",
"logErrorVerbosity": "string",
"logMinMessages": "string"
},
// end of the list of possible fields
"pool": {
"mode": "string",
"size": "string",
"clientIdleTimeout": "string",
"idleInTransactionTimeout": "string"
},
"backgroundActivities": {
"tableSizes": {
"starts": [
{
"hours": "string",
"minutes": "string"
}
]
},
"analyzeAndVacuum": {
"start": {
"hours": "string",
"minutes": "string"
},
"analyzeTimeout": "string",
"vacuumTimeout": "string"
},
"queryKillerScripts": {
"idle": {
"enable": "boolean",
"maxAge": "string",
"ignoreUsers": [
"string"
]
},
"idleInTransaction": {
"enable": "boolean",
"maxAge": "string",
"ignoreUsers": [
"string"
]
},
"longRunning": {
"enable": "boolean",
"maxAge": "string",
"ignoreUsers": [
"string"
]
}
}
},
"pxfConfig": {
"connectionTimeout": "string",
"uploadTimeout": "string",
"maxThreads": "string",
"poolAllowCoreThreadTimeout": "boolean",
"poolCoreSize": "string",
"poolQueueCapacity": "string",
"poolMaxSize": "string",
"xmx": "string",
"xms": "string"
}
},
"cloudStorage": {
"enable": "boolean"
},
"masterHostGroupIds": [
"string"
],
"segmentHostGroupIds": [
"string"
],
"serviceAccountId": "string",
"logging": {
"enabled": "boolean",
// Includes only one of the fields `folderId`, `logGroupId`
"folderId": "string",
"logGroupId": "string",
// end of the list of possible fields
"commandCenterEnabled": "boolean",
"greenplumEnabled": "boolean",
"poolerEnabled": "boolean"
}
}
|
Field |
Description |
|
folderId |
string Required field. ID of the folder to create the Greenplum® cluster in. The maximum string length in characters is 50. |
|
name |
string Required field. Name of the Greenplum® cluster. The name must be unique within the folder. The maximum string length in characters is 63. Value must match the regular expression |
|
description |
string Description of the Greenplum® cluster. The maximum string length in characters is 256. |
|
labels |
object (map<string, string>) Custom labels for the Greenplum® cluster as No more than 64 per resource. The maximum string length in characters for each value is 63. Each value must match the regular expression |
|
environment |
enum (Environment) Required field. Deployment environment of the Greenplum® cluster.
|
|
config |
Greenplum® cluster configuration. |
|
masterConfig |
Configuration of the Greenplum® master subcluster. |
|
segmentConfig |
Configuration of the Greenplum® segment subcluster. |
|
masterHostCount |
string (int64) Number of hosts in the master subcluster. |
|
segmentInHost |
string (int64) Number of segments per host. |
|
segmentHostCount |
string (int64) Number of hosts in the segment subcluster. |
|
userName |
string Required field. Owner user name. |
|
userPassword |
string Required field. Owner user password. The string length in characters must be 8-128. |
|
networkId |
string Required field. ID of the network to create the cluster in. The maximum string length in characters is 50. |
|
securityGroupIds[] |
string User security groups. |
|
deletionProtection |
boolean Determines whether the cluster is protected from being deleted. |
|
hostGroupIds[] |
string Host groups to place VMs of the cluster in. |
|
maintenanceWindow |
A Greenplum® cluster maintenance window. Should be defined by either one of the two options. |
|
configSpec |
Configuration of Greenplum® and Odyssey®. |
|
cloudStorage |
Cloud storage settings |
|
masterHostGroupIds[] |
string Host groups hosting VMs of the master subcluster. |
|
segmentHostGroupIds[] |
string Host groups hosting VMs of the segment subcluster. |
|
serviceAccountId |
string ID of the service account used for access Yandex Cloud resources. |
|
logging |
Cloud logging configuration |
GreenplumConfig
|
Field |
Description |
|
version |
string Version of the Greenplum® server software. |
|
backupWindowStart |
Time to start the daily backup, in the UTC timezone. |
|
backupRetainPeriodDays |
string (int64) Retention policy of automated backups. Acceptable values are 1 to 60, inclusive. |
|
access |
Access policy for external services. |
|
zoneId |
string ID of the availability zone the cluster belongs to. The maximum string length in characters is 50. |
|
subnetId |
string ID of the subnet the cluster belongs to. This subnet should be a part of the cloud network the cluster belongs to (see Cluster.networkId). The maximum string length in characters is 50. |
|
assignPublicIp |
boolean Determines whether the cluster has a public IP address. After the cluster has been created, this setting cannot be changed. |
|
fullVersion |
string Full version |
TimeOfDay
Represents a time of day. The date and time zone are either not significant
or are specified elsewhere. An API may choose to allow leap seconds. Related
types are google.type.Date
|
Field |
Description |
|
hours |
integer (int32) Hours of day in 24 hour format. Should be from 0 to 23. An API may choose |
|
minutes |
integer (int32) Minutes of hour of day. Must be from 0 to 59. |
|
seconds |
integer (int32) Seconds of minutes of the time. Must normally be from 0 to 59. An API may |
|
nanos |
integer (int32) Fractions of seconds in nanoseconds. Must be from 0 to 999,999,999. |
Access
|
Field |
Description |
|
dataLens |
boolean Allows data export from the cluster to DataLens. |
|
webSql |
boolean Allows SQL queries to the cluster databases from the management console. |
|
dataTransfer |
boolean Allows access for DataTransfer. |
|
yandexQuery |
boolean Allow access for YandexQuery. |
MasterSubclusterConfigSpec
|
Field |
Description |
|
resources |
Resources allocated to Greenplum® master subcluster hosts. |
Resources
|
Field |
Description |
|
resourcePresetId |
string ID of the preset for computational resources allocated to a host. Available presets are listed in the documentation. |
|
diskSize |
string (int64) Volume of the storage used by the host, in bytes. |
|
diskTypeId |
string Type of the storage used by the host: |
SegmentSubclusterConfigSpec
|
Field |
Description |
|
resources |
Resources allocated to Greenplum® segment subcluster hosts. |
MaintenanceWindow
|
Field |
Description |
|
anytime |
object An any-time maintenance window. Includes only one of the fields |
|
weeklyMaintenanceWindow |
A weekly maintenance window. Includes only one of the fields |
WeeklyMaintenanceWindow
A weekly maintenance window.
|
Field |
Description |
|
day |
enum (WeekDay) Day of the week.
|
|
hour |
string (int64) Hour of the day in the UTC timezone. Acceptable values are 1 to 24, inclusive. |
ConfigSpec
|
Field |
Description |
|
greenplumConfig_6 |
Includes only one of the fields |
|
pool |
Odyssey® pool settings. |
|
backgroundActivities |
Managed Greenplum® background tasks configuration. |
|
pxfConfig |
GreenplumConfig6
|
Field |
Description |
|
maxConnections |
string (int64) Maximum number of inbound connections on master segment Acceptable values are 50 to 1000, inclusive. |
|
maxSlotWalKeepSize |
string (int64) Specify the maximum size of WAL files that replication slots are allowed to retain in the pg_wal directory at checkpoint time. Acceptable values are 0 to 214748364800, inclusive. |
|
gpWorkfileLimitPerSegment |
string (int64) Sets the maximum total disk size that all running queries are allowed to use for creating temporary spill files at each segment. The minimum value is 0. |
|
gpWorkfileLimitPerQuery |
string (int64) Sets the maximum disk size an individual query is allowed to use for creating temporary spill files at each segment. Acceptable values are 0 to 1099511627776, inclusive. |
|
gpWorkfileLimitFilesPerQuery |
string (int64) Sets the maximum number of temporary spill files (also known as workfiles) allowed per query per segment. Acceptable values are 0 to 100000, inclusive. |
|
maxPreparedTransactions |
string (int64) Sets the maximum number of transactions that can be in the "prepared" state simultaneously Acceptable values are 50 to 10000, inclusive. |
|
gpWorkfileCompression |
boolean Specifies whether the temporary files created, when a hash aggregation or hash join operation spills to disk, are compressed. |
|
maxStatementMem |
string (int64) Sets the maximum memory limit for a query. Helps avoid out-of-memory errors on a segment host during query processing as a result of setting statement_mem too high. Acceptable values are 134217728 to 1099511627776, inclusive. |
|
logStatement |
enum (LogStatement) Controls which SQL statements are logged. DDL logs all data definition commands like CREATE, ALTER, and DROP commands.
|
|
gpAddColumnInheritsTableSetting |
boolean https://docs.vmware.com/en/VMware-Tanzu-Greenplum/6/greenplum-database/GUID-ref_guide-config_params-guc-list.html#gp_add_column_inherits_table_setting |
|
gpEnableGlobalDeadlockDetector |
boolean Controls whether the Greenplum Database Global Deadlock Detector is enabled to manage concurrent UPDATE and DELETE operations on heap tables to improve performance. See Inserting, Updating, and Deleting Datain the Greenplum Database Administrator Guide. The default is off, the Global Deadlock Detector is deactivated. |
|
gpGlobalDeadlockDetectorPeriod |
string (int64) Specifies the executing interval (in seconds) of the global deadlock detector background worker process. |
|
gpMaxSlices |
string (int64) Max amount of slice-processes for one query in one segment. Acceptable values are 10 to 100, inclusive. |
|
gpCachedSegworkersThreshold |
string (int64) Define amount of working processes in segment, that keeping in warm cash after end of query for usage again in next queries. Acceptable values are 0 to 10, inclusive. |
|
lockTimeout |
string (int64) Max time (in ms) which query will wait lock free on object Acceptable values are 0 to 2147483647, inclusive. |
|
idleInTransactionSessionTimeout |
string (int64) Max time (in ms) which session can idle in open transaction Acceptable values are 0 to 2147483647, inclusive. |
|
runawayDetectorActivationPercent |
string (int64) Percent of utilized Greenplum Database vmem that triggers the termination of queries. Acceptable values are 0 to 100, inclusive. |
|
gpVmemProtectSegworkerCacheLimit |
string (int64) Set memory limit (in MB) for working process. If a query executor process consumes more than this configured amount, then the process will not be cached for use in subsequent queries after the process completes. Acceptable values are 0 to 4096, inclusive. |
|
gpEnableZstdMemoryAccounting |
boolean Forces ZSTD lib use Greenplum memory allocation system. |
|
gpMaxPlanSize |
string (int64) Specifies the total maximum uncompressed size of a query execution plan multiplied by the number of Motion operators (slices) in the plan. Acceptable values are 0 to 2147483647, inclusive. |
|
gpAutostatsMode |
enum (GPAutostatsMode) Specifies the mode for triggering automatic statistics collection after DML.
|
|
gpAutostatsOnChangeThreshold |
string (int64) Specifies the threshold for automatic statistics collection when gp_autostats_mode is set to on_change. Acceptable values are 0 to 2147483647, inclusive. |
|
gpResourceGroupMemoryLimit |
number (double) Identifies the maximum percentage of system memory resources to allocate to resource groups on each Greenplum Database segment node. |
|
logConnections |
boolean This outputs a line to the server log detailing each successful connection. Some client programs, like psql, |
|
logDisconnections |
boolean This outputs a line in the server log at termination of a client session, and includes the duration of the session. |
|
logHostname |
boolean By default, connection log messages only show the IP address of the connecting host. |
|
logStatementStats |
boolean For each query, write total performance statistics of the query parser, planner, and executor to the server log. |
|
logMinDurationStatement |
string (int64) Logs the statement and its duration on a single log line if its duration is greater than or equal |
|
masterSharedBuffers |
string (int64) Sets the amount of memory a Greenplum Database master instance uses for shared memory buffers. Acceptable values are 1048576 to 2147483647, inclusive. |
|
maxLocksPerTransaction |
string (int64) The shared lock table is created with room to describe locks on max_locks_per_transaction * (max_connections + max_prepared_transactions) objects, Acceptable values are 128 to 2048, inclusive. |
|
segmentSharedBuffers |
string (int64) Sets the amount of memory a Greenplum Database segment instance uses for shared memory buffers. Acceptable values are 1048576 to 2147483647, inclusive. |
|
logErrorVerbosity |
enum (LogErrorVerbosity) Controls the amount of detail written in the server log for each message that is logged.
|
|
logMinMessages |
enum (LogLevelMessage) Controls which message levels are written to the server log.
|
ConnectionPoolerConfig
|
Field |
Description |
|
mode |
enum (PoolMode) Route server pool mode.
|
|
size |
string (int64) The number of servers in the server pool. Clients are placed in a wait queue when all servers are busy. Set to zero to disable the limit. |
|
clientIdleTimeout |
string (int64) Client pool idle timeout, in seconds. Drop stale client connection after this much seconds of idleness, which is not in transaction. Set to zero to disable. |
|
idleInTransactionTimeout |
string (int64) Client pool idle in transaction timeout, in seconds. Drop client connection in transaction after this much seconds of idleness. Set to zero to disable. |
BackgroundActivitiesConfig
Configuration for long running queries killer.
|
Field |
Description |
|
tableSizes |
Enables scripts that collects tables sizes to |
|
analyzeAndVacuum |
Configuration for |
|
queryKillerScripts |
Configuration for long running queries killer. |
TableSizes
Enables scripts that collects tables sizes to *_sizes tables in mdb_toolkit schema.
|
Field |
Description |
|
starts[] |
Time when start "table_sizes" script The maximum number of elements is 4. |
BackgroundActivityStartAt
Start time for background activity
|
Field |
Description |
|
hours |
string (int64) hours Acceptable values are 0 to 23, inclusive. |
|
minutes |
string (int64) minutes Acceptable values are 0 to 59, inclusive. |
AnalyzeAndVacuum
Configuration for ANALYZE and VACUUM operations.
|
Field |
Description |
|
start |
Time when analyze will start |
|
analyzeTimeout |
string (int64) Maximum duration of the Acceptable values are 7200 to 86399, inclusive. |
|
vacuumTimeout |
string (int64) Maximum duration of the Acceptable values are 7200 to 86399, inclusive. |
QueryKillerScripts
|
Field |
Description |
|
idle |
Configuration of script that kills long running queries that are in |
|
idleInTransaction |
Configuration of script that kills long running queries that are in |
|
longRunning |
Configuration of script that kills long running queries (in any state). |
QueryKiller
|
Field |
Description |
|
enable |
boolean Use query killer or not |
|
maxAge |
string (int64) Maximum duration for this type of queries (in seconds). Acceptable values are 1 to 86400, inclusive. |
|
ignoreUsers[] |
string Ignore these users when considering queries to terminate |
PXFConfig
|
Field |
Description |
|
connectionTimeout |
string (int64) Timeout for connection to the Apache Tomcat® server when making read requests. Specify values in seconds. Acceptable values are 5 to 600, inclusive. |
|
uploadTimeout |
string (int64) Timeout for connection to the Apache Tomcat® server when making write requests. Specify the values in seconds. Acceptable values are 5 to 600, inclusive. |
|
maxThreads |
string (int64) Maximum number of the Apache Tomcat® threads. To prevent situations when requests get stuck or fail due to running out of memory or malfunctioning of the Java garbage collector, specify the number of the Apache Tomcat® threads. Learn more about adjusting the number of threads in the VMware Greenplum® Platform Extension Framework Acceptable values are 1 to 1024, inclusive. |
|
poolAllowCoreThreadTimeout |
boolean Determines whether the timeout for core streaming threads is permitted. |
|
poolCoreSize |
string (int64) Number of core streaming threads per pool. Acceptable values are 1 to 1024, inclusive. |
|
poolQueueCapacity |
string (int64) Maximum number of requests you can add to a pool queue for core streaming threads. If The minimum value is 0. |
|
poolMaxSize |
string (int64) Maximum allowed number of core streaming threads. Acceptable values are 1 to 1024, inclusive. |
|
xmx |
string (int64) Initial size, in megabytes, of the JVM heap for the PXF daemon. The minimum value is 64. |
|
xms |
string (int64) Maximum size, in megabytes, of the JVM heap for the PXF daemon. The minimum value is 64. |
CloudStorage
Cloud Storage Settings
|
Field |
Description |
|
enable |
boolean enable Cloud Storage for cluster |
LoggingConfig
|
Field |
Description |
|
enabled |
boolean |
|
folderId |
string Value must match the regular expression Includes only one of the fields |
|
logGroupId |
string Value must match the regular expression Includes only one of the fields |
|
commandCenterEnabled |
boolean send Yandex Command Center logs |
|
greenplumEnabled |
boolean send Greenplum logs |
|
poolerEnabled |
boolean send Pooler logs |
Response
HTTP Code: 200 - OK
{
"id": "string",
"description": "string",
"createdAt": "string",
"createdBy": "string",
"modifiedAt": "string",
"done": "boolean",
"metadata": {
"clusterId": "string"
},
// Includes only one of the fields `error`, `response`
"error": {
"code": "integer",
"message": "string",
"details": [
"object"
]
},
"response": {
"id": "string",
"folderId": "string",
"createdAt": "string",
"name": "string",
"config": {
"version": "string",
"backupWindowStart": {
"hours": "integer",
"minutes": "integer",
"seconds": "integer",
"nanos": "integer"
},
"backupRetainPeriodDays": "string",
"access": {
"dataLens": "boolean",
"webSql": "boolean",
"dataTransfer": "boolean",
"yandexQuery": "boolean"
},
"zoneId": "string",
"subnetId": "string",
"assignPublicIp": "boolean",
"fullVersion": "string"
},
"description": "string",
"labels": "object",
"environment": "string",
"monitoring": [
{
"name": "string",
"description": "string",
"link": "string"
}
],
"masterConfig": {
"resources": {
"resourcePresetId": "string",
"diskSize": "string",
"diskTypeId": "string"
}
},
"segmentConfig": {
"resources": {
"resourcePresetId": "string",
"diskSize": "string",
"diskTypeId": "string"
}
},
"masterHostCount": "string",
"segmentHostCount": "string",
"segmentInHost": "string",
"networkId": "string",
"health": "string",
"status": "string",
"maintenanceWindow": {
// Includes only one of the fields `anytime`, `weeklyMaintenanceWindow`
"anytime": "object",
"weeklyMaintenanceWindow": {
"day": "string",
"hour": "string"
}
// end of the list of possible fields
},
"plannedOperation": {
"info": "string",
"delayedUntil": "string"
},
"securityGroupIds": [
"string"
],
"userName": "string",
"deletionProtection": "boolean",
"hostGroupIds": [
"string"
],
"clusterConfig": {
// Includes only one of the fields `greenplumConfigSet_6`
"greenplumConfigSet_6": {
"effectiveConfig": {
"maxConnections": "string",
"maxSlotWalKeepSize": "string",
"gpWorkfileLimitPerSegment": "string",
"gpWorkfileLimitPerQuery": "string",
"gpWorkfileLimitFilesPerQuery": "string",
"maxPreparedTransactions": "string",
"gpWorkfileCompression": "boolean",
"maxStatementMem": "string",
"logStatement": "string",
"gpAddColumnInheritsTableSetting": "boolean",
"gpEnableGlobalDeadlockDetector": "boolean",
"gpGlobalDeadlockDetectorPeriod": "string",
"gpMaxSlices": "string",
"gpCachedSegworkersThreshold": "string",
"lockTimeout": "string",
"idleInTransactionSessionTimeout": "string",
"runawayDetectorActivationPercent": "string",
"gpVmemProtectSegworkerCacheLimit": "string",
"gpEnableZstdMemoryAccounting": "boolean",
"gpMaxPlanSize": "string",
"gpAutostatsMode": "string",
"gpAutostatsOnChangeThreshold": "string",
"gpResourceGroupMemoryLimit": "number",
"logConnections": "boolean",
"logDisconnections": "boolean",
"logHostname": "boolean",
"logStatementStats": "boolean",
"logMinDurationStatement": "string",
"masterSharedBuffers": "string",
"maxLocksPerTransaction": "string",
"segmentSharedBuffers": "string",
"logErrorVerbosity": "string",
"logMinMessages": "string"
},
"userConfig": {
"maxConnections": "string",
"maxSlotWalKeepSize": "string",
"gpWorkfileLimitPerSegment": "string",
"gpWorkfileLimitPerQuery": "string",
"gpWorkfileLimitFilesPerQuery": "string",
"maxPreparedTransactions": "string",
"gpWorkfileCompression": "boolean",
"maxStatementMem": "string",
"logStatement": "string",
"gpAddColumnInheritsTableSetting": "boolean",
"gpEnableGlobalDeadlockDetector": "boolean",
"gpGlobalDeadlockDetectorPeriod": "string",
"gpMaxSlices": "string",
"gpCachedSegworkersThreshold": "string",
"lockTimeout": "string",
"idleInTransactionSessionTimeout": "string",
"runawayDetectorActivationPercent": "string",
"gpVmemProtectSegworkerCacheLimit": "string",
"gpEnableZstdMemoryAccounting": "boolean",
"gpMaxPlanSize": "string",
"gpAutostatsMode": "string",
"gpAutostatsOnChangeThreshold": "string",
"gpResourceGroupMemoryLimit": "number",
"logConnections": "boolean",
"logDisconnections": "boolean",
"logHostname": "boolean",
"logStatementStats": "boolean",
"logMinDurationStatement": "string",
"masterSharedBuffers": "string",
"maxLocksPerTransaction": "string",
"segmentSharedBuffers": "string",
"logErrorVerbosity": "string",
"logMinMessages": "string"
},
"defaultConfig": {
"maxConnections": "string",
"maxSlotWalKeepSize": "string",
"gpWorkfileLimitPerSegment": "string",
"gpWorkfileLimitPerQuery": "string",
"gpWorkfileLimitFilesPerQuery": "string",
"maxPreparedTransactions": "string",
"gpWorkfileCompression": "boolean",
"maxStatementMem": "string",
"logStatement": "string",
"gpAddColumnInheritsTableSetting": "boolean",
"gpEnableGlobalDeadlockDetector": "boolean",
"gpGlobalDeadlockDetectorPeriod": "string",
"gpMaxSlices": "string",
"gpCachedSegworkersThreshold": "string",
"lockTimeout": "string",
"idleInTransactionSessionTimeout": "string",
"runawayDetectorActivationPercent": "string",
"gpVmemProtectSegworkerCacheLimit": "string",
"gpEnableZstdMemoryAccounting": "boolean",
"gpMaxPlanSize": "string",
"gpAutostatsMode": "string",
"gpAutostatsOnChangeThreshold": "string",
"gpResourceGroupMemoryLimit": "number",
"logConnections": "boolean",
"logDisconnections": "boolean",
"logHostname": "boolean",
"logStatementStats": "boolean",
"logMinDurationStatement": "string",
"masterSharedBuffers": "string",
"maxLocksPerTransaction": "string",
"segmentSharedBuffers": "string",
"logErrorVerbosity": "string",
"logMinMessages": "string"
}
},
// end of the list of possible fields
"pool": {
"effectiveConfig": {
"mode": "string",
"size": "string",
"clientIdleTimeout": "string",
"idleInTransactionTimeout": "string"
},
"userConfig": {
"mode": "string",
"size": "string",
"clientIdleTimeout": "string",
"idleInTransactionTimeout": "string"
},
"defaultConfig": {
"mode": "string",
"size": "string",
"clientIdleTimeout": "string",
"idleInTransactionTimeout": "string"
}
},
"backgroundActivities": {
"tableSizes": {
"starts": [
{
"hours": "string",
"minutes": "string"
}
]
},
"analyzeAndVacuum": {
"start": {
"hours": "string",
"minutes": "string"
},
"analyzeTimeout": "string",
"vacuumTimeout": "string"
},
"queryKillerScripts": {
"idle": {
"enable": "boolean",
"maxAge": "string",
"ignoreUsers": [
"string"
]
},
"idleInTransaction": {
"enable": "boolean",
"maxAge": "string",
"ignoreUsers": [
"string"
]
},
"longRunning": {
"enable": "boolean",
"maxAge": "string",
"ignoreUsers": [
"string"
]
}
}
},
"pxfConfig": {
"effectiveConfig": {
"connectionTimeout": "string",
"uploadTimeout": "string",
"maxThreads": "string",
"poolAllowCoreThreadTimeout": "boolean",
"poolCoreSize": "string",
"poolQueueCapacity": "string",
"poolMaxSize": "string",
"xmx": "string",
"xms": "string"
},
"userConfig": {
"connectionTimeout": "string",
"uploadTimeout": "string",
"maxThreads": "string",
"poolAllowCoreThreadTimeout": "boolean",
"poolCoreSize": "string",
"poolQueueCapacity": "string",
"poolMaxSize": "string",
"xmx": "string",
"xms": "string"
},
"defaultConfig": {
"connectionTimeout": "string",
"uploadTimeout": "string",
"maxThreads": "string",
"poolAllowCoreThreadTimeout": "boolean",
"poolCoreSize": "string",
"poolQueueCapacity": "string",
"poolMaxSize": "string",
"xmx": "string",
"xms": "string"
}
}
},
"cloudStorage": {
"enable": "boolean"
},
"masterHostGroupIds": [
"string"
],
"segmentHostGroupIds": [
"string"
],
"serviceAccountId": "string",
"logging": {
"enabled": "boolean",
// Includes only one of the fields `folderId`, `logGroupId`
"folderId": "string",
"logGroupId": "string",
// end of the list of possible fields
"commandCenterEnabled": "boolean",
"greenplumEnabled": "boolean",
"poolerEnabled": "boolean"
}
}
// end of the list of possible fields
}
An Operation resource. For more information, see Operation.
|
Field |
Description |
|
id |
string ID of the operation. |
|
description |
string Description of the operation. 0-256 characters long. |
|
createdAt |
string (date-time) Creation timestamp. String in RFC3339 To work with values in this field, use the APIs described in the |
|
createdBy |
string ID of the user or service account who initiated the operation. |
|
modifiedAt |
string (date-time) The time when the Operation resource was last modified. String in RFC3339 To work with values in this field, use the APIs described in the |
|
done |
boolean If the value is |
|
metadata |
Service-specific metadata associated with the operation. |
|
error |
The error result of the operation in case of failure or cancellation. Includes only one of the fields The operation result. |
|
response |
The normal response of the operation in case of success. Includes only one of the fields The operation result. |
CreateClusterMetadata
|
Field |
Description |
|
clusterId |
string ID of the Greenplum® cluster that is being created. |
Status
The error result of the operation in case of failure or cancellation.
|
Field |
Description |
|
code |
integer (int32) Error code. An enum value of google.rpc.Code |
|
message |
string An error message. |
|
details[] |
object A list of messages that carry the error details. |
Cluster
A Greenplum® cluster resource.
|
Field |
Description |
|
id |
string ID of the Greenplum® cluster. |
|
folderId |
string ID of the folder that the Greenplum® cluster belongs to. |
|
createdAt |
string (date-time) Time when the cluster was created. String in RFC3339 To work with values in this field, use the APIs described in the |
|
name |
string Required field. Name of the Greenplum® cluster. The maximum string length in characters is 63. |
|
config |
Greenplum® cluster configuration. |
|
description |
string Description of the Greenplum® cluster. The maximum string length in characters is 256. |
|
labels |
object (map<string, string>) Custom labels for the Greenplum® cluster as |
|
environment |
enum (Environment) Deployment environment of the Greenplum® cluster.
|
|
monitoring[] |
Description of monitoring systems relevant to the Greenplum® cluster. |
|
masterConfig |
Configuration of the Greenplum® master subcluster. |
|
segmentConfig |
Configuration of the Greenplum® segment subcluster. |
|
masterHostCount |
string (int64) Number of hosts in the master subcluster. |
|
segmentHostCount |
string (int64) Number of hosts in the segment subcluster. |
|
segmentInHost |
string (int64) Number of segments per host. |
|
networkId |
string ID of the cloud network that the cluster belongs to. |
|
health |
enum (Health) Aggregated cluster health.
|
|
status |
enum (Status) Current state of the cluster.
|
|
maintenanceWindow |
A Greenplum® cluster maintenance window. Should be defined by either one of the two options. |
|
plannedOperation |
Maintenance operation planned at nearest |
|
securityGroupIds[] |
string User security groups. |
|
userName |
string Owner user name. |
|
deletionProtection |
boolean Determines whether the cluster is protected from being deleted. |
|
hostGroupIds[] |
string Host groups hosting VMs of the cluster. |
|
clusterConfig |
Greenplum® and Odyssey® configuration. |
|
cloudStorage |
Cloud storage settings |
|
masterHostGroupIds[] |
string Host groups hosting VMs of the master subcluster. |
|
segmentHostGroupIds[] |
string Host groups hosting VMs of the segment subcluster. |
|
serviceAccountId |
string Service account that will be used to access a Yandex Cloud resources |
|
logging |
Cloud logging configuration |
GreenplumConfig
|
Field |
Description |
|
version |
string Version of the Greenplum® server software. |
|
backupWindowStart |
Time to start the daily backup, in the UTC timezone. |
|
backupRetainPeriodDays |
string (int64) Retention policy of automated backups. Acceptable values are 1 to 60, inclusive. |
|
access |
Access policy for external services. |
|
zoneId |
string ID of the availability zone the cluster belongs to. The maximum string length in characters is 50. |
|
subnetId |
string ID of the subnet the cluster belongs to. This subnet should be a part of the cloud network the cluster belongs to (see Cluster.networkId). The maximum string length in characters is 50. |
|
assignPublicIp |
boolean Determines whether the cluster has a public IP address. After the cluster has been created, this setting cannot be changed. |
|
fullVersion |
string Full version |
TimeOfDay
Represents a time of day. The date and time zone are either not significant
or are specified elsewhere. An API may choose to allow leap seconds. Related
types are google.type.Date
|
Field |
Description |
|
hours |
integer (int32) Hours of day in 24 hour format. Should be from 0 to 23. An API may choose |
|
minutes |
integer (int32) Minutes of hour of day. Must be from 0 to 59. |
|
seconds |
integer (int32) Seconds of minutes of the time. Must normally be from 0 to 59. An API may |
|
nanos |
integer (int32) Fractions of seconds in nanoseconds. Must be from 0 to 999,999,999. |
Access
|
Field |
Description |
|
dataLens |
boolean Allows data export from the cluster to DataLens. |
|
webSql |
boolean Allows SQL queries to the cluster databases from the management console. |
|
dataTransfer |
boolean Allows access for DataTransfer. |
|
yandexQuery |
boolean Allow access for YandexQuery. |
Monitoring
Monitoring system metadata.
|
Field |
Description |
|
name |
string Name of the monitoring system. |
|
description |
string Description of the monitoring system. |
|
link |
string Link to the monitoring system charts for the Greenplum® cluster. |
MasterSubclusterConfig
|
Field |
Description |
|
resources |
Computational resources allocated to Greenplum® master subcluster hosts. |
Resources
|
Field |
Description |
|
resourcePresetId |
string ID of the preset for computational resources allocated to a host. Available presets are listed in the documentation. |
|
diskSize |
string (int64) Volume of the storage used by the host, in bytes. |
|
diskTypeId |
string Type of the storage used by the host: |
SegmentSubclusterConfig
|
Field |
Description |
|
resources |
Computational resources allocated to Greenplum® segment subcluster hosts. |
MaintenanceWindow
|
Field |
Description |
|
anytime |
object An any-time maintenance window. Includes only one of the fields |
|
weeklyMaintenanceWindow |
A weekly maintenance window. Includes only one of the fields |
WeeklyMaintenanceWindow
A weekly maintenance window.
|
Field |
Description |
|
day |
enum (WeekDay) Day of the week.
|
|
hour |
string (int64) Hour of the day in the UTC timezone. Acceptable values are 1 to 24, inclusive. |
MaintenanceOperation
|
Field |
Description |
|
info |
string The description of the operation. The maximum string length in characters is 256. |
|
delayedUntil |
string (date-time) Delay time for the maintenance operation. String in RFC3339 To work with values in this field, use the APIs described in the |
ClusterConfigSet
|
Field |
Description |
|
greenplumConfigSet_6 |
Includes only one of the fields |
|
pool |
Odyssey® pool settings. |
|
backgroundActivities |
Managed Greenplum® background tasks configuration. |
|
pxfConfig |
GreenplumConfigSet6
|
Field |
Description |
|
effectiveConfig |
Required field. Effective settings for a Greenplum (a combination of settings defined |
|
userConfig |
User-defined settings for a Greenplum. |
|
defaultConfig |
Default configuration for a Greenplum. |
GreenplumConfig6
|
Field |
Description |
|
maxConnections |
string (int64) Maximum number of inbound connections on master segment Acceptable values are 50 to 1000, inclusive. |
|
maxSlotWalKeepSize |
string (int64) Specify the maximum size of WAL files that replication slots are allowed to retain in the pg_wal directory at checkpoint time. Acceptable values are 0 to 214748364800, inclusive. |
|
gpWorkfileLimitPerSegment |
string (int64) Sets the maximum total disk size that all running queries are allowed to use for creating temporary spill files at each segment. The minimum value is 0. |
|
gpWorkfileLimitPerQuery |
string (int64) Sets the maximum disk size an individual query is allowed to use for creating temporary spill files at each segment. Acceptable values are 0 to 1099511627776, inclusive. |
|
gpWorkfileLimitFilesPerQuery |
string (int64) Sets the maximum number of temporary spill files (also known as workfiles) allowed per query per segment. Acceptable values are 0 to 100000, inclusive. |
|
maxPreparedTransactions |
string (int64) Sets the maximum number of transactions that can be in the "prepared" state simultaneously Acceptable values are 50 to 10000, inclusive. |
|
gpWorkfileCompression |
boolean Specifies whether the temporary files created, when a hash aggregation or hash join operation spills to disk, are compressed. |
|
maxStatementMem |
string (int64) Sets the maximum memory limit for a query. Helps avoid out-of-memory errors on a segment host during query processing as a result of setting statement_mem too high. Acceptable values are 134217728 to 1099511627776, inclusive. |
|
logStatement |
enum (LogStatement) Controls which SQL statements are logged. DDL logs all data definition commands like CREATE, ALTER, and DROP commands.
|
|
gpAddColumnInheritsTableSetting |
boolean https://docs.vmware.com/en/VMware-Tanzu-Greenplum/6/greenplum-database/GUID-ref_guide-config_params-guc-list.html#gp_add_column_inherits_table_setting |
|
gpEnableGlobalDeadlockDetector |
boolean Controls whether the Greenplum Database Global Deadlock Detector is enabled to manage concurrent UPDATE and DELETE operations on heap tables to improve performance. See Inserting, Updating, and Deleting Datain the Greenplum Database Administrator Guide. The default is off, the Global Deadlock Detector is deactivated. |
|
gpGlobalDeadlockDetectorPeriod |
string (int64) Specifies the executing interval (in seconds) of the global deadlock detector background worker process. |
|
gpMaxSlices |
string (int64) Max amount of slice-processes for one query in one segment. Acceptable values are 10 to 100, inclusive. |
|
gpCachedSegworkersThreshold |
string (int64) Define amount of working processes in segment, that keeping in warm cash after end of query for usage again in next queries. Acceptable values are 0 to 10, inclusive. |
|
lockTimeout |
string (int64) Max time (in ms) which query will wait lock free on object Acceptable values are 0 to 2147483647, inclusive. |
|
idleInTransactionSessionTimeout |
string (int64) Max time (in ms) which session can idle in open transaction Acceptable values are 0 to 2147483647, inclusive. |
|
runawayDetectorActivationPercent |
string (int64) Percent of utilized Greenplum Database vmem that triggers the termination of queries. Acceptable values are 0 to 100, inclusive. |
|
gpVmemProtectSegworkerCacheLimit |
string (int64) Set memory limit (in MB) for working process. If a query executor process consumes more than this configured amount, then the process will not be cached for use in subsequent queries after the process completes. Acceptable values are 0 to 4096, inclusive. |
|
gpEnableZstdMemoryAccounting |
boolean Forces ZSTD lib use Greenplum memory allocation system. |
|
gpMaxPlanSize |
string (int64) Specifies the total maximum uncompressed size of a query execution plan multiplied by the number of Motion operators (slices) in the plan. Acceptable values are 0 to 2147483647, inclusive. |
|
gpAutostatsMode |
enum (GPAutostatsMode) Specifies the mode for triggering automatic statistics collection after DML.
|
|
gpAutostatsOnChangeThreshold |
string (int64) Specifies the threshold for automatic statistics collection when gp_autostats_mode is set to on_change. Acceptable values are 0 to 2147483647, inclusive. |
|
gpResourceGroupMemoryLimit |
number (double) Identifies the maximum percentage of system memory resources to allocate to resource groups on each Greenplum Database segment node. |
|
logConnections |
boolean This outputs a line to the server log detailing each successful connection. Some client programs, like psql, |
|
logDisconnections |
boolean This outputs a line in the server log at termination of a client session, and includes the duration of the session. |
|
logHostname |
boolean By default, connection log messages only show the IP address of the connecting host. |
|
logStatementStats |
boolean For each query, write total performance statistics of the query parser, planner, and executor to the server log. |
|
logMinDurationStatement |
string (int64) Logs the statement and its duration on a single log line if its duration is greater than or equal |
|
masterSharedBuffers |
string (int64) Sets the amount of memory a Greenplum Database master instance uses for shared memory buffers. Acceptable values are 1048576 to 2147483647, inclusive. |
|
maxLocksPerTransaction |
string (int64) The shared lock table is created with room to describe locks on max_locks_per_transaction * (max_connections + max_prepared_transactions) objects, Acceptable values are 128 to 2048, inclusive. |
|
segmentSharedBuffers |
string (int64) Sets the amount of memory a Greenplum Database segment instance uses for shared memory buffers. Acceptable values are 1048576 to 2147483647, inclusive. |
|
logErrorVerbosity |
enum (LogErrorVerbosity) Controls the amount of detail written in the server log for each message that is logged.
|
|
logMinMessages |
enum (LogLevelMessage) Controls which message levels are written to the server log.
|
ConnectionPoolerConfigSet
|
Field |
Description |
|
effectiveConfig |
Required field. Effective settings for an Odyssey® pooler (a combination of settings defined in |
|
userConfig |
User-defined settings for an Odyssey® pooler. |
|
defaultConfig |
Default configuration for an Odyssey® pooler. |
ConnectionPoolerConfig
|
Field |
Description |
|
mode |
enum (PoolMode) Route server pool mode.
|
|
size |
string (int64) The number of servers in the server pool. Clients are placed in a wait queue when all servers are busy. Set to zero to disable the limit. |
|
clientIdleTimeout |
string (int64) Client pool idle timeout, in seconds. Drop stale client connection after this much seconds of idleness, which is not in transaction. Set to zero to disable. |
|
idleInTransactionTimeout |
string (int64) Client pool idle in transaction timeout, in seconds. Drop client connection in transaction after this much seconds of idleness. Set to zero to disable. |
BackgroundActivitiesConfig
Configuration for long running queries killer.
|
Field |
Description |
|
tableSizes |
Enables scripts that collects tables sizes to |
|
analyzeAndVacuum |
Configuration for |
|
queryKillerScripts |
Configuration for long running queries killer. |
TableSizes
Enables scripts that collects tables sizes to *_sizes tables in mdb_toolkit schema.
|
Field |
Description |
|
starts[] |
Time when start "table_sizes" script The maximum number of elements is 4. |
BackgroundActivityStartAt
Start time for background activity
|
Field |
Description |
|
hours |
string (int64) hours Acceptable values are 0 to 23, inclusive. |
|
minutes |
string (int64) minutes Acceptable values are 0 to 59, inclusive. |
AnalyzeAndVacuum
Configuration for ANALYZE and VACUUM operations.
|
Field |
Description |
|
start |
Time when analyze will start |
|
analyzeTimeout |
string (int64) Maximum duration of the Acceptable values are 7200 to 86399, inclusive. |
|
vacuumTimeout |
string (int64) Maximum duration of the Acceptable values are 7200 to 86399, inclusive. |
QueryKillerScripts
|
Field |
Description |
|
idle |
Configuration of script that kills long running queries that are in |
|
idleInTransaction |
Configuration of script that kills long running queries that are in |
|
longRunning |
Configuration of script that kills long running queries (in any state). |
QueryKiller
|
Field |
Description |
|
enable |
boolean Use query killer or not |
|
maxAge |
string (int64) Maximum duration for this type of queries (in seconds). Acceptable values are 1 to 86400, inclusive. |
|
ignoreUsers[] |
string Ignore these users when considering queries to terminate |
PXFConfigSet
|
Field |
Description |
|
effectiveConfig |
Required field. |
|
userConfig |
User-defined settings. |
|
defaultConfig |
Default configuration. |
PXFConfig
|
Field |
Description |
|
connectionTimeout |
string (int64) Timeout for connection to the Apache Tomcat® server when making read requests. Specify values in seconds. Acceptable values are 5 to 600, inclusive. |
|
uploadTimeout |
string (int64) Timeout for connection to the Apache Tomcat® server when making write requests. Specify the values in seconds. Acceptable values are 5 to 600, inclusive. |
|
maxThreads |
string (int64) Maximum number of the Apache Tomcat® threads. To prevent situations when requests get stuck or fail due to running out of memory or malfunctioning of the Java garbage collector, specify the number of the Apache Tomcat® threads. Learn more about adjusting the number of threads in the VMware Greenplum® Platform Extension Framework Acceptable values are 1 to 1024, inclusive. |
|
poolAllowCoreThreadTimeout |
boolean Determines whether the timeout for core streaming threads is permitted. |
|
poolCoreSize |
string (int64) Number of core streaming threads per pool. Acceptable values are 1 to 1024, inclusive. |
|
poolQueueCapacity |
string (int64) Maximum number of requests you can add to a pool queue for core streaming threads. If The minimum value is 0. |
|
poolMaxSize |
string (int64) Maximum allowed number of core streaming threads. Acceptable values are 1 to 1024, inclusive. |
|
xmx |
string (int64) Initial size, in megabytes, of the JVM heap for the PXF daemon. The minimum value is 64. |
|
xms |
string (int64) Maximum size, in megabytes, of the JVM heap for the PXF daemon. The minimum value is 64. |
CloudStorage
Cloud Storage Settings
|
Field |
Description |
|
enable |
boolean enable Cloud Storage for cluster |
LoggingConfig
|
Field |
Description |
|
enabled |
boolean |
|
folderId |
string Value must match the regular expression Includes only one of the fields |
|
logGroupId |
string Value must match the regular expression Includes only one of the fields |
|
commandCenterEnabled |
boolean send Yandex Command Center logs |
|
greenplumEnabled |
boolean send Greenplum logs |
|
poolerEnabled |
boolean send Pooler logs |