Managed Service for ClickHouse API, gRPC: ClusterService.ListExternalDictionaries

Written by

Updated at October 17, 2024

gRPC request
ListClusterExternalDictionariesRequest
ListClusterExternalDictionariesResponse
ExternalDictionary
Structure
Id
Key
Attribute
Layout
Range
HttpSource
Header
MysqlSource
Replica
ClickhouseSource
MongodbSource
PostgresqlSource

Retrieves a list of external dictionaries that belong to specified cluster.

gRPC request

rpc ListExternalDictionaries (ListClusterExternalDictionariesRequest) returns (ListClusterExternalDictionariesResponse)

ListClusterExternalDictionariesRequest

{
  "clusterId": "string",
  "pageSize": "int64",
  "pageToken": "string"
}

Field	Description
clusterId	string Required field. ID of the cluster that the external dictionaries belong to.
pageSize	int64 The maximum number of results per page to return. If the number of available results is larger than `pageSize`, the service returns a [ListClusterExternalDictionaryResponse.next_page_token] that can be used to get the next page of results in subsequent list requests.
pageToken	string Page token. To get the next page of results, set `pageToken` to the [ListClusterExternalDictionaryResponse.next_page_token] returned by a previous list request.

ListClusterExternalDictionariesResponse

{
  "externalDictionaries": [
    {
      "name": "string",
      "structure": {
        "id": {
          "name": "string"
        },
        "key": {
          "attributes": [
            {
              "name": "string",
              "type": "string",
              "nullValue": "string",
              "expression": "string",
              "hierarchical": "bool",
              "injective": "bool"
            }
          ]
        },
        "rangeMin": {
          "name": "string",
          "type": "string",
          "nullValue": "string",
          "expression": "string",
          "hierarchical": "bool",
          "injective": "bool"
        },
        "rangeMax": {
          "name": "string",
          "type": "string",
          "nullValue": "string",
          "expression": "string",
          "hierarchical": "bool",
          "injective": "bool"
        },
        "attributes": [
          {
            "name": "string",
            "type": "string",
            "nullValue": "string",
            "expression": "string",
            "hierarchical": "bool",
            "injective": "bool"
          }
        ]
      },
      "layout": {
        "type": "Type",
        "sizeInCells": "int64",
        "maxArraySize": "int64"
      },
      // Includes only one of the fields `fixedLifetime`, `lifetimeRange`
      "fixedLifetime": "int64",
      "lifetimeRange": {
        "min": "int64",
        "max": "int64"
      },
      // end of the list of possible fields
      // Includes only one of the fields `httpSource`, `mysqlSource`, `clickhouseSource`, `mongodbSource`, `postgresqlSource`
      "httpSource": {
        "url": "string",
        "format": "string",
        "headers": [
          {
            "name": "string",
            "value": "string"
          }
        ]
      },
      "mysqlSource": {
        "db": "string",
        "table": "string",
        "port": "int64",
        "user": "string",
        "password": "string",
        "replicas": [
          {
            "host": "string",
            "priority": "int64",
            "port": "int64",
            "user": "string",
            "password": "string"
          }
        ],
        "where": "string",
        "invalidateQuery": "string",
        "closeConnection": "google.protobuf.BoolValue",
        "shareConnection": "google.protobuf.BoolValue"
      },
      "clickhouseSource": {
        "db": "string",
        "table": "string",
        "host": "string",
        "port": "int64",
        "user": "string",
        "password": "string",
        "where": "string",
        "secure": "google.protobuf.BoolValue"
      },
      "mongodbSource": {
        "db": "string",
        "collection": "string",
        "host": "string",
        "port": "int64",
        "user": "string",
        "password": "string",
        "options": "string"
      },
      "postgresqlSource": {
        "db": "string",
        "table": "string",
        "hosts": [
          "string"
        ],
        "port": "int64",
        "user": "string",
        "password": "string",
        "invalidateQuery": "string",
        "sslMode": "SslMode"
      }
      // end of the list of possible fields
    }
  ],
  "nextPageToken": "string"
}

Field

Description

externalDictionaries[]

ExternalDictionary

List of ClickHouse Cluster external dictionaries.

nextPageToken

string

This token allows you to get the next page of results for list requests. If the number of results
is larger than [ListClusterExternalDictionaryRequest.page_size], use the nextPageToken as the value
for the [ListClusterExternalDictionaryRequest.page_token] parameter in the next list request. Each subsequent
list request will have its own nextPageToken to continue paging through the results.

ExternalDictionary

Field	Description
name	string Required field. Name of the external dictionary.
structure	Structure Required field. Set of attributes for the external dictionary. For in-depth description, see ClickHouse documentation.
layout	Layout Required field. Layout for storing the dictionary in memory. For in-depth description, see ClickHouse documentation.
fixedLifetime	int64 Fixed interval between dictionary updates. Includes only one of the fields `fixedLifetime`, `lifetimeRange`. Setting for the period of time between dictionary updates. For details, see ClickHouse documentation.
lifetimeRange	Range Range of intervals between dictionary updates for ClickHouse to choose from. Includes only one of the fields `fixedLifetime`, `lifetimeRange`. Setting for the period of time between dictionary updates. For details, see ClickHouse documentation.
httpSource	HttpSource HTTP source for the dictionary. Includes only one of the fields `httpSource`, `mysqlSource`, `clickhouseSource`, `mongodbSource`, `postgresqlSource`. Description of the source for the external dictionary.
mysqlSource	MysqlSource MySQL source for the dictionary. Includes only one of the fields `httpSource`, `mysqlSource`, `clickhouseSource`, `mongodbSource`, `postgresqlSource`. Description of the source for the external dictionary.
clickhouseSource	ClickhouseSource ClickHouse source for the dictionary. Includes only one of the fields `httpSource`, `mysqlSource`, `clickhouseSource`, `mongodbSource`, `postgresqlSource`. Description of the source for the external dictionary.
mongodbSource	MongodbSource MongoDB source for the dictionary. Includes only one of the fields `httpSource`, `mysqlSource`, `clickhouseSource`, `mongodbSource`, `postgresqlSource`. Description of the source for the external dictionary.
postgresqlSource	PostgresqlSource PostgreSQL source for the dictionary. Includes only one of the fields `httpSource`, `mysqlSource`, `clickhouseSource`, `mongodbSource`, `postgresqlSource`. Description of the source for the external dictionary.

Structure

Field	Description
id	Id Single numeric key column for the dictionary.
key	Key Composite key for the dictionary, containing of one or more key columns. For details, see ClickHouse documentation.
rangeMin	Attribute Field holding the beginning of the range for dictionaries with `RANGE_HASHED` layout. For details, see ClickHouse documentation.
rangeMax	Attribute Field holding the end of the range for dictionaries with `RANGE_HASHED` layout. For details, see ClickHouse documentation.
attributes[]	Attribute Description of the fields available for database queries. For details, see ClickHouse documentation.

Id

Numeric key.

Field

Description

name

string

Required field. Name of the numeric key.

Key

Complex key.

Field

Description

attributes[]

Attribute

Attributes of a complex key.

Attribute

Field	Description
name	string Required field. Name of the column.
type	string Required field. Type of the column.
nullValue	string Default value for an element without data (for example, an empty string).
expression	string Expression, describing the attribute, if applicable.
hierarchical	bool Indication of hierarchy support. Default value: `false`.
injective	bool Indication of injective mapping "id -> attribute". Default value: `false`.

Layout

Layout determining how to store the dictionary in memory.

Field	Description
type	enum Type Required field. Layout type for an external dictionary. `TYPE_UNSPECIFIED` `FLAT`: The entire dictionary is stored in memory in the form of flat arrays. Available for all dictionary sources. `HASHED`: The entire dictionary is stored in memory in the form of a hash table. Available for all dictionary sources. `COMPLEX_KEY_HASHED`: Similar to HASHED, to be used with composite keys. Available for all dictionary sources. `RANGE_HASHED`: The entire dictionary is stored in memory in the form of a hash table, with an ordered array of ranges and their corresponding values. Available for all dictionary sources. `CACHE`: The dictionary is stored in a cache with a set number of cells. Available for MySQL, ClickHouse and HTTP dictionary sources. `COMPLEX_KEY_CACHE`: Similar to CACHE, to be used with composite keys. Available for MySQL, ClickHouse and HTTP dictionary sources.
sizeInCells	int64 Number of cells in the cache. Rounded up to a power of two. Applicable only for CACHE and COMPLEX_KEY_CACHE layout types.
maxArraySize	int64 Maximum dictionary key size. Applicable only for FLAT layout type.

Range

Field

Description

min

int64

Minimum dictionary lifetime.

max

int64

Maximum dictionary lifetime.

HttpSource

Field	Description
url	string Required field. URL of the source dictionary available over HTTP.
format	string Required field. The data format. Valid values are all formats supported by ClickHouse SQL dialect.
headers[]	Header HTTP headers.

Field

Description

name

string

Required field.

value

string

Required field.

MysqlSource

Field	Description
db	string Required field. Name of the MySQL database to connect to.
table	string Required field. Name of the database table to use as a ClickHouse dictionary.
port	int64 Default port to use when connecting to a replica of the dictionary source.
user	string Name of the default user for replicas of the dictionary source.
password	string Password of the default user for replicas of the dictionary source.
replicas[]	Replica List of MySQL replicas of the database used as dictionary source.
where	string Selection criteria for the data in the specified MySQL table.
invalidateQuery	string Query for checking the dictionary status, to pull only updated data. For more details, see ClickHouse documentation on dictionaries.
closeConnection	google.protobuf.BoolValue Should the connection be closed after each request.
shareConnection	google.protobuf.BoolValue Should a connection be shared for some requests.

Replica

Field	Description
host	string Required field. MySQL host of the replica.
priority	int64 Required field. The priority of the replica that ClickHouse takes into account when connecting. Replica with the highest priority should have this field set to the lowest number.
port	int64 Port to use when connecting to the replica. If a port is not specified for a replica, ClickHouse uses the port specified for the source.
user	string Name of the MySQL database user.
password	string Password of the MySQL database user.

ClickhouseSource

Field	Description
db	string Required field. Name of the ClickHouse database.
table	string Required field. Name of the table in the specified database to be used as the dictionary source.
host	string ClickHouse host of the specified database.
port	int64 Port to use when connecting to the host.
user	string Required field. Name of the ClickHouse database user.
password	string Password of the ClickHouse database user.
where	string Selection criteria for the data in the specified ClickHouse table.
secure	google.protobuf.BoolValue Use ssl for connection.

MongodbSource

Field	Description
db	string Required field. Name of the MongoDB database.
collection	string Required field. Name of the collection in the specified database to be used as the dictionary source.
host	string MongoDB host of the specified database.
port	int64 Port to use when connecting to the host.
user	string Required field. Name of the MongoDB database user.
password	string Password of the MongoDB database user.
options	string

PostgresqlSource

Field	Description
db	string Required field. Name of the PostrgreSQL database.
table	string Required field. Name of the table in the specified database to be used as the dictionary source.
hosts[]	string Name of the PostrgreSQL host
port	int64 Port to use when connecting to the host.
user	string Required field. Name of the PostrgreSQL database user.
password	string Password of the PostrgreSQL database user.
invalidateQuery	string Query for checking the dictionary status, to pull only updated data. For more details, see ClickHouse documentation on dictionaries.
sslMode	enum SslMode Mode of SSL TCP/IP connection to the PostgreSQL host. For more details, see PostgreSQL documentation. `SSL_MODE_UNSPECIFIED` `DISABLE`: Only try a non-SSL connection. `ALLOW`: First try a non-SSL connection; if that fails, try an SSL connection. `PREFER`: First try an SSL connection; if that fails, try a non-SSL connection. `VERIFY_CA`: Only try an SSL connection, and verify that the server certificate is issued by a trusted certificate authority (CA). `VERIFY_FULL`: Only try an SSL connection, verify that the server certificate is issued by a trusted CA and that the requested server host name matches that in the certificate.

Managed Service for ClickHouse API, gRPC: ClusterService.ListExternalDictionaries

gRPC requestgRPC request

ListClusterExternalDictionariesRequestListClusterExternalDictionariesRequest

ListClusterExternalDictionariesResponseListClusterExternalDictionariesResponse

ExternalDictionaryExternalDictionary

StructureStructure

IdId

KeyKey

AttributeAttribute

LayoutLayout

RangeRange

HttpSourceHttpSource

HeaderHeader

MysqlSourceMysqlSource

ReplicaReplica

ClickhouseSourceClickhouseSource

MongodbSourceMongodbSource

PostgresqlSourcePostgresqlSource

Was the article helpful?

gRPC request

ListClusterExternalDictionariesRequest

ListClusterExternalDictionariesResponse

ExternalDictionary

Structure

Id

Key

Attribute

Layout

Range

HttpSource

Header

MysqlSource

Replica

ClickhouseSource

MongodbSource

PostgresqlSource