Working with Managed Service for PostgreSQL databases

This section covers the basics of working with Managed Service for PostgreSQL.

To start working with a Managed Service for PostgreSQL database, follow these steps:

1. Create a connection containing your database access credentials.
2. Run a query to the database.

Query example for reading data from Managed Service for PostgreSQL:

SELECT * FROM postgresql_mdb_connection.my_table

Where:

• postgresql_mdb_connection: Your database connection name.
• my_table: Database table name.

Setting up a connectionSetting up a connection

To create a connection to Managed Service for PostgreSQL:

1. In the management console, select the folder where you want to create a connection.

2. Navigate to Yandex Query.

3. In the left-hand panel, select Connections.

4. Click Create new.

5. Specify the connection settings:

   1. Under General parameters:

      • Name: Managed Service for PostgreSQL connection name.
      • Type: Managed Service for PostgreSQL.

   2. Under Connection type parameters:

      • Cluster: Select an existing Managed Service for PostgreSQL cluster or create a new one.

      • Service account: Select an existing Managed Service for PostgreSQL service account or create a new one. Assign it the managed-postgresql.viewer role allowing it to connect to Managed Service for PostgreSQL clusters.

        To use the service account on your behalf, you need the iam.serviceAccounts.user role.

      • Database: Select the database you will use to work with the PostgreSQL cluster.

      • Schema: Specify the namespace you will be using when working with the PostgreSQL database.

      • Login: Username for connecting to the PostgreSQL database.

      • Password: User password for connecting to the PostgreSQL database.

6. Click Create.

You need a service account to detect Managed Service for PostgreSQL cluster connection endpoints inside Yandex Cloud. To work with data, set a username and password separately.

Query syntaxQuery syntax

PostgreSQL uses the following SQL syntax:

SELECT * FROM <connection>.<table_name>

Where:

• <connection>: Your database connection name.
• <table_name>: Database table name.

LimitsLimits

Working with PostgreSQL clusters, the following restrictions apply:

1. External sources are available for read-only access via SELECT queries. Yandex Query does not currently support data-modifying queries against external sources.

2. YQ uses the Yandex Managed Service for YDB type system. However, the valid value ranges for YDB date and time types, i.e., Date, Datetime, and Timestamp, are often too narrow to accommodate the values of the corresponding PostgreSQL types, i.e., date and timestamp.
   Therefore, YQ returns date and time values read from PostgreSQL as plain strings (Optional<Utf8>) in ISO-8601 format.

Filter pushdownFilter pushdown

Yandex Query can push parts of query processing down to the source data system by sending filter expressions, e.g., WHERE conditions, directly to the database. This approach is known as filter pushdown.

Filter pushdown is possible when using:

Other filter types do not support source pushdown: the external table rows are filtered on the federated Yandex Query side, i.e., Yandex Query will perform a full scan of the external table when processing the query.

Supported data types for filter pushdown:

Supported data typesSupported data types

In PostgreSQL databases, the column nullability flag, i.e., whether or not the column can contain NULL values, is not part of the type system. The NOT NULL constraint for each column is implemented via an attnotnull attribute in the pg_attribute system catalog, i.e., at the table metadata level. Therefore, all PostgreSQL base types may contain NULL values by default, and within the YQ type system they must be mapped to optional types.

The table below shows the mapping of PostgreSQL types to Yandex Query types. Only the listed types are supported.