Creating an external HDFS data source

Written by

Updated at June 23, 2026

In Yandex MPP Analytics for PostgreSQL, you can use HDFS as part of Yandex Data Processing or other third-party HDFS services as an external data source with the HDFS connection type.

Create an external data source

Management console

REST API

gRPC API

Open the folder dashboard.
Navigate to Yandex MPP Analytics for PostgreSQL.
Open the page of the Yandex MPP Analytics for PostgreSQL cluster in question.
In the left-hand panel, select PXF.
Click Create data source.
Select the HDFS connection type.
Enter a source name.
Configure at least one optional setting.
Click Create.

Get an IAM token for API authentication and put it into an environment variable:
```
export IAM_TOKEN="<IAM_token>"
```

Call the PXFDatasource.Create method, e.g., via the following cURL request:

curl \
    --request POST \
    --header "Authorization: Bearer $IAM_TOKEN" \
    --header "Content-Type: application/json" \
    --url 'https://mdb.api.cloud.yandex.net/managed-greenplum/v1/clusters/<cluster_ID>/pxf_datasources' \
    --data '{
              "datasource": {
                "name": "<external_data_source_name>",
                "hdfs": {
                  "core": {
                    "defaultFs": "<storage_type>"
                  },
                  ...
                }
              }
            }'

Where:

name: External data source name.
hdfs: External data source settings. Configure at least one optional setting.

You can get the cluster ID with the list of clusters in the folder.

View the server response to make sure your request was successful.

Get an IAM token for API authentication and put it into an environment variable:
```
export IAM_TOKEN="<IAM_token>"
```
Clone the cloudapi repository:
```
cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapi
```
Below, we assume that the repository contents reside in the ~/cloudapi/ directory.

Call the PXFDatasourceService.Create method, e.g., via the following gRPCurl request:

grpcurl \
    -format json \
    -import-path ~/cloudapi/ \
    -import-path ~/cloudapi/third_party/googleapis/ \
    -proto ~/cloudapi/yandex/cloud/mdb/greenplum/v1/pxf_service.proto \
    -rpc-header "Authorization: Bearer $IAM_TOKEN" \
    -d '{
          "cluster_id": "<cluster_ID>"
          "datasource": {
            "name": "<external_data_source_name>",
            "hdfs": {
              "core": {
                "default_fs": "<storage_type>"
              },
              ...
            }
          }
        }' \
    mdb.api.cloud.yandex.net:443 \
    yandex.cloud.mdb.greenplum.v1.PXFDatasourceService.Create

Where:

name: External data source name.
hdfs: External data source settings. Configure at least one optional setting.

You can get the cluster ID with the list of clusters in the folder.

Check the server response to make sure your request was successful.

After you create an external data source, create an external table.

Creating an external HDFS data source

Create an external data sourceCreate an external data source

Was the article helpful?

Create an external data source