S3cmd

S3cmd is a console client (Linux, Mac) for services that support the Amazon S3 HTTP API. The general procedure for running commands can be found in the official s3cmd documentation.

Getting startedGetting started

1. Create a service account.
2. Assign the service account the roles required for your project. For more information about roles, see the Identity and Access Management documentation.
3. Create a static access key.

InstallationInstallation

To install S3cmd, check out the installation section in the S3cmd repository on GitHub.

SetupSetup

To configure S3cmd, use the s3cmd --configure command. For a query, specify values for the following parameters:

1. Access Key: Enter the ID of the key you received when generating the static key.

2. Secret Key: Enter the secret key you received when generating the static key.

3. Set Default Region to ru-central1.

   To work with Object Storage, always specify ru-central1 as the region. A different region value may lead to an authorization error.

4. Set S3 Endpoint to storage.yandexcloud.net.

5. Set DNS-style bucket+hostname:port template for accessing a bucket to %(bucket)s.storage.yandexcloud.net.

6. Leave the other parameter values unchanged.

The program will try to establish a connection with Object Storage and get a list of buckets. If successful, it will display Success. Your access key and secret key worked fine :-).

The s3cmd --configure command will save the settings in a ~/.s3cfg file in the following format:

[default]
access_key = id
secret_key = secretKey
bucket_location = ru-central1
host_base = storage.yandexcloud.net
host_bucket = %(bucket)s.storage.yandexcloud.net

If necessary, you can change these settings directly in the file. You can also specify settings when launching the client by using the appropriate parameters.

For the static website hosting control commands to work correctly, manually add the following parameter to the configuration file:

website_endpoint = http://%(bucket)s.website.yandexcloud.net

Things to considerThings to consider

• S3cmd treats Object Storage as a hierarchical file system and object keys look like file paths.
• By default, S3cmd uploads objects to standard storage. To specify the storage class when uploading an object, use the --storage-class key.
• By default, when uploading an object, S3cmd can send the additional X-Amz-Meta-S3cmd-Attrs header with the attributes of your file (access permissions, file owners, timestamps). The header value is saved in the metadata of the object. You can disable the sending of attributes using the preserve_attrs = False parameter in the ~/.s3cfg configuration file or using the --no-preserve key.

Examples of operationsExamples of operations

Getting a list of bucketsGetting a list of buckets

s3cmd ls

Create a bucketCreate a bucket

s3cmd mb s3://bucket

When creating a bucket, follow the naming conventions.

Uploading an object to cold storageUploading an object to cold storage

s3cmd --storage-class COLD put local_file s3://bucket/object

Getting a list of objectsGetting a list of objects

s3cmd ls s3://bucket

Retrieving an objectRetrieving an object

s3cmd get s3://bucket/object local_file

Deleting an objectDeleting an object

s3cmd del s3://bucket/object