Installing Fluent Bit with a plugin for Cloud Logging
Fluent Bit
The plugin for Cloud Logging enables you to export logs generated in a Managed Service for Kubernetes cluster, including at the pod level, to Yandex Cloud Logging.
Getting started
-
If you do not have the Yandex Cloud command line interface yet, install and initialize it.
The folder specified in the CLI profile is used by default. You can specify a different folder using the
--folder-name
or--folder-id
parameter. -
Create a service account, which is required for Fluent Bit.
-
Assign the
logging.writer
andmonitoring.editor
roles to the service account. -
Create an authorized key for the service account and save it to the
sa-key.json
file. -
Make sure that the security groups for the Managed Service for Kubernetes cluster and its node groups are configured correctly. If any rule is missing, add it.
Warning
The configuration of security groups determines the performance and availability of the cluster and the services and applications running in it.
Installation using Yandex Cloud Marketplace
- Go to the folder page
and select Managed Service for Kubernetes. - Click the name of the Managed Service for Kubernetes cluster you need and select the
Marketplace tab. - Under Application available for installation, select Fluent Bit with a plugin for Cloud Logging and click Go to install.
- Configure the application:
- Namespace: Select a namespace or create a new one.
- Application name: Specify the app name.
- Target log group ID: Specify the ID of the log group to which Fluent Bit logs will be saved.
- Cluster ID: Specify the Managed Service for Kubernetes cluster ID.
- Service account key for Cloud Logging: Paste the contents of the
sa-key.json
file.
- Click Install.
- Wait for the application to change its status to
Deployed
.
Installation using a Helm chart
-
Install Helm
v3.8.0 or higher. -
Install kubectl
and configure it to work with the created cluster. -
To install a Helm chart
with Fluent Bit, run this command:cat sa-key.json | helm registry login cr.yandex --username 'json_key' --password-stdin && \ helm pull oci://cr.yandex/yc-marketplace/yandex-cloud/fluent-bit/fluent-bit \ --version 2.1.7-3 \ --untar && \ helm install \ --namespace <namespace> \ --create-namespace \ --set loggingGroupId=<log_group_ID> \ --set loggingFilter=<cluster_ID> \ --set-file auth.json=sa-key.json \ fluentbit ./fluent-bit/
This command also creates a new namespace required for Fluent Bit.
Note
If you are using a Helm version below 3.8.0, append the
export HELM_EXPERIMENTAL_OCI=1 && \
string to the command to enable Open Container Initiative (OCI) support in the Helm client.