Getting started with Monium.Logs

Monium.Logs is a distributed and highly available system for storing, searching, visualizing, and analyzing logs. The system forms a part of Monium and makes use of its shared components, i.e., access management, data model, and unified interface.

Monium.Logs features:

• Monium currently only accepts OpenTelemetry (OTLP) data.

• You can write logs via the API in gRPC and HTTP formats.

• Address for writing logs: ingest.monium.yandex.cloud:443.

• To write logs, you will need a service account with the monium.logs.writer role and an API key.

• Log viewing interface: Monium home page > Logs.

Setting up loggingSetting up logging

Follow these steps to set up log transfer from your application to Monium.Logs through Unified Agent. The application will send logs in OTLP format to the local Unified Agent input, and the agent will collect the logs and deliver them to Monium. The application can be located either in your local infrastructure or in Yandex Cloud.

You also can set up log transfer through Fluent Bit or directly from the app. By using the agent, you separate the generation of logs and their delivery to the storage system. This approach removes the need for the application to write data to the storage system and prevents data loss in case of failures.

1. Create a service account with the monium.logs.writer role.

2. Create an API key for the service account.

3. Set up log transfer from your application in OTLP format:

   1. Install an SDK for relevant programming language.
   2. Set up log transfer to the address the agent will be listening to, e.g, localhost:8889.

4. Install Unified Agent.

5. Configure Unified Agent to listen to the app's logs and send them to Monium.

   Example configuration:

   storages:
      - name: logs_storage
      plugin: fs
      config:
          directory: /my/logs_storage
          max_partition_size: 1gb
   
   routes:
   - input:
      plugin: otel_logs
      config:
          port: 8889
   
      channel:
      pipe:
          - storage_ref:
              name: logs_storage
      output:
          plugin: otel_logs
          config:
          project: folder__<folder_ID>
          cluster: doc
   
          format: proto
          url: "ingest.monium.yandex.cloud:443"
   
          tvm:
              client_id: 2025442
              destination_id: 2045111
              secret:
              file: /my/secret/token
   

   In this configuration, Unified Agent will accept application logs in OpenTelemetry format at localhost:8889 and send them to the collector that writes logs from the 2025442 TVM application to the folder__<folder_ID> project.

   Unified Agent uses the otel_logs input to accept logs and the otel_logs output to transfer them.

6. Run your app and start sending logs.

Viewing logsViewing logs

1. On the Monium home page, select Logs on the left.
2. At the top, set the search interval using the timeline, a preset interval, or by entering the time value directly.
3. In the search bar, enter a query to search for application logs:
   1. Select the folder__<folder_ID> project. By default, the current folder's project is selected.
   2. Enter your query to search for application logs.
   3. Click Execute query.
4. To view logs for a specific entry, expand it.

See alsoSee also

• Getting started with Monium Traces
• Getting started with metrics in Monium