Deckhouse provides a built-in solution for short-term log storage based on the Grafana Loki project.

The storage is deployed in the cluster and integrated with the log collection system. After configuring the resources ClusterLoggingConfig, PodLoggingConfig and ClusterLogDestination, logs are automatically collected from all system components. The configured storage is added to Grafana as a data source for visualization and analysis.

Log collection from user applications is configured separately.

Short-term storage parameters are set in the loki module settings. It is possible to configure disk size and retention period, set the StorageClass to use and resources.

Short-term storage based on Grafana Loki does not support high availability mode. Use external storage for long-term storage of important logs.

Integration with Grafana Cloud

To configure Deckhouse to work with the Grafana Cloud platform, follow these steps:

  1. Create a Grafana Cloud API access key.

  2. Encode the Grafana Cloud access token in Base64 format:

    Grafana Cloud API key

    echo -n "<YOUR-GRAFANACLOUD-TOKEN>" | base64 -w0

  3. Create a ClusterLogDestination resource, following the example:

    apiVersion: deckhouse.io/v1alpha1
kind: ClusterLogDestination
metadata:
  name: loki-storage
spec:
  loki:
    auth:
      password: PFlPVVItR1JBRkFOQUNMT1VELVRPS0VOPg==
      strategy: Basic
      user: "<YOUR-GRAFANACLOUD-USERNAME>"
    endpoint: <YOUR-GRAFANACLOUD-URL> # For example https://logs-prod-us-central1.grafana.net or https://logs-prod-eu-west-0.grafana.net
  type: Loki

Migration from Grafana Promtail

To migrate from Promtail, edit the Loki URL by removing the /loki/api/v1/push path from it.

The Vector logging agent used in Deckhouse will automatically add this path when sending data to Loki.