Managing the internal container image registry

The ability to use internal registry is implemented by the registry module.

The internal registry allows for optimizing the downloading and storage of images, as well as helping to ensure availability and fault tolerance for Deckhouse Kubernetes Platform.

Modes of operation with the internal registry

The registry module, which implements internal storage, operates in the following modes:

• Direct — enables the internal container image registry. Access to the internal registry is performed via the fixed address registry.d8-system.svc:5001/system/deckhouse. This fixed address allows Deckhouse images to avoid being re-downloaded and components to avoid being restarted when registry parameters change. Switching between modes and registries is done through the deckhouse ModuleConfig. The switching process is automatic (for more details, see the switching examples below) for more information. The architecture of the mode is described in the section Direct Mode Architecture.

• Unmanaged — operation without using an internal registry. Access within the cluster is performed via an address that can be set during the cluster installation or changed in a deployed cluster.

Restrictions on working with the internal registry

Working with the internal registry using the registry module has a number of limitations and restrictions concerning installation, operating conditions, and mode switching.

Cluster installation limitations

Bootstrapping a DKP cluster with Direct mode enabled is not supported. The cluster is deployed with settings for Unmanaged mode.

Operating conditions restrictions

The module works under the following conditions:

• If CRI containerd or containerd v2 is used on the cluster nodes. To configure CRI, refer to the ClusterConfiguration configuration.
• The cluster is fully managed by DKP. The module will not work in Managed Kubernetes clusters.

Mode switching restrictions

Mode switching restrictions are as follows:

• Switching to Direct mode is possible if there are no user registry configurations on the nodes.
• Switching to Unmanaged mode is only available from Direct mode.
• In Unmanaged mode, changing registry settings is not supported. To change settings, you need to switch to Direct mode, make the necessary changes, and then switch back to Unmanaged mode.

Examples of switching

Switching to Direct Mode

To switch an already running cluster to Direct mode, follow these steps:

1. If the cluster is running with containerd v1, you need to prepare custom containerd configuration.

2. Make sure all master nodes are in the Ready state and do not have the SchedulingDisabled status, using the following command:

   d8 k get nodes
   

   Example output:

   NAME       STATUS   ROLES                 ...
   master-0   Ready    control-plane,master  ...
   master-1   Ready    control-plane,master  ...
   master-2   Ready    control-plane,master  ...
   

   Example of output when the master node (master-2 in the example) is in the SchedulingDisabled status:

   NAME       STATUS                      ROLES                 ...
   master-0   Ready    control-plane,master  ...
   master-1   Ready    control-plane,master  ...
   master-2   Ready,SchedulingDisabled    control-plane,master  ...
   

3. Make sure the registry module is enabled and running. To do this, execute the following command:

   d8 k get module registry -o wide
   

   Example output:

   NAME       WEIGHT ...  PHASE   ENABLED   DISABLED MESSAGE   READY
   registry   38     ...  Ready   True                         True
   

4. Set the Direct mode configuration in the ModuleConfig deckhouse. If you’re using a registry other than registry.deckhouse.io, refer to the deckhouse module documentation for correct configuration.

   Configuration example:

   apiVersion: deckhouse.io/v1alpha1
   kind: ModuleConfig
   metadata:
     name: deckhouse
   spec:
     version: 1
     enabled: true
     settings:
       registry:
         mode: Direct
         direct:
           imagesRepo: registry.deckhouse.io/deckhouse/ee
           scheme: HTTPS
           license: <LICENSE_KEY> # Replace with your license key
   

5. Check the registry switch status in the registry-state secret using this guide. Example output:

   conditions:
   # ...
     - lastTransitionTime: "..."
       message: ""
       reason: ""
       status: "True"
       type: Ready
   hash: ..
   mode: Direct
   target_mode: Direct
   

Switching to Unmanaged Mode

To switch the cluster to Unmanaged mode, follow these steps:

1. Make sure all master nodes are in the Ready state and do not have the SchedulingDisabled status, using the following command:

   d8 k get nodes
   

   Example output:

   NAME       STATUS   ROLES                 ...
   master-0   Ready    control-plane,master  ...
   master-1   Ready    control-plane,master  ...
   master-2   Ready    control-plane,master  ...
   

   Example of output when the master node (master-2 in the example) is in the SchedulingDisabled status:

   NAME       STATUS                      ROLES                 ...
   master-0   Ready    control-plane,master  ...
   master-1   Ready    control-plane,master  ...
   master-2   Ready,SchedulingDisabled    control-plane,master  ...
   

2. Ensure that the registry module is running in Direct mode and the switch status to Direct is Ready. You can verify the state via the registry-state secret using this guide. Example output:

   conditions:
   # ...
     - lastTransitionTime: "..."
       message: ""
       reason: ""
       status: "True"
       type: Ready
   hash: ..
   mode: Direct
   target_mode: Direct
   

3. Set the Unmanaged mode in the ModuleConfig deckhouse:

   apiVersion: deckhouse.io/v1alpha1
   kind: ModuleConfig
   metadata:
     name: deckhouse
   spec:
     version: 1
     enabled: true
     settings:
       registry:
         mode: Unmanaged
   

4. Check the registry switch status in the registry-state secret using this guide. Example output:

   conditions:
   # ...
     - lastTransitionTime: "..."
       message: ""
       reason: ""
       status: "True"
       type: Ready
   hash: ..
   mode: Unmanaged
   target_mode: Unmanaged
   

5. If you need to switch back to the previous containerd v1 auth configuration, refer to the instruction.

Preparation of containerd v1

When switching to the Direct mode, the Containerd V1 service will be restarted.
The authorization configuration will be switched to Mirror Auth (this configuration is used by default in containerd v2).
After switching back to Unmanaged, the updated authorization configuration will remain unchanged.

Example directory structure for Mirror Auth configuration:

tree /etc/containerd/registry.d
.
├── registry.d8-system.svc:5001
│   ├── ca.crt
│   └── hosts.toml
└── registry.deckhouse.ru
    ├── ca.crt
    └── hosts.toml

Example hosts.toml configuration:

[host]
  [host."https://registry.deckhouse.ru"]
    capabilities = ["pull", "resolve"]
    skip_verify = true
    ca = ["/path/to/ca.crt"]
    [host."https://registry.deckhouse.ru".auth]
      username = "username"
      password = "password"
      # If providing auth string:
      auth = "<base64>"

Before switching, make sure there are no custom authorization configurations present on nodes with containerd V1 in the /etc/containerd/conf.d directory.

If such configurations exist:

1. Create new Mirror Auth configurations in the /etc/containerd/registry.d directory. Example:

   apiVersion: deckhouse.io/v1alpha1
   kind: NodeGroupConfiguration
   metadata:
     name: custom-registry
   spec:
     bundles:
       - '*'
     content: |
       #!/bin/bash
       REGISTRY_ADDRESS="registry.io"
       REGISTRY_SCHEME="https"
       host_toml=$(cat <<EOF
       [host]
         [host."https://registry.deckhouse.ru"]
           capabilities = ["pull", "resolve"]
           skip_verify = true
           ca = ["/path/to/ca.crt"]
           [host."https://registry.deckhouse.ru".auth]
             username = "username"
             password = "password"
             # If providing auth string:
             auth = "<base64>"
       EOF
       )
       mkdir -p "/etc/containerd/registry.d/${REGISTRY_ADDRESS}"
       echo "$host_toml" > "/etc/containerd/registry.d/${REGISTRY_ADDRESS}/hosts.toml"
     nodeGroups:
       - '*'
     weight: 0
   

   To test the configuration:

   # HTTPS:
   ctr -n k8s.io images pull --hosts-dir=/etc/containerd/registry.d/ registry.io/registry/path:tag
   
   # HTTP:
   ctr -n k8s.io images pull --hosts-dir=/etc/containerd/registry.d/ --plain-http registry.io/registry/path:tag
   

2. Delete auth configurations from the /etc/containerd/conf.d directory.

Switch to the previous containerd v1 authorization configuration

1. Switch the registry mode to Unmanaged.

2. Check the switching status using this guide. Example output:

   conditions:
   # ...
   - lastTransitionTime: "..."
     message: ""
     reason: ""
     status: "True"
     type: Ready
   hash: ..
   mode: Unmanaged
   target_mode: Unmanaged
   

3. Delete the secret registry-bashible-config:

   d8 k -n d8-system delete secret registry-bashible-config
   

4. After deleting the secret, wait for the auth configuration to switch back to the legacy one in containerd v1.

   You can use this guide to track the switch. Example output:

   conditions:
   # ...
   - lastTransitionTime: "..."
     message: ""
     reason: ""
     status: "True"
     type: Ready
   hash: ..
   mode: Unmanaged
   target_mode: Unmanaged
   

Check registry mode switch status

The status of the registry mode switch can be retrieved using the following command:

d8 k -n d8-system -o yaml get secret registry-state | yq -C -P '.data | del .state | map_values(@base64d) | .conditions = (.conditions | from_yaml)'

Example output:

conditions:
  - lastTransitionTime: "2025-07-15T12:52:46Z"
    message: 'registry.deckhouse.ru: all 157 items are checked'
    reason: Ready
    status: "True"
    type: RegistryContainsRequiredImages
  - lastTransitionTime: "2025-07-11T11:59:03Z"
    message: ""
    reason: ""
    status: "True"
    type: ContainerdConfigPreflightReady
  - lastTransitionTime: "2025-07-15T12:47:47Z"
    message: ""
    reason: ""
    status: "True"
    type: TransitionContainerdConfigReady
  - lastTransitionTime: "2025-07-15T12:52:48Z"
    message: ""
    reason: ""
    status: "True"
    type: InClusterProxyReady
  - lastTransitionTime: "2025-07-15T12:54:53Z"
    message: ""
    reason: ""
    status: "True"
    type: DeckhouseRegistrySwitchReady
  - lastTransitionTime: "2025-07-15T12:55:48Z"
    message: ""
    reason: ""
    status: "True"
    type: FinalContainerdConfigReady
  - lastTransitionTime: "2025-07-15T12:55:48Z"
    message: ""
    reason: ""
    status: "True"
    type: Ready
mode: Direct
target_mode: Direct

The output displays the status of the switch process. Each condition can have a status of True or False, and may contain a message field with additional details.

Description of conditions: