Docker not working related to recent update ?

oly

Hitting issues with my local docker, after much pain I tried running a simple image but it seems even hello world no long works, any ideas on why this may be ?

docker run --rm hello-world

Gives me this error

docker: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error setting cgroup config for procHooks process: bpf_prog_query(BPF_CGROUP_DEVICE) failed: invalid argument: unknown.

kyrios

Ping @ReillyBrogan

oly

After trying on a nearly identical laptop, same model both completely updated only one is hitting this issue I am unsure as to why though, so still after any advice anyone can give ?

ReillyBrogan

Please run the following and reply with the output:
docker version
docker info
sudo journalctl -u docker.service -b --no-pager

oly

Thanks ReillyBrogan I just this second figured it out, at boot i was using a lts kernel 1.14 something I think using the very latest non lts and it works, guess the lt does not have a feature needed enabled .

ReillyBrogan

I had a feeling it would be a linux-lts issue. Any chance you could reboot back into the LTS kernel and still give me the output of those commands? I'll need to fix the docker packages anyway since they need to work on linux-lts as well.

ReillyBrogan

Also, this did used to work right? Before you updated after the most recent sync?

oly

It definately ran in the past but I dont tend to use docker that often on this machine so I could not be certain when I last used it, the details you asked for are below in order hope it helps 🙂

Client:
 Version:           20.10.13-ce
 API version:       1.41
 Go version:        go1.17.8
 Git commit:        906f57ff5b7100013dfef066ea8fe367706468df
 Built:             Sun Mar 20 18:30:51 2022
 OS/Arch:           linux/amd64
 Context:           default
 Experimental:      true

Server:
 Engine:
  Version:          20.10.13-ce
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.17.8
  Git commit:       906f57ff5b7100013dfef066ea8fe367706468df
  Built:            Sun Mar 20 18:30:11 2022
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          v1.6.1
  GitCommit:        10f428dac7cec44c864e1b830a4623af27a9fc70
 runc:
  Version:          1.1.0
  GitCommit:        
 docker-init:
  Version:          0.19.0
  GitCommit:

Client:
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc., v0.8.0)

Server:
 Containers: 4
  Running: 0
  Paused: 0
  Stopped: 4
 Images: 5
 Server Version: 20.10.13-ce
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: systemd
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 io.containerd.runtime.v1.linux runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 10f428dac7cec44c864e1b830a4623af27a9fc70
 runc version: 
 init version: 
 Security Options:
  apparmor
  cgroupns
 Kernel Version: 4.14.246-178.lts
 Operating System: Solus 4.3 Fortitude
 OSType: linux
 Architecture: x86_64
 CPUs: 8
 Total Memory: 15.46GiB
 Name: fry
 ID: YPZA:KCAK:GCJA:K7AE:BLI5:6WS5:CH52:I6GR:KFRT:L7VY:PTPD:O3W7
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Username: olymk2
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false

WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
WARNING: No cpu shares support
WARNING: No cpuset support

Mar 30 20:59:35 fry systemd[1]: Starting Docker Application Container Engine...
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.526088160+01:00" level=info msg="Starting up"
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.530116230+01:00" level=info msg="libcontainerd: started new containerd process" pid=936
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.530169693+01:00" level=info msg="parsed scheme: \"unix\"" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.530178330+01:00" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.530426551+01:00" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.530451228+01:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35+01:00" level=warning msg="deprecated version : `1`, please switch to version `2`"
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.638264748+01:00" level=info msg="starting containerd" revision=10f428dac7cec44c864e1b830a4623af27a9fc70 version=v1.6.1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.654153587+01:00" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.654478517+01:00" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.655665002+01:00" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/4.14.246-178.lts\\n\"): skip plugin" type=io.containerd.snapshotter.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.655691977+01:00" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.655851244+01:00" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.655868065+01:00" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.655884984+01:00" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.655898458+01:00" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.656192606+01:00" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.656418898+01:00" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.656933844+01:00" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.656950301+01:00" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.656974421+01:00" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.656990604+01:00" level=info msg="metadata content store policy set" policy=shared
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.658834213+01:00" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.658854400+01:00" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.658880903+01:00" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.658925959+01:00" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.658944502+01:00" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.658963740+01:00" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.658984757+01:00" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.659025370+01:00" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.659058799+01:00" level=info msg="loading plugin \"io.containerd.service.v1.leases-service\"..." type=io.containerd.service.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.659075772+01:00" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.659092056+01:00" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.659107903+01:00" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.659183109+01:00" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.659243956+01:00" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661015318+01:00" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661068540+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661222276+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661307569+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661320385+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661330596+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661339500+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661349092+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661358528+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661367573+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661376300+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661393974+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661877805+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661891395+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661901397+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661910208+01:00" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661921400+01:00" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="no OpenTelemetry endpoint: skip plugin" type=io.containerd.tracing.processor.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661933052+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.661950304+01:00" level=error msg="failed to initialize a tracing processor \"otlp\"" error="no OpenTelemetry endpoint: skip plugin"
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.662100443+01:00" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.662162912+01:00" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.662199225+01:00" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock
Mar 30 20:59:35 fry dockerd[936]: time="2022-03-30T20:59:35.662210700+01:00" level=info msg="containerd successfully booted in 0.026079s"
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.670336259+01:00" level=info msg="parsed scheme: \"unix\"" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.670355517+01:00" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.670369293+01:00" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.670378610+01:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.672296797+01:00" level=info msg="parsed scheme: \"unix\"" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.672314454+01:00" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.672327408+01:00" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.672339153+01:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.719754883+01:00" level=info msg="[graphdriver] using prior storage driver: overlay2"
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.773834977+01:00" level=warning msg="Unable to find cpu controller"
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.773850419+01:00" level=warning msg="Unable to find cpuset controller"
Mar 30 20:59:35 fry dockerd[704]: time="2022-03-30T20:59:35.774298543+01:00" level=info msg="Loading containers: start."
Mar 30 20:59:36 fry dockerd[704]: time="2022-03-30T20:59:36.117905929+01:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Mar 30 20:59:36 fry dockerd[704]: time="2022-03-30T20:59:36.888549897+01:00" level=info msg="Loading containers: done."
Mar 30 20:59:36 fry dockerd[704]: time="2022-03-30T20:59:36.956165963+01:00" level=info msg="Docker daemon" commit=906f57ff5b7100013dfef066ea8fe367706468df graphdriver(s)=overlay2 version=20.10.13-ce
Mar 30 20:59:36 fry dockerd[704]: time="2022-03-30T20:59:36.957312502+01:00" level=info msg="Daemon has completed initialization"
Mar 30 20:59:36 fry systemd[1]: Started Docker Application Container Engine.
Mar 30 20:59:36 fry dockerd[704]: time="2022-03-30T20:59:36.977281308+01:00" level=info msg="API listen on /run/docker.sock"

ReillyBrogan

I did some research into this, and it turns out that runc (the component of the Docker daemon that does all the actual work of creating containers in the host OS) requires kernels >= 4.15 in order to support cgroup v2 (linux-lts currently is on the 4.14 kernel series). Searching around the dev site it appears that switching back to pure cgroup v1 (with the kernel parameter systemd.unified_cgroup_hierarchy=0) will break at the very least snapd and is not supported on Solus.

Therefore it is currently impossible for us to support Docker for users running linux-lts, though this situation is going to improve when we update linux-lts to a newer LTS series. As far as I can tell Docker hasn't worked on linux-lts since March of 2021.