-
Notifications
You must be signed in to change notification settings - Fork 18
Installation of cc-runtime with CRI-O for Kubernetes on Ubuntu works, but new pods error #945
Description
Problem
The ubuntu setup script (for Kubernetes) doesn't install libnuma (libnuma.so.1). NUMA stands for: Non Uniform Memory Access, and after (seemingly successful) installation, pods fail to start.
Pods will give errors like:
Warning FailedCreatePodSandBox 0s (x9 over 28s) kubelet, leaf3.myhost.com Failed create pod sandbox.
Steps to reproduce:
Follow the instructions here, on a clean Ubuntu 16:04 installation, and substituting the setup.sh with the one in /.ci/setup.sh as mentioned here.
On inspection of the logs of the kubelet journalctl -u kubelet -n 100 -f it appears the libnuma module cannot be found. Errors seen are like:
Mar 09 14:23:53 leaf3.myhost.com kubelet[1003]: E0309 14:23:53.276056 1003 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = container create failed: /usr/bin/qemu-lite-system-x86_64: error while loading shared libraries: libnuma.so.1: cannot open shared object file: No such file or directory
Proposed solution:
Add apt-get install libnuma1 to the install script on https://github.com/clearcontainers/tests/blob/master/.ci/setup_env_ubuntu.sh, possibly other distributions are also affected, but I have not tested anything but Ubuntu 16.04. This is on Packet.net
Environment:
go version go1.9.4 linux/amd64
root@leaf3:/etc/kubernetes# cc-runtime cc-env
[Meta]
Version = "1.0.9"
[Runtime]
Debug = false
[Runtime.Version]
Semver = "3.0.21"
Commit = "68570d9b895f07dd97c9606bc0f64433dcf89e5f"
OCI = "1.0.1"
[Runtime.Config]
Path = "/usr/share/defaults/clear-containers/configuration.toml"
[Hypervisor]
MachineType = "pc"
Version = "QEMU emulator version 2.7.0, Copyright (c) 2003-2016 Fabrice Bellard and the QEMU Project developers"
Path = "/usr/bin/qemu-lite-system-x86_64"
Debug = false
BlockDeviceDriver = "virtio-scsi"
[Image]
Path = "/usr/share/clear-containers/cc-20640-agent-6f6e9e.img"
[Kernel]
Path = "/usr/share/clear-containers/vmlinuz-4.14.22-86.container"
Parameters = ""
[Proxy]
Type = "ccProxy"
Version = "Version: 3.0.21-2d500edc813034b4a59a57bad72d55a36cc2e0da"
Path = "/usr/libexec/clear-containers/cc-proxy"
Debug = true
[Shim]
Type = "ccShim"
Version = "shim version: 3.0.21 (commit: c8f732c99484e947f18cf29ab0d3d26e3e6bfbfe)"
Path = "/usr/libexec/clear-containers/cc-shim"
Debug = true
[Agent]
Type = "hyperstart"
Version = "<>"
[Host]
Kernel = "4.4.0-112-generic"
Architecture = "amd64"
VMContainerCapable = true
[Host.Distro]
Name = "Ubuntu"
Version = "16.04"
[Host.CPU]
Vendor = "GenuineIntel"
Model = "Intel(R) Atom(TM) CPU C2550 @ 2.40GHz"