Managed Kubernetes Service

Overview

The Managed Kubernetes Service offers a streamlined solution for efficiently managing server workloads. Kubernetes has emerged as the industry standard, providing a unified and accessible API, primarily utilizing YAML for configuration. This means that teams can easily understand and work with Kubernetes, streamlining infrastructure management.

The Kubernetes leverages robust software design patterns, enabling continuous recovery in any scenario through the reconciliation method. Additionally, it ensures seamless scaling across a multitude of servers, addressing the challenges posed by complex and outdated APIs found in traditional virtualization platforms. This managed service eliminates the need for developing custom solutions or modifying source code, saving valuable time and effort.

Deployment Details

The managed Kubernetes service deploys a standard Kubernetes cluster utilizing the Cluster API, Kamaji as control-plane provicer and the KubeVirt infrastructure provider. This ensures a consistent and reliable setup for workloads.

Within this cluster, users can take advantage of LoadBalancer services and easily provision physical volumes as needed. The control-plane operates within containers, while the worker nodes are deployed as virtual machines, all seamlessly managed by the application.

How-Tos

How to access to deployed cluster:

kubectl get secret -n <namespace> kubernetes-<clusterName>-admin-kubeconfig -o go-template='{{ printf "%s\n" (index .data "super-admin.conf" | base64decode) }}' > test

Parameters

Common parameters

NameDescriptionValue
hostThe hostname used to access the Kubernetes cluster externally (defaults to using the cluster name as a subdomain for the tenant host).""
controlPlane.replicasNumber of replicas for Kubernetes control-plane components2
storageClassStorageClass used to store user datareplicated
nodeGroupsnodeGroups configuration{}

Cluster Addons

NameDescriptionValue
addons.certManager.enabledEnables the cert-managerfalse
addons.certManager.valuesOverrideCustom values to override{}
addons.cilium.valuesOverrideCustom values to override{}
addons.gatewayAPI.enabledEnables the Gateway APIfalse
addons.ingressNginx.enabledEnable Ingress-NGINX controller (expect nodes with ‘ingress-nginx’ role)false
addons.ingressNginx.valuesOverrideCustom values to override{}
addons.ingressNginx.hostsList of domain names that should be passed through to the cluster by upper cluster[]
addons.gpuOperator.enabledEnables the gpu-operatorfalse
addons.gpuOperator.valuesOverrideCustom values to override{}
addons.fluxcd.enabledEnables Flux CDfalse
addons.fluxcd.valuesOverrideCustom values to override{}
addons.monitoringAgents.enabledEnables MonitoringAgents (fluentbit, vmagents for sending logs and metrics to storage) if tenant monitoring enabled, send to tenant storage, else to root storagefalse
addons.monitoringAgents.valuesOverrideCustom values to override{}
addons.verticalPodAutoscaler.valuesOverrideCustom values to override{}

Kubernetes control plane configuration

NameDescriptionValue
controlPlane.apiServer.resourcesPresetSet container resources according to one common preset (allowed values: none, nano, micro, small, medium, large, xlarge, 2xlarge). This is ignored if resources is set (resources is recommended for production).small
controlPlane.apiServer.resourcesResources{}
controlPlane.controllerManager.resourcesResources{}
controlPlane.controllerManager.resourcesPresetSet container resources according to one common preset (allowed values: none, nano, micro, small, medium, large, xlarge, 2xlarge). This is ignored if resources is set (resources is recommended for production).micro
controlPlane.scheduler.resourcesPresetSet container resources according to one common preset (allowed values: none, nano, micro, small, medium, large, xlarge, 2xlarge). This is ignored if resources is set (resources is recommended for production).micro
controlPlane.scheduler.resourcesResources{}
controlPlane.konnectivity.server.resourcesPresetSet container resources according to one common preset (allowed values: none, nano, micro, small, medium, large, xlarge, 2xlarge). This is ignored if resources is set (resources is recommended for production).micro
controlPlane.konnectivity.server.resourcesResources{}

U Series

The U Series is quite neutral and provides resources for general purpose applications.

U is the abbreviation for “Universal”, hinting at the universal attitude towards workloads.

VMs of instance types will share physical CPU cores on a time-slice basis with other VMs.

U Series Characteristics

Specific characteristics of this series are:

  • Burstable CPU performance - The workload has a baseline compute performance but is permitted to burst beyond this baseline, if excess compute resources are available.
  • vCPU-To-Memory Ratio (1:4) - A vCPU-to-Memory ratio of 1:4, for less noise per node.

O Series

The O Series is based on the U Series, with the only difference being that memory is overcommitted.

O is the abbreviation for “Overcommitted”.

UO Series Characteristics

Specific characteristics of this series are:

  • Burstable CPU performance - The workload has a baseline compute performance but is permitted to burst beyond this baseline, if excess compute resources are available.
  • Overcommitted Memory - Memory is over-committed in order to achieve a higher workload density.
  • vCPU-To-Memory Ratio (1:4) - A vCPU-to-Memory ratio of 1:4, for less noise per node.

CX Series

The CX Series provides exclusive compute resources for compute intensive applications.

CX is the abbreviation of “Compute Exclusive”.

The exclusive resources are given to the compute threads of the VM. In order to ensure this, some additional cores (depending on the number of disks and NICs) will be requested to offload the IO threading from cores dedicated to the workload. In addition, in this series, the NUMA topology of the used cores is provided to the VM.

CX Series Characteristics

Specific characteristics of this series are:

  • Hugepages - Hugepages are used in order to improve memory performance.
  • Dedicated CPU - Physical cores are exclusively assigned to every vCPU in order to provide fixed and high compute guarantees to the workload.
  • Isolated emulator threads - Hypervisor emulator threads are isolated from the vCPUs in order to reduce emaulation related impact on the workload.
  • vNUMA - Physical NUMA topology is reflected in the guest in order to optimize guest sided cache utilization.
  • vCPU-To-Memory Ratio (1:2) - A vCPU-to-Memory ratio of 1:2.

M Series

The M Series provides resources for memory intensive applications.

M is the abbreviation of “Memory”.

M Series Characteristics

Specific characteristics of this series are:

  • Hugepages - Hugepages are used in order to improve memory performance.
  • Burstable CPU performance - The workload has a baseline compute performance but is permitted to burst beyond this baseline, if excess compute resources are available.
  • vCPU-To-Memory Ratio (1:8) - A vCPU-to-Memory ratio of 1:8, for much less noise per node.

RT Series

The RT Series provides resources for realtime applications, like Oslat.

RT is the abbreviation for “realtime”.

This series of instance types requires nodes capable of running realtime applications.

RT Series Characteristics

Specific characteristics of this series are:

  • Hugepages - Hugepages are used in order to improve memory performance.
  • Dedicated CPU - Physical cores are exclusively assigned to every vCPU in order to provide fixed and high compute guarantees to the workload.
  • Isolated emulator threads - Hypervisor emulator threads are isolated from the vCPUs in order to reduce emaulation related impact on the workload.
  • vCPU-To-Memory Ratio (1:4) - A vCPU-to-Memory ratio of 1:4 starting from the medium size.

Resources

The following instancetype resources are provided by Cozystack:

NamevCPUsMemory
cx1.2xlarge816Gi
cx1.4xlarge1632Gi
cx1.8xlarge3264Gi
cx1.large24Gi
cx1.medium12Gi
cx1.xlarge48Gi
gn1.2xlarge832Gi
gn1.4xlarge1664Gi
gn1.8xlarge32128Gi
gn1.xlarge416Gi
m1.2xlarge864Gi
m1.4xlarge16128Gi
m1.8xlarge32256Gi
m1.large216Gi
m1.xlarge432Gi
n1.2xlarge1632Gi
n1.4xlarge3264Gi
n1.8xlarge64128Gi
n1.large48Gi
n1.medium44Gi
n1.xlarge816Gi
o1.2xlarge832Gi
o1.4xlarge1664Gi
o1.8xlarge32128Gi
o1.large28Gi
o1.medium14Gi
o1.micro11Gi
o1.nano1512Mi
o1.small12Gi
o1.xlarge416Gi
rt1.2xlarge832Gi
rt1.4xlarge1664Gi
rt1.8xlarge32128Gi
rt1.large28Gi
rt1.medium14Gi
rt1.micro11Gi
rt1.small12Gi
rt1.xlarge416Gi
u1.2xlarge832Gi
u1.2xmedium24Gi
u1.4xlarge1664Gi
u1.8xlarge32128Gi
u1.large28Gi
u1.medium14Gi
u1.micro11Gi
u1.nano1512Mi
u1.small12Gi
u1.xlarge416Gi