- JSON representation
- AcceleratorConfig
- GPUSharingConfig
- GPUSharingStrategy
- GPUDriverInstallationConfig
- GPUDriverVersion
- SandboxConfig
- Type
- ReservationAffinity
- Type
- WorkloadMetadataConfig
- NodeMetadata
- Mode
- NodeTaint
- Effect
- LinuxNodeConfig
- CgroupMode
- HugepagesConfig
- EphemeralStorageConfig
- AdvancedMachineFeatures
- VirtualNIC
- FastSocket
- WindowsNodeConfig
- OSVersion
- LocalNvmeSsdBlockConfig
- EphemeralStorageLocalSsdConfig
- SoleTenantConfig
- NodeAffinity
- Operator
- SecondaryBootDisk
- Mode
- SecondaryBootDiskUpdateStrategy
- EffectiveCgroupMode
Parameters that describe the nodes in a cluster.
GKE Autopilot clusters do not recognize parameters in NodeConfig
. Use AutoprovisioningNodePoolDefaults
instead.
JSON representation |
---|
{ "machineType": string, "diskSizeGb": integer, "oauthScopes": [ string ], "serviceAccount": string, "metadata": { string: string, ... }, "imageType": string, "labels": { string: string, ... }, "localSsdCount": integer, "tags": [ string ], "preemptible": boolean, "accelerators": [ { object ( |
Fields | |
---|---|
machineType |
The name of a Google Compute Engine machine type. If unspecified, the default machine type is |
diskSizeGb |
Size of the disk attached to each node, specified in GB. The smallest allowed disk size is 10GB. If unspecified, the default disk size is 100GB. |
oauthScopes[] |
The set of Google API scopes to be made available on all of the node VMs under the "default" service account. The following scopes are recommended, but not required, and by default are not included:
If unspecified, no scopes are added, unless Cloud Logging or Cloud Monitoring are enabled, in which case their required scopes will be added. |
serviceAccount |
The Google Cloud Platform Service Account to be used by the node VMs. Specify the email address of the Service Account; otherwise, if no Service Account is specified, the "default" service account is used. |
metadata |
The metadata key/value pairs assigned to instances in the cluster. Keys must conform to the regexp
Values are free-form strings, and only have meaning as interpreted by the image running in the instance. The only restriction placed on them is that each value's size must be less than or equal to 32 KB. The total size of all keys and values must be less than 512 KB. An object containing a list of |
imageType |
The image type to use for this node. Note that for a given image type, the latest version of it will be used. Please see https://cloud.google.com/kubernetes-engine/docs/concepts/node-images for available image types. |
labels |
The map of Kubernetes labels (key/value pairs) to be applied to each node. These will added in addition to any default label(s) that Kubernetes may apply to the node. In case of conflict in label keys, the applied set may differ depending on the Kubernetes version -- it's best to assume the behavior is undefined and conflicts should be avoided. For more information, including usage and the valid values, see: https://kubernetes.io/docs/concepts/overview/working-with-objects/labels/ An object containing a list of |
localSsdCount |
The number of local SSD disks to be attached to the node. The limit for this value is dependent upon the maximum number of disks available on a machine per zone. See: https://cloud.google.com/compute/docs/disks/local-ssd for more information. |
tags[] |
The list of instance tags applied to all nodes. Tags are used to identify valid sources or targets for network firewalls and are specified by the client during cluster or node pool creation. Each tag within the list must comply with RFC1035. |
preemptible |
Whether the nodes are created as preemptible VM instances. See: https://cloud.google.com/compute/docs/instances/preemptible for more information about preemptible VM instances. |
accelerators[] |
A list of hardware accelerators to be attached to each node. See https://cloud.google.com/compute/docs/gpus for more information about support for GPUs. |
sandboxConfig |
Sandbox configuration for this node. |
nodeGroup |
Setting this field will assign instances of this pool to run on the specified node group. This is useful for running workloads on sole tenant nodes. |
reservationAffinity |
The optional reservation affinity. Setting this field will apply the specified Zonal Compute Reservation to this node pool. |
diskType |
Type of the disk attached to each node (e.g. 'pd-standard', 'pd-ssd' or 'pd-balanced') If unspecified, the default disk type is 'pd-standard' |
minCpuPlatform |
Minimum CPU platform to be used by this instance. The instance may be scheduled on the specified or newer CPU platform. Applicable values are the friendly names of CPU platforms, such as |
workloadMetadataConfig |
The workload metadata configuration for this node. |
taints[] |
List of kubernetes taints to be applied to each node. For more information, including usage and the valid values, see: https://kubernetes.io/docs/concepts/configuration/taint-and-toleration/ |
bootDiskKmsKey |
The Customer Managed Encryption Key used to encrypt the boot disk attached to each node in the node pool. This should be of the form projects/[KEY_PROJECT_ID]/locations/[LOCATION]/keyRings/[RING_NAME]/cryptoKeys/[KEY_NAME]. For more information about protecting resources with Cloud KMS Keys please see: https://cloud.google.com/compute/docs/disks/customer-managed-encryption |
shieldedInstanceConfig |
Shielded Instance options. |
linuxNodeConfig |
Parameters that can be configured on Linux nodes. |
kubeletConfig |
Node kubelet configs. |
ephemeralStorageConfig |
Parameters for the ephemeral storage filesystem. If unspecified, ephemeral storage is backed by the boot disk. |
gcfsConfig |
GCFS (Google Container File System) configs. |
advancedMachineFeatures |
Advanced features for the Compute Engine VM. |
gvnic |
Enable or disable gvnic on the node pool. |
spot |
Spot flag for enabling Spot VM, which is a rebrand of the existing preemptible flag. |
confidentialNodes |
Confidential nodes config. All the nodes in the node pool will be Confidential VM once enabled. |
resourceLabels |
The resource labels for the node pool to use to annotate any related Google Compute Engine resources. An object containing a list of |
loggingConfig |
Logging configuration. |
windowsNodeConfig |
Parameters that can be configured on Windows nodes. |
localNvmeSsdBlockConfig |
Parameters for using raw-block Local NVMe SSDs. |
ephemeralStorageLocalSsdConfig |
Parameters for the node ephemeral storage using Local SSDs. If unspecified, ephemeral storage is backed by the boot disk. This field is functionally equivalent to the ephemeralStorageConfig |
soleTenantConfig |
Parameters for node pools to be backed by shared sole tenant node groups. |
containerdConfig |
Parameters for containerd customization. |
hostMaintenancePolicy |
HostMaintenancePolicy contains the desired maintenance policy for the Google Compute Engine hosts. |
resourceManagerTags |
A map of resource manager tag keys and values to be attached to the nodes. |
enableConfidentialStorage |
Optional. Reserved for future use. |
secondaryBootDisks[] |
List of secondary boot disks attached to the nodes. |
storagePools[] |
List of Storage Pools where boot disks are provisioned. |
effectiveCgroupMode |
Output only. effectiveCgroupMode is the cgroup mode actually used by the node pool. It is determined by the cgroup mode specified in the LinuxNodeConfig or the default cgroup mode based on the cluster creation version. |
fastSocket |
Enable or disable NCCL fast socket for the node pool. |
secondaryBootDiskUpdateStrategy |
Secondary boot disk update strategy. |
AcceleratorConfig
AcceleratorConfig represents a Hardware Accelerator request.
JSON representation |
---|
{ "acceleratorCount": string, "acceleratorType": string, "gpuPartitionSize": string, "maxTimeSharedClientsPerGpu": string, "gpuSharingConfig": { object ( |
Fields | |
---|---|
acceleratorCount |
The number of the accelerator cards exposed to an instance. |
acceleratorType |
The accelerator type resource name. List of supported accelerators here |
gpuPartitionSize |
Size of partitions to create on the GPU. Valid values are described in the NVIDIA mig user guide. |
maxTimeSharedClientsPerGpu |
The number of time-shared GPU resources to expose for each physical GPU. |
gpuSharingConfig |
The configuration for GPU sharing options. |
gpuDriverInstallationConfig |
The configuration for auto installation of GPU driver. |
GPUSharingConfig
GPUSharingConfig represents the GPU sharing configuration for Hardware Accelerators.
JSON representation |
---|
{
"maxSharedClientsPerGpu": string,
"gpuSharingStrategy": enum ( |
Fields | |
---|---|
maxSharedClientsPerGpu |
The max number of containers that can share a physical GPU. |
gpuSharingStrategy |
The type of GPU sharing strategy to enable on the GPU node. |
GPUSharingStrategy
The type of GPU sharing strategy currently provided.
Enums | |
---|---|
GPU_SHARING_STRATEGY_UNSPECIFIED |
Default value. |
TIME_SHARING |
GPUs are time-shared between containers. |
MPS |
GPUs are shared between containers with NVIDIA MPS. |
GPUDriverInstallationConfig
GPUDriverInstallationConfig specifies the version of GPU driver to be auto installed.
JSON representation |
---|
{
"gpuDriverVersion": enum ( |
Fields | |
---|---|
gpuDriverVersion |
Mode for how the GPU driver is installed. |
GPUDriverVersion
The GPU driver version to install.
Enums | |
---|---|
GPU_DRIVER_VERSION_UNSPECIFIED |
Default value is to not install any GPU driver. |
INSTALLATION_DISABLED |
Disable GPU driver auto installation and needs manual installation |
DEFAULT |
"Default" GPU driver in COS and Ubuntu. |
LATEST |
"Latest" GPU driver in COS. |
SandboxConfig
SandboxConfig contains configurations of the sandbox to use for the node.
JSON representation |
---|
{
"sandboxType": string,
"type": enum ( |
Fields | |
---|---|
sandboxType |
Type of the sandbox to use for the node (e.g. 'gvisor') |
type |
Type of the sandbox to use for the node. |
Type
Possible types of sandboxes.
Enums | |
---|---|
UNSPECIFIED |
Default value. This should not be used. |
GVISOR |
Run sandbox using gvisor. |
ReservationAffinity
ReservationAffinity is the configuration of desired reservation which instances could take capacity from.
JSON representation |
---|
{
"consumeReservationType": enum ( |
Fields | |
---|---|
consumeReservationType |
Corresponds to the type of reservation consumption. |
key |
Corresponds to the label key of a reservation resource. To target a SPECIFIC_RESERVATION by name, specify "compute.googleapis.com/reservation-name" as the key and specify the name of your reservation as its value. |
values[] |
Corresponds to the label value(s) of reservation resource(s). |
Type
Indicates whether to consume capacity from a reservation or not.
Enums | |
---|---|
UNSPECIFIED |
Default value. This should not be used. |
NO_RESERVATION |
Do not consume from any reserved capacity. |
ANY_RESERVATION |
Consume any reservation available. |
SPECIFIC_RESERVATION |
Must consume from a specific reservation. Must specify key value fields for specifying the reservations. |
WorkloadMetadataConfig
WorkloadMetadataConfig defines the metadata configuration to expose to workloads on the node pool.
JSON representation |
---|
{ "nodeMetadata": enum ( |
Fields | |
---|---|
nodeMetadata |
NodeMetadata is the configuration for how to expose metadata to the workloads running on the node. |
mode |
Mode is the configuration for how to expose metadata to workloads running on the node pool. |
NodeMetadata
NodeMetadata is the configuration for if and how to expose the node metadata to the workload running on the node.
Enums | |
---|---|
UNSPECIFIED |
Not set. |
SECURE |
Prevent workloads not in hostNetwork from accessing certain VM metadata, specifically kube-env, which contains Kubelet credentials, and the instance identity token. Metadata concealment is a temporary security solution available while the bootstrapping process for cluster nodes is being redesigned with significant security improvements. This feature is scheduled to be deprecated in the future and later removed. |
EXPOSE |
Expose all VM metadata to pods. |
GKE_METADATA_SERVER |
Run the GKE Metadata Server on this node. The GKE Metadata Server exposes a metadata API to workloads that is compatible with the V1 Compute Metadata APIs exposed by the Compute Engine and App Engine Metadata Servers. This feature can only be enabled if Workload Identity is enabled at the cluster level. |
Mode
Mode is the configuration for how to expose metadata to workloads running on the node.
Enums | |
---|---|
MODE_UNSPECIFIED |
Not set. |
GCE_METADATA |
Expose all Compute Engine metadata to pods. |
GKE_METADATA |
Run the GKE Metadata Server on this node. The GKE Metadata Server exposes a metadata API to workloads that is compatible with the V1 Compute Metadata APIs exposed by the Compute Engine and App Engine Metadata Servers. This feature can only be enabled if Workload Identity is enabled at the cluster level. |
NodeTaint
Kubernetes taint is composed of three fields: key, value, and effect. Effect can only be one of three types: NoSchedule, PreferNoSchedule or NoExecute.
See here for more information, including usage and the valid values.
JSON representation |
---|
{
"key": string,
"value": string,
"effect": enum ( |
Fields | |
---|---|
key |
Key for taint. |
value |
Value for taint. |
effect |
Effect for taint. |
Effect
Possible values for Effect in taint.
Enums | |
---|---|
EFFECT_UNSPECIFIED |
Not set |
NO_SCHEDULE |
NoSchedule |
PREFER_NO_SCHEDULE |
PreferNoSchedule |
NO_EXECUTE |
NoExecute |
LinuxNodeConfig
Parameters that can be configured on Linux nodes.
JSON representation |
---|
{ "sysctls": { string: string, ... }, "cgroupMode": enum ( |
Fields | |
---|---|
sysctls |
The Linux kernel parameters to be applied to the nodes and all pods running on the nodes. The following parameters are supported. net.core.busy_poll net.core.busy_read net.core.netdev_max_backlog net.core.rmem_max net.core.wmem_default net.core.wmem_max net.core.optmem_max net.core.somaxconn net.ipv4.tcp_rmem net.ipv4.tcp_wmem net.ipv4.tcp_tw_reuse An object containing a list of |
cgroupMode |
cgroupMode specifies the cgroup mode to be used on the node. |
hugepages |
Optional. Amounts for 2M and 1G hugepages |
CgroupMode
Possible cgroup modes that can be used.
Enums | |
---|---|
CGROUP_MODE_UNSPECIFIED |
CGROUP_MODE_UNSPECIFIED is when unspecified cgroup configuration is used. The default for the GKE node OS image will be used. |
CGROUP_MODE_V1 |
CGROUP_MODE_V1 specifies to use cgroupv1 for the cgroup configuration on the node image. |
CGROUP_MODE_V2 |
CGROUP_MODE_V2 specifies to use cgroupv2 for the cgroup configuration on the node image. |
HugepagesConfig
Hugepages amount in both 2m and 1g size
JSON representation |
---|
{ "hugepageSize2m": integer, "hugepageSize1g": integer } |
Fields | |
---|---|
hugepageSize2m |
Optional. Amount of 2M hugepages |
hugepageSize1g |
Optional. Amount of 1G hugepages |
EphemeralStorageConfig
EphemeralStorageConfig contains configuration for the ephemeral storage filesystem.
JSON representation |
---|
{ "localSsdCount": integer } |
Fields | |
---|---|
localSsdCount |
Number of local SSDs to use to back ephemeral storage. Uses NVMe interfaces. The limit for this value is dependent upon the maximum number of disk available on a machine per zone. See: https://cloud.google.com/compute/docs/disks/local-ssd for more information. A zero (or unset) value has different meanings depending on machine type being used: 1. For pre-Gen3 machines, which support flexible numbers of local ssds, zero (or unset) means to disable using local SSDs as ephemeral storage. 2. For Gen3 machines which dictate a specific number of local ssds, zero (or unset) means to use the default number of local ssds that goes with that machine type. For example, for a c3-standard-8-lssd machine, 2 local ssds would be provisioned. For c3-standard-8 (which doesn't support local ssds), 0 will be provisioned. See https://cloud.google.com/compute/docs/disks/local-ssd#choose_number_local_ssds for more info. |
AdvancedMachineFeatures
Specifies options for controlling advanced machine features.
JSON representation |
---|
{ "threadsPerCore": string, "enableNestedVirtualization": boolean } |
Fields | |
---|---|
threadsPerCore |
The number of threads per physical core. To disable simultaneous multithreading (SMT) set this to 1. If unset, the maximum number of threads supported per core by the underlying processor is assumed. |
enableNestedVirtualization |
Whether or not to enable nested virtualization (defaults to false). |
VirtualNIC
Configuration of gVNIC feature.
JSON representation |
---|
{ "enabled": boolean } |
Fields | |
---|---|
enabled |
Whether gVNIC features are enabled in the node pool. |
FastSocket
Configuration of Fast Socket feature.
JSON representation |
---|
{ "enabled": boolean } |
Fields | |
---|---|
enabled |
Whether Fast Socket features are enabled in the node pool. |
WindowsNodeConfig
Parameters that can be configured on Windows nodes. Windows Node Config that define the parameters that will be used to configure the Windows node pool settings
JSON representation |
---|
{
"osVersion": enum ( |
Fields | |
---|---|
osVersion |
OSVersion specifies the Windows node config to be used on the node |
OSVersion
Possible OS version that can be used.
Enums | |
---|---|
OS_VERSION_UNSPECIFIED |
When OSVersion is not specified |
OS_VERSION_LTSC2019 |
LTSC2019 specifies to use LTSC2019 as the Windows Servercore Base Image |
OS_VERSION_LTSC2022 |
LTSC2022 specifies to use LTSC2022 as the Windows Servercore Base Image |
LocalNvmeSsdBlockConfig
LocalNvmeSsdBlockConfig contains configuration for using raw-block local NVMe SSDs
JSON representation |
---|
{ "localSsdCount": integer } |
Fields | |
---|---|
localSsdCount |
Number of local NVMe SSDs to use. The limit for this value is dependent upon the maximum number of disk available on a machine per zone. See: https://cloud.google.com/compute/docs/disks/local-ssd for more information. A zero (or unset) value has different meanings depending on machine type being used: 1. For pre-Gen3 machines, which support flexible numbers of local ssds, zero (or unset) means to disable using local SSDs as ephemeral storage. 2. For Gen3 machines which dictate a specific number of local ssds, zero (or unset) means to use the default number of local ssds that goes with that machine type. For example, for a c3-standard-8-lssd machine, 2 local ssds would be provisioned. For c3-standard-8 (which doesn't support local ssds), 0 will be provisioned. See https://cloud.google.com/compute/docs/disks/local-ssd#choose_number_local_ssds for more info. |
EphemeralStorageLocalSsdConfig
EphemeralStorageLocalSsdConfig contains configuration for the node ephemeral storage using Local SSDs.
JSON representation |
---|
{ "localSsdCount": integer } |
Fields | |
---|---|
localSsdCount |
Number of local SSDs to use to back ephemeral storage. Uses NVMe interfaces. A zero (or unset) value has different meanings depending on machine type being used: 1. For pre-Gen3 machines, which support flexible numbers of local ssds, zero (or unset) means to disable using local SSDs as ephemeral storage. The limit for this value is dependent upon the maximum number of disk available on a machine per zone. See: https://cloud.google.com/compute/docs/disks/local-ssd for more information. 2. For Gen3 machines which dictate a specific number of local ssds, zero (or unset) means to use the default number of local ssds that goes with that machine type. For example, for a c3-standard-8-lssd machine, 2 local ssds would be provisioned. For c3-standard-8 (which doesn't support local ssds), 0 will be provisioned. See https://cloud.google.com/compute/docs/disks/local-ssd#choose_number_local_ssds for more info. |
SoleTenantConfig
SoleTenantConfig contains the NodeAffinities to specify what shared sole tenant node groups should back the node pool.
JSON representation |
---|
{
"nodeAffinities": [
{
object ( |
Fields | |
---|---|
nodeAffinities[] |
NodeAffinities used to match to a shared sole tenant node group. |
NodeAffinity
Specifies the NodeAffinity key, values, and affinity operator according to shared sole tenant node group affinities.
JSON representation |
---|
{
"key": string,
"operator": enum ( |
Fields | |
---|---|
key |
Key for NodeAffinity. |
operator |
Operator for NodeAffinity. |
values[] |
Values for NodeAffinity. |
Operator
Operator allows user to specify affinity or anti-affinity for the given key values.
Enums | |
---|---|
OPERATOR_UNSPECIFIED |
Invalid or unspecified affinity operator. |
IN |
Affinity operator. |
NOT_IN |
Anti-affinity operator. |
SecondaryBootDisk
SecondaryBootDisk represents a persistent disk attached to a node with special configurations based on its mode.
JSON representation |
---|
{
"mode": enum ( |
Fields | |
---|---|
mode |
Disk mode (container image cache, etc.) |
diskImage |
Fully-qualified resource ID for an existing disk image. |
Mode
Mode specifies how the secondary boot disk will be used. This triggers mode-specified logic in the control plane.
Enums | |
---|---|
MODE_UNSPECIFIED |
MODE_UNSPECIFIED is when mode is not set. |
CONTAINER_IMAGE_CACHE |
CONTAINER_IMAGE_CACHE is for using the secondary boot disk as a container image cache. |
SecondaryBootDiskUpdateStrategy
This type has no fields.
SecondaryBootDiskUpdateStrategy is a placeholder which will be extended in the future to define different options for updating secondary boot disks.
EffectiveCgroupMode
Possible effective cgroup modes for the node.
Enums | |
---|---|
EFFECTIVE_CGROUP_MODE_UNSPECIFIED |
EFFECTIVE_CGROUP_MODE_UNSPECIFIED means the cgroup configuration for the node pool is unspecified, i.e. the node pool is a Windows node pool. |
EFFECTIVE_CGROUP_MODE_V1 |
CGROUP_MODE_V1 means the node pool is configured to use cgroupv1 for the cgroup configuration. |
EFFECTIVE_CGROUP_MODE_V2 |
CGROUP_MODE_V2 means the node pool is configured to use cgroupv2 for the cgroup configuration. |