The cluster config.
Optional. The shared Compute Engine config settings for all instances in a cluster.
Optional. The Compute Engine config settings for worker instances in a cluster.
Optional. The config settings for software inside the cluster.
Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all
worker nodes. You can test a node's role metadata to run an
executable on a master or worker node, as shown below using
curl
(you can also use wget
): :: ROLE=$(curl -H
Metadata-Flavor:Google http://metadata/computeMetadata/v1b
eta2/instance/attributes/dataproc-role) if [[ "${ROLE}" ==
'Master' ]]; then ... master specific actions ...
else ... worker specific actions ... fi
Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.
Optional. Security related configuration.