Class SoftwareConfig (3.0.0)

SoftwareConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Specifies the selection and config of software inside the cluster.

Attributes

NameDescription
image_version str
Optional. The version of software inside the cluster. It must be one of the supported `Dataproc Versions
properties Sequence[google.cloud.dataproc_v1.types.SoftwareConfig.PropertiesEntry]
Optional. The properties to set on daemon config files. Property keys are specified in prefix:property format, for example core:hadoop.tmp.dir. The following are supported prefixes and their mappings: - capacity-scheduler: capacity-scheduler.xml - core: core-site.xml - distcp: distcp-default.xml - hdfs: hdfs-site.xml - hive: hive-site.xml - mapred: mapred-site.xml - pig: pig.properties - spark: spark-defaults.conf - yarn: yarn-site.xml For more information, see `Cluster properties
optional_components Sequence[google.cloud.dataproc_v1.types.Component]
Optional. The set of components to activate on the cluster.

Classes

PropertiesEntry

PropertiesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The abstract base class for a message.

Parameters
NameDescription
kwargs dict

Keys and values corresponding to the fields of the message.

mapping Union[dict, .Message]

A dictionary or message to be used to determine the values for this message.

ignore_unknown_fields Optional(bool)

If True, do not raise errors for unknown fields. Only applied if mapping is a mapping type or there are keyword parameters.