A Cloud Dataproc job for running Apache Hadoop
MapReduce <https://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html>
jobs on Apache Hadoop
YARN <https://hadoop.apache.org/docs/r2.7.1/hadoop-yarn/hadoop-yarn-site/YARN.html>.
The HCFS URI of the jar file containing the main class.
Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-
metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar'
'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-
examples.jar'
Optional. The arguments to pass to the driver. Do not include
arguments, such as -libjars or -Dfoo=bar, that can be
set as job properties, since a collision may occur that causes
an incorrect job submission.
Optional. HCFS (Hadoop Compatible Filesystem) URIs of files to
be copied to the working directory of Hadoop drivers and
distributed tasks. Useful for naively parallel tasks.
Optional. A mapping of property names to values, used to
configure Hadoop. Properties that conflict with values set by
the Cloud Dataproc API may be overwritten. Can include
properties set in /etc/hadoop/conf/*-site and classes in user
code.
Classes
PropertiesEntry
API documentation for dataproc_v1beta2.types.HadoopJob.PropertiesEntry class.