A Dataproc job for running Apache Pig queries on YARN.
JSON representation |
---|
{ "continueOnFailure": boolean, "scriptVariables": { string: string, ... }, "properties": { string: string, ... }, "jarFileUris": [ string ], "loggingConfig": { object ( |
Fields | |
---|---|
continueOnFailure |
Optional. Whether to continue executing queries if a query fails. The default value is |
scriptVariables |
Optional. Mapping of query variable names to values (equivalent to the Pig command: An object containing a list of |
properties |
Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API might be overwritten. Can include properties set in An object containing a list of |
jarFileUris[] |
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs. |
loggingConfig |
Optional. The runtime log config for job execution. |
Union field queries . Required. The sequence of Pig queries to execute, specified as an HCFS file URI or a list of queries. queries can be only one of the following: |
|
queryFileUri |
The HCFS URI of the script that contains the Pig queries. |
queryList |
A list of queries. |