Google Cloud Dataproc V1 Client - Class SparkSqlJob (2.1.0)

Reference documentation and code samples for the Google Cloud Dataproc V1 Client class SparkSqlJob.

A Dataproc job for running Apache Spark SQL queries.

Generated from protobuf message google.cloud.dataproc.v1.SparkSqlJob

Namespace

Google \ Cloud \ Dataproc \ V1

Methods

__construct

Constructor.

Parameters
Name Description
data array

Optional. Data for populating the Message object.

↳ query_file_uri string

The HCFS URI of the script that contains SQL queries.

↳ query_list Google\Cloud\Dataproc\V1\QueryList

A list of queries.

↳ script_variables array|Google\Protobuf\Internal\MapField

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

↳ properties array|Google\Protobuf\Internal\MapField

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API might be overwritten.

↳ jar_file_uris array

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

↳ logging_config Google\Cloud\Dataproc\V1\LoggingConfig

Optional. The runtime log config for job execution.

getQueryFileUri

The HCFS URI of the script that contains SQL queries.

Returns
Type Description
string

hasQueryFileUri

setQueryFileUri

The HCFS URI of the script that contains SQL queries.

Parameter
Name Description
var string
Returns
Type Description
$this

getQueryList

A list of queries.

Returns
Type Description
Google\Cloud\Dataproc\V1\QueryList|null

hasQueryList

setQueryList

A list of queries.

Parameter
Name Description
var Google\Cloud\Dataproc\V1\QueryList
Returns
Type Description
$this

getScriptVariables

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

Returns
Type Description
Google\Protobuf\Internal\MapField

setScriptVariables

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

Parameter
Name Description
var array|Google\Protobuf\Internal\MapField
Returns
Type Description
$this

getProperties

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API might be overwritten.

Returns
Type Description
Google\Protobuf\Internal\MapField

setProperties

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API might be overwritten.

Parameter
Name Description
var array|Google\Protobuf\Internal\MapField
Returns
Type Description
$this

getJarFileUris

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Returns
Type Description
Google\Protobuf\Internal\RepeatedField

setJarFileUris

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Parameter
Name Description
var string[]
Returns
Type Description
$this

getLoggingConfig

Optional. The runtime log config for job execution.

Returns
Type Description
Google\Cloud\Dataproc\V1\LoggingConfig|null

hasLoggingConfig

clearLoggingConfig

setLoggingConfig

Optional. The runtime log config for job execution.

Parameter
Name Description
var Google\Cloud\Dataproc\V1\LoggingConfig
Returns
Type Description
$this

getQueries

Returns
Type Description
string