Class: Google::Apis::DataplexV1::GoogleCloudDataplexV1TaskSparkTaskConfig
- Inherits:
-
Object
- Object
- Google::Apis::DataplexV1::GoogleCloudDataplexV1TaskSparkTaskConfig
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- lib/google/apis/dataplex_v1/classes.rb,
lib/google/apis/dataplex_v1/representations.rb,
lib/google/apis/dataplex_v1/representations.rb
Overview
User-specified config for running a Spark task.
Instance Attribute Summary collapse
-
#archive_uris ⇒ Array<String>
Optional.
-
#file_uris ⇒ Array<String>
Optional.
-
#infrastructure_spec ⇒ Google::Apis::DataplexV1::GoogleCloudDataplexV1TaskInfrastructureSpec
Configuration for the underlying infrastructure used to run workloads.
-
#main_class ⇒ String
The name of the driver's main class.
-
#main_jar_file_uri ⇒ String
The Cloud Storage URI of the jar file that contains the main class.
-
#python_script_file ⇒ String
The Gcloud Storage URI of the main Python file to use as the driver.
-
#sql_script ⇒ String
The query text.
-
#sql_script_file ⇒ String
A reference to a query file.
Instance Method Summary collapse
-
#initialize(**args) ⇒ GoogleCloudDataplexV1TaskSparkTaskConfig
constructor
A new instance of GoogleCloudDataplexV1TaskSparkTaskConfig.
-
#update!(**args) ⇒ Object
Update properties of this object.
Constructor Details
#initialize(**args) ⇒ GoogleCloudDataplexV1TaskSparkTaskConfig
Returns a new instance of GoogleCloudDataplexV1TaskSparkTaskConfig.
6804 6805 6806 |
# File 'lib/google/apis/dataplex_v1/classes.rb', line 6804 def initialize(**args) update!(**args) end |
Instance Attribute Details
#archive_uris ⇒ Array<String>
Optional. Cloud Storage URIs of archives to be extracted into the working
directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz,
and .zip.
Corresponds to the JSON property archiveUris
6757 6758 6759 |
# File 'lib/google/apis/dataplex_v1/classes.rb', line 6757 def archive_uris @archive_uris end |
#file_uris ⇒ Array<String>
Optional. Cloud Storage URIs of files to be placed in the working directory of
each executor.
Corresponds to the JSON property fileUris
6763 6764 6765 |
# File 'lib/google/apis/dataplex_v1/classes.rb', line 6763 def file_uris @file_uris end |
#infrastructure_spec ⇒ Google::Apis::DataplexV1::GoogleCloudDataplexV1TaskInfrastructureSpec
Configuration for the underlying infrastructure used to run workloads.
Corresponds to the JSON property infrastructureSpec
6768 6769 6770 |
# File 'lib/google/apis/dataplex_v1/classes.rb', line 6768 def infrastructure_spec @infrastructure_spec end |
#main_class ⇒ String
The name of the driver's main class. The jar file that contains the class must
be in the default CLASSPATH or specified in jar_file_uris. The execution args
are passed in as a sequence of named process arguments (--key=value).
Corresponds to the JSON property mainClass
6775 6776 6777 |
# File 'lib/google/apis/dataplex_v1/classes.rb', line 6775 def main_class @main_class end |
#main_jar_file_uri ⇒ String
The Cloud Storage URI of the jar file that contains the main class. The
execution args are passed in as a sequence of named process arguments (--key=
value).
Corresponds to the JSON property mainJarFileUri
6782 6783 6784 |
# File 'lib/google/apis/dataplex_v1/classes.rb', line 6782 def main_jar_file_uri @main_jar_file_uri end |
#python_script_file ⇒ String
The Gcloud Storage URI of the main Python file to use as the driver. Must be a
.py file. The execution args are passed in as a sequence of named process
arguments (--key=value).
Corresponds to the JSON property pythonScriptFile
6789 6790 6791 |
# File 'lib/google/apis/dataplex_v1/classes.rb', line 6789 def python_script_file @python_script_file end |
#sql_script ⇒ String
The query text. The execution args are used to declare a set of script
variables (set key="value";).
Corresponds to the JSON property sqlScript
6795 6796 6797 |
# File 'lib/google/apis/dataplex_v1/classes.rb', line 6795 def sql_script @sql_script end |
#sql_script_file ⇒ String
A reference to a query file. This can be the Cloud Storage URI of the query
file or it can the path to a SqlScript Content. The execution args are used to
declare a set of script variables (set key="value";).
Corresponds to the JSON property sqlScriptFile
6802 6803 6804 |
# File 'lib/google/apis/dataplex_v1/classes.rb', line 6802 def sql_script_file @sql_script_file end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
6809 6810 6811 6812 6813 6814 6815 6816 6817 6818 |
# File 'lib/google/apis/dataplex_v1/classes.rb', line 6809 def update!(**args) @archive_uris = args[:archive_uris] if args.key?(:archive_uris) @file_uris = args[:file_uris] if args.key?(:file_uris) @infrastructure_spec = args[:infrastructure_spec] if args.key?(:infrastructure_spec) @main_class = args[:main_class] if args.key?(:main_class) @main_jar_file_uri = args[:main_jar_file_uri] if args.key?(:main_jar_file_uri) @python_script_file = args[:python_script_file] if args.key?(:python_script_file) @sql_script = args[:sql_script] if args.key?(:sql_script) @sql_script_file = args[:sql_script_file] if args.key?(:sql_script_file) end |