Class: Aws::Glue::Types::SparkSQL

Inherits:

Struct

• Object
• Struct
• Aws::Glue::Types::SparkSQL

Includes:

Structure

Defined in:

lib/aws-sdk-glue/types.rb

Overview

Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #inputs ⇒ Array<String>

  The data inputs identified by their node names.

• #name ⇒ String

  The name of the transform node.

• #output_schemas ⇒ Array<Types::GlueSchema>

  Specifies the data schema for the SparkSQL transform.

• #sql_aliases ⇒ Array<Types::SqlAlias>

  A list of aliases.

• #sql_query ⇒ String

  A SQL query that must use Spark SQL syntax and return a single data set.

Instance Attribute Details

#inputs ⇒ Array<String>

The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.

Returns:

• (Array<String>)

# File 'lib/aws-sdk-glue/types.rb', line 28648

class SparkSQL < Struct.new(
  :name,
  :inputs,
  :sql_query,
  :sql_aliases,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#name ⇒ String

The name of the transform node.

Returns:

• (String)

# File 'lib/aws-sdk-glue/types.rb', line 28648

class SparkSQL < Struct.new(
  :name,
  :inputs,
  :sql_query,
  :sql_aliases,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#output_schemas ⇒ Array<Types::GlueSchema>

Specifies the data schema for the SparkSQL transform.

Returns:

• (Array<Types::GlueSchema>)

# File 'lib/aws-sdk-glue/types.rb', line 28648

class SparkSQL < Struct.new(
  :name,
  :inputs,
  :sql_query,
  :sql_aliases,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#sql_aliases ⇒ Array<Types::SqlAlias>

A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

select * from SqlName

and that gets data from MyDataSource.

Returns:

• (Array<Types::SqlAlias>)

# File 'lib/aws-sdk-glue/types.rb', line 28648

class SparkSQL < Struct.new(
  :name,
  :inputs,
  :sql_query,
  :sql_aliases,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end

#sql_query ⇒ String

A SQL query that must use Spark SQL syntax and return a single data set.

Returns:

• (String)

# File 'lib/aws-sdk-glue/types.rb', line 28648

class SparkSQL < Struct.new(
  :name,
  :inputs,
  :sql_query,
  :sql_aliases,
  :output_schemas)
  SENSITIVE = []
  include Aws::Structure
end