GdcSparkApplicationPysparkApplicationConfigArgs

data class GdcSparkApplicationPysparkApplicationConfigArgs(val archiveUris: Output<List<String>>? = null, val args: Output<List<String>>? = null, val fileUris: Output<List<String>>? = null, val jarFileUris: Output<List<String>>? = null, val mainPythonFileUri: Output<String>, val pythonFileUris: Output<List<String>>? = null) : ConvertibleToJava<GdcSparkApplicationPysparkApplicationConfigArgs>

Constructors

constructor(archiveUris: Output<List<String>>? = null, args: Output<List<String>>? = null, fileUris: Output<List<String>>? = null, jarFileUris: Output<List<String>>? = null, mainPythonFileUri: Output<String>, pythonFileUris: Output<List<String>>? = null)

Properties

Link copied to clipboard
val archiveUris: Output<List<String>>? = null

HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

Link copied to clipboard
val args: Output<List<String>>? = null

The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.

Link copied to clipboard
val fileUris: Output<List<String>>? = null

HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.

Link copied to clipboard
val jarFileUris: Output<List<String>>? = null

HCFS URIs of jar files to add to the CLASSPATHs of the Python driver and tasks.

Link copied to clipboard

The HCFS URI of the main Python file to use as the driver. Must be a .py file.

Link copied to clipboard
val pythonFileUris: Output<List<String>>? = null

HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: .py, .egg, and .zip.

Functions

Link copied to clipboard
open override fun toJava(): GdcSparkApplicationPysparkApplicationConfigArgs