SparkRBatchResponse

data class SparkRBatchResponse(val archiveUris: List<String>, val args: List<String>, val fileUris: List<String>, val mainRFileUri: String)

A configuration for running an Apache SparkR (https://spark.apache.org/docs/latest/sparkr.html) batch workload.

Constructors

Link copied to clipboard
constructor(archiveUris: List<String>, args: List<String>, fileUris: List<String>, mainRFileUri: String)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard

Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

Link copied to clipboard

Optional. The arguments to pass to the Spark driver. Do not include arguments that can be set as batch properties, such as --conf, since a collision can occur that causes an incorrect batch submission.

Link copied to clipboard

Optional. HCFS URIs of files to be placed in the working directory of each executor.

Link copied to clipboard

The HCFS URI of the main R file to use as the driver. Must be a .R or .r file.