HDInsight
HDInsight ondemand linked service.
Constructors
Properties
Specifies additional storage accounts for the HDInsight linked service so that the Data Factory service can register them on your behalf.
List of tags that can be used for describing the linked service.
The prefix of cluster name, postfix will be distinct with timestamp. Type: string (or Expression with resultType string).
The password to access the cluster.
The resource group where the cluster belongs. Type: string (or Expression with resultType string).
Number of worker/data nodes in the cluster. Suggestion value: 4. Type: int (or Expression with resultType int).
The password to SSH remotely connect cluster’s node (for Linux).
The username to SSH remotely connect to cluster’s node (for Linux). Type: string (or Expression with resultType string).
The cluster type. Type: string (or Expression with resultType string).
The username to access the cluster. Type: string (or Expression with resultType string).
The integration runtime reference.
Specifies the core configuration parameters (as in core-site.xml) for the HDInsight cluster to be created.
The credential reference containing authentication information.
Specifies the size of the data node for the HDInsight cluster.
Linked service description.
The encrypted credential used for authentication. Credentials are encrypted using the integration runtime credential manager. Type: string.
Specifies the HBase configuration parameters (hbase-site.xml) for the HDInsight cluster.
The name of Azure SQL linked service that point to the HCatalog database. The on-demand HDInsight cluster is created by using the Azure SQL database as the metastore.
Specifies the HDFS configuration parameters (hdfs-site.xml) for the HDInsight cluster.
Specifies the size of the head node for the HDInsight cluster.
Specifies the hive configuration parameters (hive-site.xml) for the HDInsight cluster.
The customer’s subscription to host the cluster. Type: string (or Expression with resultType string).
Azure Storage linked service to be used by the on-demand cluster for storing and processing data.
Specifies the MapReduce configuration parameters (mapred-site.xml) for the HDInsight cluster.
Specifies the Oozie configuration parameters (oozie-site.xml) for the HDInsight cluster.
Parameters for linked service.
Custom script actions to run on HDI ondemand cluster once it's up. Please refer to https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-customize-cluster-linux?toc=%2Fen-us%2Fazure%2Fhdinsight%2Fr-server%2FTOC.json&bc=%2Fen-us%2Fazure%2Fbread%2Ftoc.json#understanding-script-actions.
The service principal id for the hostSubscriptionId. Type: string (or Expression with resultType string).
The key for the service principal id.
The version of spark if the cluster type is 'spark'. Type: string (or Expression with resultType string).
Specifies the Storm configuration parameters (storm-site.xml) for the HDInsight cluster.
The ARM resource ID for the subnet in the vNet. If virtualNetworkId was specified, then this property is required. Type: string (or Expression with resultType string).
The allowed idle time for the on-demand HDInsight cluster. Specifies how long the on-demand HDInsight cluster stays alive after completion of an activity run if there are no other active jobs in the cluster. The minimum value is 5 mins. Type: string (or Expression with resultType string).
The ARM resource ID for the vNet to which the cluster should be joined after creation. Type: string (or Expression with resultType string).
Specifies the Yarn configuration parameters (yarn-site.xml) for the HDInsight cluster.
Specifies the size of the Zoo Keeper node for the HDInsight cluster.