pulumi-aws-native-kotlin/com.pulumi.awsnative.sagemaker.kotlin.outputs/InferenceComponentComputeResourceRequirements

InferenceComponentComputeResourceRequirements

data class InferenceComponentComputeResourceRequirements(val maxMemoryRequiredInMb: Int? = null, val minMemoryRequiredInMb: Int? = null, val numberOfAcceleratorDevicesRequired: Double? = null, val numberOfCpuCoresRequired: Double? = null)

Constructors

constructor(maxMemoryRequiredInMb: Int? = null, minMemoryRequiredInMb: Int? = null, numberOfAcceleratorDevicesRequired: Double? = null, numberOfCpuCoresRequired: Double? = null)

Types

Companion

object Companion

Properties

maxMemoryRequiredInMb

val maxMemoryRequiredInMb: Int? = null

The maximum MB of memory to allocate to run a model that you assign to an inference component.

minMemoryRequiredInMb

val minMemoryRequiredInMb: Int? = null

The minimum MB of memory to allocate to run a model that you assign to an inference component.

numberOfAcceleratorDevicesRequired

val numberOfAcceleratorDevicesRequired: Double? = null

The number of accelerators to allocate to run a model that you assign to an inference component. Accelerators include GPUs and AWS Inferentia.

numberOfCpuCoresRequired

val numberOfCpuCoresRequired: Double? = null

The number of CPU cores to allocate to run a model that you assign to an inference component.