Plugin always set number of executors to at least one.
Doesn't scale. Uses set number of executors
Determine number of executors by node hardware: Memory and vCPU count. Specify the quantity of each resource to be allocated per executor. The plugin sources the resources of the node and calculates the desired number of executors. The lower number of executors calculated will be chosen to prevent over provisioning.
The plugin consumes instance
weight information provided by a Launch Specification
and uses it to scale the node's number of executors from configuration field Number of Executors
.
Note: current implementation doesn't support Launch Template, only Launch Specification.
Example (here instance type from launch specification matches with launched instance type):
Number of Executors | Instance Weight | Effective Number of Executors |
---|---|---|
1 | 1 | 1 |
1 | 0.5 | 1 |
1 | 0.1 | 1 |
10 | 0.1 | 1 |
1 | 1.5 | 2 |
1 | 1.44 | 1 |
If the launched instance type doesn't match any weight in launch specification, regular number of executors will be used without any scaling.