Autoscaling Starburst Clusters

Starburst Enterprise
1

Trying to understand and want to try autoscaling with Starburst’s clusters.
Wanted to check, if the metric server and HPA controller, is Prometheus required to autoscale?

2

If you are using our k8s helm charts, then it’s built right into the chart.

  # number of workers
  replicas: 2
  autoscaling:
    enabled: false
    minReplicas: 1
    maxReplicas: 100
    targetCPUUtilizationPercentage: 80
  deploymentTerminationGracePeriodSeconds: 300 # 5 minutes
  starburstWorkerShutdownGracePeriodSeconds: 120 # 2 minutes

we spin up an HPA for you. You don’t need prometheus.

3

Also note the scaling requirements Starburst Enterprise with Kubernetes requirements — Starburst Enterprise and KEDA scaler support - see Configuring Starburst Enterprise in Kubernetes — Starburst Enterprise