Categories
October Surprise 2024

Autoscaling metrics on GCP Dataproc on YARN

Allocated memory refers to the total YARN memory taken up by running containers across the whole cluster. If there are 6 running containers that can use up to 1GB, there is 6GB of allocated memory.