We have a few customers who use GPU's and its difficult to perform effective autoscaling as the resource limitation is on the GPU, not the CPU or memory. If would be useful to have the GPU metrics as a factor for when performing autoscaling, i.e the current GPU utilisation. It would also be beneficial to see the GPU Utilisation during the Autoscaling History. As GPU's are expensive resources this could be a considerable cost saving feature.
GPU Autoscaling and performance reporting
2
Please sign in to leave a comment.
Comments (0 comments)