hardNewNVIDIADatabricksGoogle

Your GPU dashboard shows 95 percent utilisation and finance wants to know why you need more GPUs. What do you tell them?

The utilisation number everyone quotes means at least one kernel was resident, not that the hardware was doing useful work. A GPU at 95 percent can be doing five percent of what it is capable of.

Updated Sep 2026 · Grounded in researched DevOps, SRE and platform engineering interview loops, written to a senior-engineer editorial bar, and never padded to hit a word count.

The utilisation number everyone quotes means at least one kernel was resident, not that the hardware was doing useful work. A GPU at 95 percent can be doing five percent of what it is capable of.

20 answers per topic instead of 10, and your progress kept · no cardor unlock all 390 remaining answers · ₹2,000 / $25

UP NEXT ON YOUR JOURNEY

Next in this trackYou need prompt and response logs to debug an AI feature, and legal says no. How do you resolve it?Next in this trackHow do you detect that a model in production got worse, when nothing in your infrastructure metrics changed?Next in this trackYour distributed training run died six hours into an epoch on preemptible GPUs. What happens next, and how do you design for it?

DISCUSSION · 0

Nothing here yet. Say how you would answer it.