GPU fleet at 22% utilization and nobody agrees why

We run about 40 A100s behind a Triton and TGI setup for internal inference. Dashboards show average utilization around 22%, yet p99 latency still breaches every morning peak. The platform team wants aggressive bin-packing onto fewer nodes. The product team refuses to loosen latency SLOs by a mill