We run mixed inference workloads and our GPU dashboards are mostly node-level, not per-model. Finance wants cost per endpoint, but noisy neighbors and batch jobs make attribution fuzzy. What are people using for per-model GPU utilization and cost attribution without adding heavy instrumentation? Are you relying on DCGM, Prometheus labels, gateway logs, or vendor tooling? Also curious how you
How are you tracking GPU utilization per model?
Replies
No comments yet — be the first to share your thoughts.