GPU or NPU Not Working
Usual symptom
Section titled “Usual symptom”The model technically runs, but it feels far slower than expected and the device gets hot in the wrong way.
What to verify
Section titled “What to verify”- Does the runtime actually support acceleration on this device?
- Is the app falling back to CPU?
- Are drivers or platform support still immature on this hardware?
Practical rule
Section titled “Practical rule”If you cannot confirm acceleration is active, assume it is not.
That means the correct next move is usually:
- test the same device in a more known-good runtime,
- or drop to a smaller model size,
- or move the workload to a better-supported machine.