canirunthismodel

What can your GPU run locally?

Every GPU below has a page listing the popular AI models it can run, the best quantization for each, and how to run them. Pick your card to see what fits in its VRAM.

NVIDIA GeForce RTX 50

NVIDIA GeForce RTX 40

NVIDIA GeForce RTX 30

NVIDIA (older / workstation)

NVIDIA Data Center

AMD Radeon

Intel Arc