Lesson 515 of 1596
VRAM and RAM Sizing: What Can This Machine Actually Run?
Students need a repeatable way to decide whether a local model fits the machine before downloading giant files.
Creators · Model Families · ~12 min read
The operational idea: hardware sizing
Students need a repeatable way to decide whether a local model fits the machine before downloading giant files. In local AI, the model family is only one part of the system. The runtime, file format, serving path, hardware budget, evaluation set, and safety policy decide whether the model becomes useful.
Compare the options
| Layer | What to decide | What can go wrong |
|---|---|---|
| Runtime | hardware sizing | The model runs, but the workflow is slow or brittle |
| Evaluation | A small task-specific test set | A flashy demo hides routine failures |
| Safety and ops | Permissions, provenance, logging, and rollback | Confusing disk size with runtime memory. A model can fit on disk and still be unusable in memory. |
Current source signal
Build the small version
Create a pre-download sizing worksheet for laptop CPU, Apple Silicon, consumer NVIDIA GPU, and workstation GPU.
- 1Define the user task in one sentence.
- 2Choose the smallest model and runtime that might pass that task.
- 3Run one happy-path prompt and one failure-path prompt.
- 4Record speed, memory pressure, output quality, and the exact reason for any failure.
- 5Write the operating rule you would give a non-expert user.
A local-model operations sketch students can adapt.
fit_check: model_size: 8B quantization: Q4 context: 8192 hardware: ram: 32GB vram: shared_or_dedicated decision: run_test_before_committing record: loaded: yes_no usable_speed: yes_noKey terms in this lesson
The big idea: fit before download. A local model app is not done when the model answers once; it is done when the whole workflow can be installed, measured, trusted, and recovered.
End-of-lesson quiz
Check what stuck
8 questions · Score saves to your progress.
Tutor
Curious about “VRAM and RAM Sizing: What Can This Machine Actually Run?”?
Ask anything about this lesson. I’ll answer using just what you’re reading — short, friendly, grounded.
Progress saved locally in this browser. Sign in to sync across devices.
Related lessons
Keep going
Creators · 45 min
OpenAI Model Picker: GPT-5.5, GPT-5.4, Mini, Nano, and Codex
A practical picker for current OpenAI models: when to pay for the frontier model, when to use a smaller model, and when Codex-specific models make sense.
Creators · 9 min
The GPT Store: Discovery, Monetization, And Quality Signals
The GPT Store is a marketplace, but most listings are noise. Knowing how to read a listing — and how to make one stand out — is a creator skill of its own.
Creators · 10 min
Operator: The Agentic Browser Pattern
Operator points an agent at a real browser and lets it click, type, and navigate. The pattern is powerful and the failure modes are different from chat — supervision is not optional.