On this pageWhat 8 GB really meansStart between 1B and 4BPrepare the computerRun a useful testWhen 8 GB is not enoughKeep an 8 GB laptop usableWhat if the answer is weak?Verified model files and the 8 GB limitSources
DT

Written and reviewed by DeviceterraPractical guidance · Updated November 11, 2026

THE SHORT ANSWER

An 8 GB computer can test local AI, but it needs a small quantized model, short prompts, and enough free memory for the operating system.

THE DIRECT ANSWER

What should you choose?

For most 8 GB computers, Qwen 3 4B in a Q4 format is the best balanced starting point. Choose Qwen 2.5 Coder 3B for coding, Phi-4 Mini for compact reasoning, or Qwen 3 1.7B when the computer struggles with larger models.

This recommendation assumes:

This answer assumes the computer has 8 GB of total RAM, no large apps open, one user, a short conversation, and a Q4-size model file.

Best overall

Qwen 3 4B Q4

It offers a useful balance of writing, reasoning, coding, and several languages while remaining small enough for a careful 8 GB test.

Limit: It will be tight on Windows. Close other apps and keep the context short.
ollama run qwen3:4b
Best for coding

Qwen 2.5 Coder 3B Q4

It is smaller than many coding models and is focused on code completion, explanation, and simple fixes.

Limit: It is not the right size for large repositories or difficult multi-file work.
ollama run qwen2.5-coder:3b
Best compact reasoning

Phi-4 Mini 3.8B Q4

It is a small model with useful reasoning and math ability for its size.

Limit: Long prompts and difficult research tasks can still overwhelm it.
ollama run phi4-mini
Safest low-memory choice

Qwen 3 1.7B

It leaves more room for Windows, a browser, and the AI engine.

Limit: Answer quality is lower than the 4B choices on difficult work.
ollama run qwen3:1.7b
What to avoid

Do not begin with 7B, 8B, or 14B models on an 8 GB computer. A file may download successfully and still leave too little working memory.

WATCH THE EXPLANATION

8GB RAM is Enough: The Truth About Local AI

This Deviceterra video shows why the exact model file, free system memory, and real task matter more than the 8 GB label alone.

Watch on YouTube or turn on captions ↗
THE FULL GUIDE

Here is what matters, why it matters and how to check it on your own setup.

01

What 8 GB really means

Your AI model cannot use all 8 GB. Windows, macOS, or Linux already uses part of the memory. Your browser and other programs use more. This is why a model file that looks small enough can still make the computer slow.

Treat 8 GB as an entry-level test machine. It can help with short summaries, rewriting, simple questions, and light coding help. It is not a good starting point for many users, large documents, or complex agents.

02

Start between 1B and 4B

Begin with an instruction model between about 1 billion and 4 billion parameters. A Q4 quantized file is often the safest first choice because it uses less memory than a full-precision model.

Small Gemma, Qwen, Phi, and Llama family models may fit this range. The exact file matters more than the family name. Check the file size and quantization before downloading.

Safe first rule

Start small. Move up only when the smaller model cannot complete your real task.

03

Prepare the computer

  • Close games, video editors, and browser tabs you do not need.
  • Keep several gigabytes of free storage beyond the model file.
  • Start with a short conversation and one document at a time.
  • Use a CPU-friendly engine such as Ollama, LM Studio, or llama.cpp.
  • Restart the AI app if memory use keeps growing after a long session.
04

Run a useful test

Create five prompts from work you really do. Ask for a short summary, a rewrite, a list, a simple explanation, and one task-specific answer. Record whether the answer is correct and how long you wait.

Do not judge the model from one impressive answer. If it fails the same type of task more than once, try a better prompt or a different small model.

05

When 8 GB is not enough

Move to a 16 GB or larger computer when you need longer documents, stronger coding help, image understanding, several apps open at once, or faster answers.

Use the MamiLens hardware path to see conservative matches. If no model has enough memory headroom, MamiLens should say so instead of forcing a recommendation.

06

Keep an 8 GB laptop usable

An 8 GB machine shares RAM between the operating system, browser and AI app. Start with a compact instruction model and short prompts. A model that barely loads with every other app closed may not be useful while you are doing normal work.

Test a short email rewrite, a small summary and one question from your real work. Leave your usual apps open for the final check. If the computer starts using the disk heavily or freezes, reduce the model size and conversation length.

A mistake to avoid

Do not treat 8 GB system RAM as 8 GB dedicated graphics memory. Integrated graphics may share the same RAM.

07

What if the answer is weak?

Improve the prompt and provide clear facts first. If quality is still poor, test a slightly larger model only when the memory check allows it. Cloud help may be more practical for occasional hard tasks.

08

Verified model files and the 8 GB limit

The Ollama library lists Qwen3 1.7B Q4_K_M at about 1.4 GB and Qwen3 4B Q4_K_M at about 2.6 GB. A community CPU test ran Qwen3 4B in a 6 GB virtual machine, but its Qwen3 8B test was stopped by out-of-memory. This supports trying 4B, not promising it will be comfortable on every 8 GB Windows laptop. For an older or busy computer, use 1.7B first.

Run a short 4K-context test with heavy apps closed, then repeat with the programs you normally use. If memory pressure or disk swapping makes it unusable, keep the smaller model. The download size is not the total memory requirement.

TEST THE RECOMMENDATION

Try a safe model on an 8 GB computer

An 8 GB computer can run local AI, but the operating system already uses part of that memory. Start small and leave space for Windows, macOS, or Linux.

  1. 1

    Check total memory

    On Windows, press Ctrl, Shift, and Esc. Select Performance, then Memory. Confirm that the total is about 8 GB.

  2. 2

    Close heavy programs

    Save your work. Close games, editing apps, and browser tabs you do not need.

  3. 3

    Install Ollama

    Visit ollama.com/download, choose your system, and run the installer.

  4. 4

    Open a command window

    Windows: click Start, type PowerShell, and open it. Mac: press Command and Space, type Terminal, and press Enter.

  5. 5

    Run a 1B model

    Type this command and press Enter.

    ollama run gemma3:1b
  6. 6

    Ask one short question

    Ask for a five-sentence summary. Avoid long documents during the first test.

How to know the choice is right
  • The computer remains responsive.
  • The model completes a short task.
  • You still have free memory while it runs.
PLAIN ENGLISH

Words you may see in this guide

RAM
The working memory used by your computer and apps.
VRAM
The memory on a dedicated graphics card. Shared graphics may use system RAM.
Context
The text and other input the model can use for its current answer.
Quantization
A way to make model weights smaller. It can change memory use and answer quality.
Engine
The software that loads the model and runs it.
RAG
A workflow that finds useful document passages before asking a model to answer.
Benchmark
A repeatable test. A result is useful only when you know the setup and task.
RESEARCH SOURCES

Official facts and real user evidence

Official documentation supports product and model facts. Community discussions show real setups, failures, and questions. A community result is supporting evidence, not a promise that another computer will perform the same way.

YOUR NEXT STEP

Watch a real test. Check what fits your computer.

See practical local AI tests from DeviceTerra, then use MamiLens to build a hardware-aware shortlist for your own setup.

This guide is educational. Model software, licenses, and hardware support can change. Check official sources before an important deployment.