Storage holds the download
An SSD keeps model files after shutdown. RAM holds working data while the model runs. Leave free disk space for updates and other models. More SSD space does not replace enough RAM.
Apple Mac mini M1 (2020)
Reviewed unit: M1 Mac mini with 16 GB memory; SSD unspecified.
Chat & learning
Meet the hardware
Photographs and manufacturer images, with source credits. Select a picture to inspect the full image. The pictured variant may differ from the reviewed unit.
Processor: what does the work?
The CPU keeps the system and applications running. The GPU can do many model calculations together when your engine supports it. More cores do not guarantee a faster answer across different chip families.
Read the right numbers
CPU cores and GPU compute units describe different designs. Compare the same model, engine and settings before treating one chip as faster. An NPU or Neural Engine specification does not prove that your chosen language-model application uses it.
Memory: where the model works
The CPU, GPU and operating system share one memory pool. Shared GPU memory is not extra memory on top of the listed capacity. A large model, a long conversation and other applications all compete for that space.
Capacity is not the same as speed
Capacity tells you how much memory is available. Bandwidth tells you how quickly the chip can read it. A model can fit in memory and still respond slowly. Longer context also uses memory for the model’s working cache.
Learn RAM, VRAM and model size →Storage, connections and upgrades
Memory is not a removable DIMM upgrade on these Apple Silicon Macs. Choose capacity before buying. Internal SSD serviceability varies by model; use the exact service documentation rather than assuming a standard PC drive can be fitted.
Connections shape the setup
Check the monitor, network and drive ports you need. USB-C is a connector shape; check its actual speed and display support. A fast network does not automatically merge two computers’ memory.
Detailed system specifications
These are manufacturer product-family specifications and options. The creator’s exact reviewed configuration is listed separately. Confirm the model number and options before buying.
| Specification | Detail | Source |
|---|---|---|
| Cpu | M1, 8 CPU cores | Source ↗ |
| Gpu | 8 GPU cores | Source ↗ |
| Memory | 8 GB; configurable to 16 GB | Source ↗ |
| Memory type | Unified memory shared by CPU and GPU | Source ↗ |
| Storage | 256 GB-2 TB SSD options | Source ↗ |
| Memory (family options) | 8 GB unified memory Configurable to 16 GB | Source ↗ |
| Storage 1 (family options) | 256 GB SSD Configurable to: 512 GB, 1 TB, or 2 TB | Source ↗ |
| Connections and Expansion (family options) | Two Thunderbolt / USB 4 ports with support for: DisplayPort Thunderbolt 3 (up to 40 Gb/s) USB 4 (up to 40Gb/s) USB 3.1 Gen 2 (up to 10 Gb/s) Thunderbolt 2, HDMI, DVI, and VGA supported using adapters (sold separately) Two USB-A ports (up to 5 Gb/s) HDMI port Gigabit Ethernet port (Configurable to 10Gb Ethernet) 3.5 mm headphone jack | Source ↗ |
| Communications (family options) | Wi-Fi 802.11ax Wi-Fi 6 wireless networking IEEE 802.11a/b/g/n/ac compatible Bluetooth Bluetooth 5.0 wireless technology Ethernet 10/100/1000BASE-T Gigabit Ethernet (RJ-45 connector) Configurable to 10Gb Ethernet (Nbase-T Ethernet with support for 1Gb, 2.5Gb, 5Gb, and 10Gb Ethernet using RJ-45 connector) | Source ↗ |
| Size and Weight (family options) | Height: 1.4 inches (3.6 cm) Width: 7.7 inches (19.7 cm) Depth: 7.7 inches (19.7 cm) Weight: 2.6 pounds (1.2 kg) 2 | Source ↗ |
| Electrical and Operating Requirements (family options) | Line voltage: 100-240V AC Frequency: 50Hz to 60Hz, single phase Maximum continuous power: 150 W Operating temperature: 50° to 95° F (10° to 35° C) Storage temperature: -40° to 116° F (-40° to 47° C) Relative humidity: 5% to 90% noncondensing Operating altitude: tested up to 16,400 feet (5000 meters) Typical acoustical performance: Sound pressure level (operator position): 5 dBA at idle 3 | Source ↗ |
Software checks before you start
Confirm your operating system, driver, engine version, model format and quantization. The creator’s named test below is a starting point, not a guarantee that every model or engine works. Use a native Apple Silicon engine with a supported Metal or MLX backend. CUDA-only installation instructions are for NVIDIA hardware.
Plan your model and engineWatch the real test
Apple Silicon Speed Test: LocalLLM on M1 vs. M2 vs. M2 Pro vs. M3
By Bijan Bowen / Ominous Industries · 2024-06-02
An owned-machine comparison demonstrates local inference on the 16 GB M1.
What this test does not prove
Historical single-prompt comparison; no modern-model or long-context claim.
Terms used in this review
A plain-English reading companion for this review and its hardware specifications. Select a term to read its meaning and why it matters. These explanations are not a transcript or quotations from the creator.
24 terms
CPU and CPU cores
The CPU runs the operating system and general instructions. A core is a unit inside it that can work on instructions.
Why it matters here: More cores can help some jobs, but core counts from different chip families are not a shared speed score.
GPU
A graphics processor can do many similar calculations at once. Local AI engines can use that ability to run a model.
Why it matters here: The engine must support the exact GPU and driver. A powerful GPU is not useful to an unsupported engine.
RAM
The computer’s working memory. The operating system, applications and a running model use it.
Why it matters here: A downloaded model can fit on your SSD and still be too large to load into working memory.
VRAM
Memory dedicated to a separate graphics card.
Why it matters here: When a model fits in VRAM with space for its working context, the engine may avoid moving data through slower system memory.
Unified or shared memory
One physical memory pool is shared by the CPU, GPU and the operating system.
Why it matters here: Do not count shared GPU memory as extra RAM. Leave room for the system and other applications.
DIMM and SO-DIMM
Formats for removable RAM modules. SO-DIMMs are smaller and often used in laptops and mini PCs.
Why it matters here: Do not assume every mini PC has memory slots. Many unified-memory systems use soldered memory instead.
GB/s and Gbps
GB/s means gigabytes per second; Gbps means gigabits per second. A byte contains eight bits.
Why it matters here: A10Gbps network number is not the same as10GB/s of memory bandwidth. Check the units before comparing specifications.
Memory bandwidth
How much data the memory system can move per second. Capacity and bandwidth describe different things.
Why it matters here: A machine may hold a very large model but generate its answers slowly. Check actual model tests.
SSD, NVMe and M.2
An SSD stores files. NVMe is a fast storage protocol. M.2 describes a module and connector format.
Why it matters here: Model downloads live on storage, while a running model needs working memory. Check supported drive sizes and slots before upgrading.
Tokens and tokens per second
A token is a small piece of text. Tokens per second describes how quickly a model produces or processes those pieces.
Why it matters here: Reading the prompt and writing the answer are different measurements. Ask which stage the reviewer measured.
Context window
The amount of text a model can work with at once, including the prompt, conversation and other supplied text.
Why it matters here: A larger setting uses more working memory and can increase loading or response time. Start with enough for your real task.
KV cache
Working memory that keeps information from earlier tokens so the model can use it while continuing an answer.
Why it matters here: Longer context can make this cache larger. Model-file size alone does not describe total memory use.
Quantization and Q4
A way to store model numbers using fewer bits. Q4 usually describes a roughly four-bit approach, with different formats and tradeoffs.
Why it matters here: Lower-bit files often need less memory, but quality and speed can change. Compare the exact file, not just the model name.
Parameters and “B”
Parameters are the model’s learned numbers. B means billion, so 8B means about eight billion parameters.
Why it matters here: More parameters do not guarantee a better result for every task. The model must also fit and respond at a useful speed.
GPU offload
Running some or all of a model’s work on the GPU instead of the CPU.
Why it matters here: Partial offload can allow a model to run, but it is not proof that the complete model fits in the GPU’s memory.
Inference engine
The software that loads a model and performs its calculations to produce an answer.
Why it matters here: The same hardware can behave differently with different engines, drivers and model files.
GGUF
A model-file format used by llama.cpp and several local AI applications.
Why it matters here: Choose the model format your engine supports. A downloadable model is not automatically compatible with every application.
Metal and MLX
Apple technologies that local AI applications can use to run calculations on Apple Silicon.
Why it matters here: Use a native engine and a supported model artifact. NVIDIA CUDA instructions do not transfer directly to a Mac.
CUDA
NVIDIA’s software platform for GPU computing.
Why it matters here: CUDA-based tools need compatible NVIDIA hardware and software. A CUDA tutorial is not an AMD installation guide.
Time to first token
The wait before the model starts producing its answer.
Why it matters here: A system can write quickly once started but still spend a long time reading a large document first.
RAG
Retrieval-augmented generation: finding relevant passages from documents and supplying them to a model with your question.
Why it matters here: This can help answer from your files, but you still need to check the cited passages and answer accuracy.
TDP and power supply rating
TDP is a chip cooling or power-design figure. The power supply rating is the amount the supply is designed to provide.
Why it matters here: Neither number alone is a measurement of the full system’s electricity use during your AI task.
NPU or Neural Engine
A specialized processor for supported AI workloads.
Why it matters here: An NPU specification does not mean your chosen local language-model engine uses it.
Cluster and multi-node
Two or more computers working together through software and a network.
Why it matters here: More machines do not automatically mean faster answers or one shared memory pool. Check single-machine and cluster results separately.
Further reading: LM Studio load settings · Quantization · KV cache
What the creator tested
These observations belong to this source and configuration. Changing the model file, context or software can change the result.
Llama 3 8B
Engine: Jan.ai · Quantization: Q4
Generated answers with maximum GPU offload.
No exact family-and-size catalog link recorded. Use the creator’s source for the tested model.
Is it useful for your work?
Editorial inference: Useful if already owned or attractively priced used; choose memory carefully before purchase.
Check before buying
- Reviewed SSD capacity not stated.
- No current pricing verified.
Check current price, regional availability, returns, warranty and the exact memory configuration with the seller. This guide does not guarantee a specific speed.
Community and reproducibility
No separately verified owner report is attached to this profile yet. The creator test above is the evidence currently recorded.
Have this hardware? Share the exact model file, engine version, memory, context length, speed and any setup problems.
Contribute your testMatch the exact configuration
Check memory, storage, model number, seller warranty, returns and shipping to your country. A product-family name does not identify every component inside.
View manufacturer options ↗