What is local AI? A beginner’s guide to AI on your computer

Start with the word local

Imagine you want help writing an invitation. With cloud AI, your request travels across the internet to another company’s computers. Those computers do the AI work and send an answer back.

With local AI, the AI work happens on your laptop, desktop, or a nearby machine you manage. Local describes where the work happens. It does not describe how clever the answer will be.

AI means artificial intelligence. In this series, we mostly mean programs that create text, such as a draft, a summary, or a reply. Other kinds of AI work with pictures and sound.

Follow the path of a question

The diagram shows one fully local chat. The model is the downloaded set of learned values. The engine is the software that runs it. We will explain those in the next two lessons.

For cloud chat, the middle part happens on a remote computer. The chat window may look the same. A familiar screen does not tell you where your information goes.

A useful everyday example

A shop owner writes a rough note: “Closed Friday. Back Saturday at nine.” A local text model can turn that note into a polite notice. The owner checks the day and time before putting it on the door.

That is a useful small task. The model does not need today’s news or private customer records. It can still make a mistake, so the owner remains responsible for the notice.

Start with work you can easily check. A model that sounds friendly can still invent details.

Does local AI need the internet?

You usually need the internet to download the app and a model. Once the needed files are present, supported offline chat can work without a connection.

Web search, cloud models, online voice services, and some extensions still need the internet. Turning on one of these may send data outside your computer. Local AI is not an automatic privacy promise.

Is it free, and will it work on any laptop?

Some apps and model downloads are free to use, but running them still uses electricity, disk space, and your computer’s memory. Licences can also limit how a model may be used.

An older laptop may run a small model slowly. A larger model may not fit at all. There is no honest “works on every computer” answer. Use the calculator to find a cautious starting point, then test it.

Cloud AI may be the easier choice when you need powerful features and do not want to manage software.

Try it: draw your data path

Write a harmless task, such as rewriting a birthday invitation. Draw three boxes: you, the computer doing the work, and the answer.

If you already have a local app, check its documentation for offline use. After downloading its required files, disconnect from the internet and try the harmless task. A working reply shows that this particular task can run offline; it does not prove every feature is private.

• Do not begin with passwords, private records, or important decisions.
• Check the answer for invented names, dates, and promises.
• Remember: local tells you where, not whether the answer is correct.