SSD Nodes Learn 🎉 VPS from $5.50/mo
How to do am Matt ConnorBy Matt Connor · Updated 2026-08-13

AI Agent vs LLM vs Assistant: Wetin Be the Difference?

LLM na weights wey need RAM. Assistant add chat surface, while agent add tools, loop and credentials, so e need machine wey stay on and credential rotation.

Wetin be the difference between AI agent, LLM and AI assistant?

AI agent, LLM and AI assistant na three layers for one stack. To tell dem apart, ask wetin each one need from server. LLM (large language model) na file wey contain weights. E need RAM and compute. Assistant na that model wey dem wrap inside chat surface, with account and saved history. Almost every time, e dey run for another person hardware. Agent na assistant wey get tools and loop too. E dey hold credentials. Na this one make e need machine wey dey on continuously.

Plenty writing about this question stop for definitions. The definitions matter because each layer get different cost. One dey cost RAM. The next one dey cost public URL and TLS (transport layer security). The last one dey cost credentials. Once agent don use credential, you need rotate that credential.

LLM na weights, and weights need RAM

LLM na file wey contain numbers. You download am, runtime load am into memory, and e answer one request at a time. The contract narrow: text go in, text go out. Model no get memory between calls, no clock, no network access, and no way to open file. Anything wey LLM appear to remember na the program wey call am paste am into its context.

The number wey decide your VPS plan na the size of that file, because the whole file dey memory while model dey run. For the 4-bit quantisation wey Ollama ship by default, count roughly 0.6 GB for every billion parameters. Then add one or two gigabytes for context window and runtime itself.

ChartQwen3 download size and the RAM the box needs (published sizes, ollama.com, August 2026)
The data behind this chart
[
  {
    "label": "qwen3:4b",
    "download_gb": 2.5,
    "ram_gb_needed": 6
  },
  {
    "label": "qwen3:8b",
    "download_gb": 5.2,
    "ram_gb_needed": 8
  },
  {
    "label": "qwen3:14b",
    "download_gb": 9.3,
    "ram_gb_needed": 12
  },
  {
    "label": "qwen3:32b",
    "download_gb": 20.0,
    "ram_gb_needed": 24
  }
]

The qwen3:8b build dey 5.2 GB for disk and need about 8 GB RAM to run without swapping. 4 GB VPS no go load qwen3:14b, wey be 9.3 GB before you type even one word into am. The biggest row here, qwen3:32b, need about 24 GB, and for most price lists, na different plan and different monthly bill be that.

Whether e fit enter memory na one question. Speed na another one. For CPU-only VPS, bottleneck na memory bandwidth, no be clock speed. So model wey fit enter memory still fit answer only a few tokens per second. That one okay for job wey run overnight, but e no pleasant for chat. GPU fit increase that figure by roughly one order of magnitude, and e go increase your bill too. So decide with measurement: benchmark the VPS with the workload you plan to run and read when a GPU VPS earns its price. To make weights run at all, start with Ollama on your own VPS.

Assistant na LLM plus chat surface

Assistant na product layer wey dey around model. ChatGPT and Claude na assistants: model, chat window, account, saved conversations, rate limit. Almost none of these dey run for hardware wey you control. Na why hosted assistant dey cost subscription and zero RAM.

The self-hosted version na front end like Open WebUI wey point to local Ollama or hosted API. The front end na small software. Expect about 1 GB resident for the chat surface, on top of wetin the model need. But e need public URL and certificate, while bare model no need am, because you want reach am from phone: issue the certificate with Certbot and Nginx, or terminate TLS at Traefik in front of several apps. If you never choose front end yet, compare Open WebUI alternatives.

Assistant dey answer. E no dey act. When e write shell command, person go read the command and decide whether to paste am. That person na safety layer, and agent na the thing wey remove am.

Agent dey add tools and one loop

Agent na assistant wey fit call functions, then read the results. Two parts dey do the work. The first one na tool: description of function wey model fit request, plus your code wey actually run am. The second one na loop: your program call model, model ask for tool, your program run am, add the output to the conversation, then call model again. This one repeat until model talk say e finish, or limit stop am.

Loop na ordinary code, and basic one fit dey under one hundred lines. Wetin make am agent be say the tools get real credentials, so the loop fit change something outside itself. Na this fact drive every hosting decision wey follow. Agent skills and MCP (model context protocol) servers na two ways to give agent more tools without rewriting the loop.

Wetin each layer need from the box

ChartWhat each layer asks of a server you own
The data behind this chart
[
  {
    "label": "LLM (weights you host)",
    "ram_gb": 8,
    "gpu": "helps a lot",
    "public_url": "no",
    "credentials": "none"
  },
  {
    "label": "Assistant (chat surface)",
    "ram_gb": 1,
    "gpu": "no",
    "public_url": "yes",
    "credentials": "one login"
  },
  {
    "label": "Agent (tools and a loop)",
    "ram_gb": 2,
    "gpu": "no",
    "public_url": "only for webhooks",
    "credentials": "several"
  }
]

Read the RAM column well, because e no include the model. Chat front end and agent runtime na both small programs. If the agent dey call hosted model, 2 GB of RAM fit run am, and cheap plan na correct answer, no be compromise. If you put the weights for the same box, the 8 GB model line go pass everything else by far.

The other columns matter pass wetin people dey expect. Na only model layer dey faster with GPU. Na only assistant layer need public URL as normal requirement, because browser need reach am; agent need one only when something outside need call inside, like webhook. And agent dey hold several credentials, and na this be the real difference between am and chat window. Chat window fit dey wrong. Agent fit dey wrong and still act based on the wrong answer.

You need GPU to run AI agent?

No, except say you dey host the model weights for the same machine. The agent loop na HTTP requests, JSON parsing, and subprocess calls. CPU dey almost idle while e dey wait for network. The GPU question really na question about the LLM layer.

So divide the decision. If the text no fit comot from your machine, pay for enough memory to hold model, and, if you want usable speed, pay for GPU to run am. If na only automation you want, rent the model by token and use the money for uptime and backups instead. Most self-hosted agents for 2026 dey call hosted model, and na why dem cheaper to run.

Agent fit dey self-host?

Yes, and na the agent layer make most sense to self-host, because na the loop hold your data and credentials. Small VPS wey get 2 GB RAM, service manager, and outbound network access fit run real agent. Choose the build-your-own route on a VPS if you want control the loop yourself, or deploy one of the ready-made self-hosted agents if you prefer start with something wey don ready.

To self-host the assistant easy: na one container and one certificate. To self-host the model na the expensive part, and na there many people dey give up after dem watch tokens dey crawl out from CPU. Self-host the weights when the data no fit leave the box, or when your usage volume make per-token pricing too costly. Otherwise, make the agent call an API and keep the important parts local.

ChatGPT na AI agent?

Chat product go become agent immediately e fit call tool and act on the result without asking you first. By this test, hosted assistants wey get browsing, code execution, or connectors na agents. The difference for you na where the loop dey run and whose credentials e dey use. For hosted product, vendor own both. For your own server, you own both, together with responsibility for anything wey the loop do for 3 in the morning.

Reactive, planning na multi-agent

Roundup dem like list seven types of agent. Plenty of those types na just marketing. Two differences dey change the code wey you write, and one dey change the bill. Reactive agent dey call tool, read the answer, then reply. Planning agent first dey write plan, then e work through am. This one dey handle long jobs better, but e dey cost more tokens because dem dey send the plan again for every step. Multi-agent setup let one agent start other agents. E dey multiply token spending and ways wey things fit fail at the same time. So e only make sense when the sub-jobs really independent, like searching four sources at once. Start with reactive. Add planning when runs begin long. Use multi-agent last. For the wider map, see wetin worth learning about AI agents for 2026.

How to know which layer you dey actually run

For server, ask which processes dey hold the memory.

free -h
ps -eo rss,comm --sort=-rss | head -5

If top line na ollama or llama-server wey dey hold several gigabytes of RSS (resident set size, na the memory wey process dey really occupy), na you dey host the model. If nothing pass a few hundred megabytes and your API bill dey continue grow, na you dey host an agent or assistant, while you dey rent the model. If that list empty because everything dey happen for browser tab, na you be customer of an assistant. That one dey okay until you need software wey go act on your behalf.

Wich one you wan run?

FAQ

AI agent na just LLM wey get extra steps?

The extra steps na the actual product. LLM dey turn text to text, and nothing more. Agent surround am with tools wey e fit call and loop wey continue to call dem. Those tools carry credentials, so output fit change file, database, or live service. Na why agent need machine wey dey on, service manager, and secrets policy. LLM only need enough memory to hold im weights while e dey answer.

I need GPU to run AI agent?

No be for the agent itself. The loop na HTTP requests, JSON handling, and subprocess calls. Any CPU fit manage these things while e dey wait for network. You only need GPU when you host the model weights by yourself and want more than few tokens per second from dem. Agent wey dey call hosted model fit run well for small VPS without any GPU.

How much RAM VPS need for AI agent?

About 2 GB when agent dey call hosted model, because na runtime, im dependencies, and small local database e dey hold. Add the model on top if you host the weights: qwen3:8b alone need around 8 GB. So, all-in-one box go start from that level and increase based on the model wey you choose.

I fit self-host AI assistant and keep my conversations private?

Yes, but one caveat dey decide everything. Self-hosted front end like Open WebUI dey keep accounts and history for your server. The conversations go remain private only if the model behind am dey local too. If you point the same front end to hosted API, the text still dey leave your box for every message. So you keep the history, but you no keep the privacy.

Wetin be the difference between AI agent and chatbot?

Chatbot dey reply and stop. Agent dey decide wetin to do next, call tool, read the result, and decide again until e finish the job or limit stop am. The practical test be this: if the software fit change something without human pressing button between the answer and the action, na agent be that. E need the hosting and guardrails wey come with am.