Latency
Category: Infrastructure“LAY-ten-see”
The delay between asking an AI something and getting the answer back.
Lesson #3: Under the Hood: Models, Meaning & Speed →The pause between flipping a switch and the light actually coming on.
A voice assistant taking two seconds to answer instead of one.
A field app that stalls when checking specs on a weak signal.
A chat widget losing customers because replies take eight seconds.
Slow AI gets abandoned — speed often matters more to users than a slightly smarter answer.
Latency is the wait time between question and answer.
Time how long your most-used AI tool takes to answer. Anything over 5s hurts.
Hover or focus a choice to preview the new review date.
Exercises by category
- Agents0/21 · 0%
- Models0/10 · 0%
- Data0/11 · 0%
- Infrastructure0/22 · 0%
- Fundamentals0/15 · 0%
- NobleHub0/20 · 0%
Next badge: First Nail — 1 more exercise
Related terms
Picked automatically from the same category and the ideas this term shares.
Hand-picked pair
A doorway that lets two pieces of software talk to each other.
Hand-picked pair
Setting up work so it happens by itself, without someone doing it each time.
Hand-picked pair
Inference is when an AI uses what it has already learned to answer a question, make a prediction, or complete a task.
Same category: Infrastructure
Getting into a company by compromising something it depends on — a vendor, a plugin, or a piece of borrowed code.
Same category: Infrastructure
An automatic message one app sends to another the moment something happens, so nobody has to keep checking for updates.
Same category: Infrastructure
A tamper-resistant record of who did what, when, and to which record — including actions taken by an AI.