Back to glossary

Infrastructure

Latency

Definition

Time from sending a request to getting a response.

Why it matters

If your AI chatbot takes 10 seconds to respond, customers leave.

Open Weights / Open-Source Models AI-native

Practice with flashcards