Inference
In one sentenceUsing a trained model to get an answer. Every time you hit enter in ChatGPT, that is inference.
What it means
AI has two phases. Training is when the model learns (expensive, done once by the AI company). Inference is when the model is used to answer a request (happens billions of times a day).
Inference costs are why AI tools have usage limits, plans and Token Pricing.
How to use it
- You will mostly see this word in pricing pages and technical articles. It simply means "running the model".
Related terms
Training Data Token Pricing Model
Still fuzzy? Ask the evyAI agent to explain Inference with examples for your business.
Ask evyAI