AI 4UAnalyze my business

Plain-language AI glossary

Term 15InfrastructureMeaning / context / connections

Infrastructure / Definition

Inference

The process of running a trained AI model to generate predictions or outputs from new inputs, as opposed to training the model.

Browse all termsUnderstand the idea
15of 75
01

MeaningThe one-sentence definition.

02

ContextHow the idea works in practice.

03

UsesWhere the concept becomes useful.

01 / Plain-language context

How Inference works.

Inference happens whenever a trained model processes a new input and produces an output. Cost and latency depend on factors such as model size, input length, output length, reasoning settings, batching, caching, and where the model runs. A hosted API reduces infrastructure work, while self-hosting can provide more deployment control at the cost of operating the hardware and serving stack.

02 / Practical uses

Where it helps.

  1. 01API-based AI features
  2. 02Real-time predictions
  3. 03Batch processing
  4. 04Edge deployment
03 / Keep exploring
Large Language Model (LLM)A neural network trained on massive text datasets that can generate, understand, and reason about human language.TokenizationThe process of breaking text into smaller units (tokens) that an AI model can process, typically subwords or word pieces.Fine-TuningThe process of further training a pre-trained AI model on your specific data to improve performance on domain-specific tasks.