Glossary / AI & data

Inference (AI inference)

Inference is an AI model actually running — taking your input and producing an answer — as opposed to training, which is how the model was built. Inference is what you pay for in production, priced per token or per second, and its speed and cost shape what's economically viable to automate. Efficient inference architecture is the difference between an AI feature that profits and one that quietly burns margin.