The inference engine is the component that runs trained machine learning models on target devices. After a model has been trained on the Nordic Edge AI platform, the inference engine processes new input data, applies the learned model, and outputs predictions. It is designed to operate efficiently on devices with limited computational resources.