20class ModelOrchestrator;
21struct InterfaceContext;
41 ModelOrchestrator* orchestrator,
42 const std::string& default_tier,
43 InterfaceContext** out_context);
Function pointer types for core-to-inference communication.
Activate model on GPU (WARM → ACTIVE).
void destroy_orchestrator_interface(InterfaceContext *context)
Free a context returned by build_orchestrator_interface().
InferenceInterface build_orchestrator_interface(ModelOrchestrator *orchestrator, const std::string &default_tier, InterfaceContext **out_context)
Build an InferenceInterface wired to an orchestrator.