inference Directory Reference

Directory dependency graph for inference:

Directories
	adapters

Files
	adapter_manager.h
	AdapterManager — LoRA adapter lifecycle and hot-swap.
	backend.h
	InferenceBackend concrete base class.
	grammar_registry.h
	GrammarRegistry — named grammar management and validation.
	image_preprocessor.h
	Image preprocessing for multimodal inference.
	interface_factory.h
	Factory for building InferenceInterface from a ModelOrchestrator.
	orchestrator.h
	ModelOrchestrator — multi-model lifecycle and routing.
	profile_registry.h
	ProfileRegistry – named GPU resource profile management.
	secondary_model_loader.h
	Unified lifecycle for non-primary inference backends.
	speculative_compat.h
	Tokenizer/architecture compatibility check for speculative decoding draft pairing.
	throughput_tracker.h
	ThroughputTracker – real-time throughput measurement and prediction.