backend_capability.h File Reference

Backend capability flags and metadata for architecture-agnostic queries. More...

#include <cstddef>
#include <string>

Include dependency graph for backend_capability.h:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
struct	entropic::BackendInfo
	Backend metadata for introspection. More...

Namespaces
namespace	entropic
	Activate model on GPU (WARM → ACTIVE).

Enumerations
enum class	entropic::BackendCapability : int {   entropic::KV_CACHE = 0 , entropic::HIDDEN_STATE = 1 , entropic::STREAMING = 2 , entropic::RAW_COMPLETION = 3 ,   entropic::GRAMMAR = 4 , entropic::LORA_ADAPTERS = 5 , entropic::MULTI_SEQUENCE = 6 , entropic::TOKENIZER = 7 ,   entropic::LOG_PROBS = 8 , entropic::VISION = 9 , entropic::SPECULATIVE_DECODING = 10 , entropic::PROMPT_CACHING = 11 ,   entropic::AUDIO = 12 , entropic::_COUNT }
	Capabilities that an inference backend may or may not support. More...

Detailed Description

Backend capability flags and metadata for architecture-agnostic queries.

Backends declare what they support; the engine queries before using optional features. A backend that does not support a capability returns graceful errors (not crashes) if the feature is invoked anyway.

Version

1.9.13

Definition in file backend_capability.h.