entropic::ModelOrchestrator::SpeculativeCompatInfo Struct Reference

Result of a speculative-decoding compatibility check. More...

#include <entropic/inference/orchestrator.h>

Public Attributes
bool	compatible = false
	true when speculative may proceed
std::string	diagnostic
	Reason on failure (empty on ok)

Detailed Description

Result of a speculative-decoding compatibility check.

Version

2.1.11

Definition at line 265 of file orchestrator.h.

Member Data Documentation

compatible

bool entropic::ModelOrchestrator::SpeculativeCompatInfo::compatible = false

true when speculative may proceed

Definition at line 266 of file orchestrator.h.

diagnostic

std::string entropic::ModelOrchestrator::SpeculativeCompatInfo::diagnostic

Reason on failure (empty on ok)

Definition at line 267 of file orchestrator.h.

---

The documentation for this struct was generated from the following file:

• entropic/inference/orchestrator.h