Entropic 2.3.8
Local-first agentic inference engine
Loading...
Searching...
No Matches
speculative_compat.h
Go to the documentation of this file.
1// SPDX-License-Identifier: Apache-2.0
43#pragma once
44
45#include <string>
46
47struct llama_model;
48
49namespace entropic::speculative {
50
56struct CompatResult {
57 bool compatible = false;
58 std::string diagnostic;
60};
61
93CompatResult check_compat(
94 const llama_model* target, const llama_model* draft);
95
96} // namespace entropic::speculative
entropic::speculative::check_compat
CompatResult check_compat(const llama_model *target, const llama_model *draft)
Check whether a draft model can pair with a target for sequential speculative decoding.
Definition speculative_compat.cpp:271
entropic::speculative::CompatResult
Result of a draft/target compatibility check.
Definition speculative_compat.h:56
entropic::speculative::CompatResult::diagnostic
std::string diagnostic
Human-readable reason on failure (empty when compatible).
Definition speculative_compat.h:58
entropic::speculative::CompatResult::compatible
bool compatible
true when draft can pair with target
Definition speculative_compat.h:57