entropic::InferenceConfig Struct Reference

Inference-side configuration knobs (v2.1.11). More...

#include <entropic/types/config.h>

Collaboration diagram for entropic::InferenceConfig:

Public Attributes
SpeculativeConfig	speculative
	Speculative decoding (gh#36)

Detailed Description

Inference-side configuration knobs (v2.1.11).

Sub-tree mirroring the proposal's inference.* YAML namespace. Currently holds speculative decoding only; future inference-level settings land here rather than spreading across ParsedConfig.

Version

2.1.11

Definition at line 702 of file config.h.

Member Data Documentation

speculative

SpeculativeConfig entropic::InferenceConfig::speculative

Speculative decoding (gh#36)

Definition at line 703 of file config.h.

---

The documentation for this struct was generated from the following file:

• entropic/types/config.h