entropic::RoutingResult Struct Reference

Result metadata from a routing decision. More...

#include <entropic/inference/orchestrator.h>

Public Attributes
std::string	tier_name
	Selected tier.
std::string	previous_tier
	Previous tier (empty if first)
std::string	model_raw
	Raw model output (e.g. "2")
std::string	swap_action = "none"
	"none", "reused", "loaded"
double	routing_ms = 0.0
	Total routing time.
std::string	adapter_name
	Active adapter (empty = base model) (v1.9.2)
double	adapter_swap_ms = 0.0
	Adapter swap latency (v1.9.2)

Detailed Description

Result metadata from a routing decision.

Version

1.9.2 — added adapter_name, adapter_swap_ms

Definition at line 53 of file orchestrator.h.

Member Data Documentation

adapter_name

std::string entropic::RoutingResult::adapter_name

Active adapter (empty = base model) (v1.9.2)

Definition at line 59 of file orchestrator.h.

adapter_swap_ms

double entropic::RoutingResult::adapter_swap_ms = 0.0

Adapter swap latency (v1.9.2)

Definition at line 60 of file orchestrator.h.

model_raw

std::string entropic::RoutingResult::model_raw

Raw model output (e.g. "2")

Definition at line 56 of file orchestrator.h.

previous_tier

std::string entropic::RoutingResult::previous_tier

Previous tier (empty if first)

Definition at line 55 of file orchestrator.h.

routing_ms

double entropic::RoutingResult::routing_ms = 0.0

Total routing time.

Definition at line 58 of file orchestrator.h.

swap_action

std::string entropic::RoutingResult::swap_action = "none"

"none", "reused", "loaded"

Definition at line 57 of file orchestrator.h.

tier_name

std::string entropic::RoutingResult::tier_name

Selected tier.

Definition at line 54 of file orchestrator.h.

---

The documentation for this struct was generated from the following file:

• entropic/inference/orchestrator.h