entropic::FootprintInputs Struct Reference

Everything the estimate needs, with no orchestrator or filesystem. More...

#include </home/runner/work/entropic/entropic/src/inference/vram_footprint.h>

Public Attributes
uint64_t	weights_bytes = 0
	Size of the tier's GGUF on disk.
uint64_t	mmproj_bytes = 0
	Size of the vision projector, 0 if none.
int	gpu_layers = -1
	Tier's requested offload (-1 = all).
int	context_length = 0
	Tier's requested context window.
std::string	cache_type_k = "f16"
	KV key cache quantization.
std::string	cache_type_v = "f16"
	KV value cache quantization.
int	vram_reserve_mb = 0
	Configured headroom to leave free.

Detailed Description

Everything the estimate needs, with no orchestrator or filesystem.

Definition at line 82 of file vram_footprint.h.

Member Data Documentation

cache_type_k

std::string entropic::FootprintInputs::cache_type_k = "f16"

KV key cache quantization.

Definition at line 87 of file vram_footprint.h.

cache_type_v

std::string entropic::FootprintInputs::cache_type_v = "f16"

KV value cache quantization.

Definition at line 88 of file vram_footprint.h.

context_length

int entropic::FootprintInputs::context_length = 0

Tier's requested context window.

Definition at line 86 of file vram_footprint.h.

gpu_layers

int entropic::FootprintInputs::gpu_layers = -1

Tier's requested offload (-1 = all).

Definition at line 85 of file vram_footprint.h.

mmproj_bytes

uint64_t entropic::FootprintInputs::mmproj_bytes = 0

Size of the vision projector, 0 if none.

Definition at line 84 of file vram_footprint.h.

vram_reserve_mb

int entropic::FootprintInputs::vram_reserve_mb = 0

Configured headroom to leave free.

Definition at line 89 of file vram_footprint.h.

weights_bytes

uint64_t entropic::FootprintInputs::weights_bytes = 0

Size of the tier's GGUF on disk.

Definition at line 83 of file vram_footprint.h.

---

The documentation for this struct was generated from the following file:

• inference/vram_footprint.h