entropic::CacheEntry Struct Reference

Single cached KV state snapshot. More...

#include </home/runner/work/entropic/entropic/src/inference/prompt_cache.h>

Public Attributes
std::vector< uint8_t >	data
	Raw KV cache bytes.
int	token_count
	Prompt tokens covered by this entry.
size_t	data_size
	data.size() for quick byte accounting

Detailed Description

Single cached KV state snapshot.

Version

1.8.3

Definition at line 62 of file prompt_cache.h.

Member Data Documentation

data

std::vector<uint8_t> entropic::CacheEntry::data

Raw KV cache bytes.

Definition at line 63 of file prompt_cache.h.

data_size

size_t entropic::CacheEntry::data_size

data.size() for quick byte accounting

Definition at line 65 of file prompt_cache.h.

token_count

int entropic::CacheEntry::token_count

Prompt tokens covered by this entry.

Definition at line 64 of file prompt_cache.h.

---

The documentation for this struct was generated from the following file:

• inference/prompt_cache.h