entropic::CacheStats Struct Reference

Cumulative cache performance counters. More...

#include </home/runner/work/entropic/entropic/src/inference/prompt_cache.h>

Public Attributes
uint64_t	hits = 0
	Successful lookups.
uint64_t	misses = 0
	Failed lookups.
uint64_t	evictions = 0
	LRU evictions.
uint64_t	stores = 0
	Successful stores.
size_t	peak_bytes = 0
	High-water mark of bytes_used.

Detailed Description

Cumulative cache performance counters.

Version

1.8.3

Definition at line 72 of file prompt_cache.h.

Member Data Documentation

evictions

uint64_t entropic::CacheStats::evictions = 0

LRU evictions.

Definition at line 75 of file prompt_cache.h.

hits

uint64_t entropic::CacheStats::hits = 0

Successful lookups.

Definition at line 73 of file prompt_cache.h.

misses

uint64_t entropic::CacheStats::misses = 0

Failed lookups.

Definition at line 74 of file prompt_cache.h.

peak_bytes

size_t entropic::CacheStats::peak_bytes = 0

High-water mark of bytes_used.

Definition at line 77 of file prompt_cache.h.

stores

uint64_t entropic::CacheStats::stores = 0

Successful stores.

Definition at line 76 of file prompt_cache.h.

---

The documentation for this struct was generated from the following file:

• inference/prompt_cache.h