entropic::PoolGeometry Struct Reference

Context geometry derived from a tier's session-pool request. More...

#include </home/runner/work/entropic/entropic/src/inference/session_pool_util.h>

Public Attributes
int	n_seq_max = 1
	cparams.n_seq_max
bool	kv_unified = false
	cparams.kv_unified
int	n_ctx = 0
	cparams.n_ctx (TOTAL cells, all streams)
int	temp_seq_base = 1
	First seq id the batch fan-out may use.

Detailed Description

Context geometry derived from a tier's session-pool request.

Definition at line 51 of file session_pool_util.h.

Member Data Documentation

kv_unified

bool entropic::PoolGeometry::kv_unified = false

cparams.kv_unified

Definition at line 53 of file session_pool_util.h.

n_ctx

int entropic::PoolGeometry::n_ctx = 0

cparams.n_ctx (TOTAL cells, all streams)

Definition at line 54 of file session_pool_util.h.

n_seq_max

int entropic::PoolGeometry::n_seq_max = 1

cparams.n_seq_max

Definition at line 52 of file session_pool_util.h.

temp_seq_base

int entropic::PoolGeometry::temp_seq_base = 1

First seq id the batch fan-out may use.

Definition at line 55 of file session_pool_util.h.

---

The documentation for this struct was generated from the following file:

• inference/session_pool_util.h