Context passed to the streaming token callback. More...

Collaboration diagram for entropic::StreamAccumulator:

[legend]

Public Attributes
std::string	content
	Accumulated content.

EngineCallbacks *	callbacks
	Callback reference.

GenerationEvents *	events
	Event flags.

const HookInterface *	hooks
	Hook dispatch (v1.9.1)

int	token_index = 0
	Token counter (v1.9.1)

bool	interrupted = false
	Set when interrupt detected.

int *	cancel_flag = nullptr
	Pointer to the backend's cancel flag (gh#20, v2.1.5).

void(*	observer )(const char , size_t, void ) = nullptr
	Global observer — fires on every token alongside callbacks->on_stream_chunk.

void *	observer_data = nullptr
	Observer user_data.

Detailed Description

Context passed to the streaming token callback.

@dg_internal

Version: 1.8.4

Definition at line 248 of file response_generator.cpp.

Member Data Documentation

◆ callbacks

EngineCallbacks* entropic::StreamAccumulator::callbacks

Callback reference.

Definition at line 250 of file response_generator.cpp.

◆ cancel_flag

int* entropic::StreamAccumulator::cancel_flag = nullptr

Pointer to the backend's cancel flag (gh#20, v2.1.5).

When the interrupt event fires, the token callback writes 1 here so the next iteration of the backend's decode loop stops within a single token instead of running to natural EOS.

Definition at line 260 of file response_generator.cpp.

◆ content

std::string entropic::StreamAccumulator::content

Accumulated content.

Definition at line 249 of file response_generator.cpp.

◆ events

GenerationEvents* entropic::StreamAccumulator::events

Event flags.

Definition at line 251 of file response_generator.cpp.

◆ hooks

const HookInterface* entropic::StreamAccumulator::hooks

Hook dispatch (v1.9.1)

Definition at line 252 of file response_generator.cpp.

◆ interrupted

bool entropic::StreamAccumulator::interrupted = false

Set when interrupt detected.

Definition at line 254 of file response_generator.cpp.

◆ observer

void(* entropic::StreamAccumulator::observer) (const char *, size_t, void *) = nullptr

Global observer — fires on every token alongside callbacks->on_stream_chunk.

(2.0.6-rc16)

Definition at line 263 of file response_generator.cpp.

◆ observer_data

void* entropic::StreamAccumulator::observer_data = nullptr

Observer user_data.

Definition at line 264 of file response_generator.cpp.

◆ token_index

int entropic::StreamAccumulator::token_index = 0

Token counter (v1.9.1)

Definition at line 253 of file response_generator.cpp.

The documentation for this struct was generated from the following file:

core/response_generator.cpp

Public Attributes