device_memory.cpp File Reference

gh#142: ggml-backed free-VRAM query. More...

#include "device_memory.h"
#include <entropic/types/logging.h>
#include <ggml-backend.h>

Include dependency graph for device_memory.cpp:

Go to the source code of this file.

Namespaces
namespace	entropic
	Activate model on GPU (WARM → ACTIVE).

Functions
uint64_t	entropic::query_device_free_vram_bytes ()
	Free VRAM on the first GPU device ggml reports, in bytes.

Detailed Description

gh#142: ggml-backed free-VRAM query.

See device_memory.h.

Version

2.11.0

Definition in file device_memory.cpp.