device_memory.cpp File Reference

gh#142: ggml-backed free-VRAM query. More...

#include "device_memory.h"
#include <entropic/types/logging.h>
#include <ggml-backend.h>
#include "partial_offload.h"
#include <sys/resource.h>
#include <atomic>

Include dependency graph for device_memory.cpp:

Go to the source code of this file.

Namespaces
namespace	entropic
	Activate model on GPU (WARM → ACTIVE).

Functions
uint64_t	entropic::query_device_free_vram_bytes ()
	Free VRAM on the first GPU device ggml reports, in bytes.
uint64_t	entropic::host_memlock_limit_bytes ()
	This process's RLIMIT_MEMLOCK soft limit (gh#148).
uint64_t	entropic::device_memory_query_count ()
	How many device free-VRAM queries this process has made (gh#198).

Detailed Description

gh#142: ggml-backed free-VRAM query.

See device_memory.h.

Version

2.11.0

Definition in file device_memory.cpp.