Entropic 2.9.4
Local-first agentic inference engine
Loading...
Searching...
No Matches
sampler.h
Go to the documentation of this file.
1// SPDX-License-Identifier: Apache-2.0
24#pragma once
25
27
28#include <cstdint>
29#include <memory>
30
31namespace entropic {
32
48class Sampler {
49public:
50 virtual ~Sampler() = default;
51
64 virtual int32_t sample() = 0;
65
78 virtual void reset() {}
79};
80
94public:
95 virtual ~SamplerFactory() = default;
96
110 virtual std::unique_ptr<Sampler> create(
111 const GenerationParams& params) = 0;
112};
113
114} // namespace entropic
Factory that materializes a Sampler from GenerationParams.
Definition sampler.h:93
virtual std::unique_ptr< Sampler > create(const GenerationParams &params)=0
Build a configured Sampler for one generation.
Pure-virtual per-generation sampler used by the decode loop.
Definition sampler.h:48
virtual int32_t sample()=0
Sample one token from the current decode position.
virtual void reset()
Reset internal sampler state.
Definition sampler.h:78
Configuration structs with defaults.
Activate model on GPU (WARM → ACTIVE).
Generation parameters for a single inference call.
Definition config.h:302