Entropic 2.3.8
Local-first agentic inference engine
Loading...
Searching...
No Matches
logprob_result.h
Go to the documentation of this file.
1// SPDX-License-Identifier: Apache-2.0
20#pragma once
21
22#include <cstdint>
23#include <vector>
24
25namespace entropic {
26
37 std::vector<float> logprobs;
38 std::vector<int32_t> tokens;
39 float perplexity = 0.0f;
40 float total_logprob = 0.0f;
41 int n_tokens = 0;
42 int n_logprobs = 0;
43};
44
45} // namespace entropic
Activate model on GPU (WARM → ACTIVE).
Per-token log-probability evaluation result.
std::vector< float > logprobs
Log-prob for each token transition (N-1 values)
int n_logprobs
Number of logprob values (n_tokens - 1)
int n_tokens
Number of input tokens.
float total_logprob
Sum of all logprob values.
float perplexity
exp(-mean(logprobs)) — lower = less surprising
std::vector< int32_t > tokens
Input tokens echoed back for verification.