代码库
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Python
agentscalibrationclassificationdecision-makingggufinferencellama-cppllmmlxopen-weightsreasoningvllm