Decision models in llama.cpp Jev project
Decision models in llama.cpp is a Open source project built with Jev. Six launch models answer at /v1/systemone in ggml-org's llama.cpp, returning a probability
Six launch models answer at /v1/systemone in ggml-org's llama.cpp, returning a probability per option, with one-question medians of 3-43 ms on an RTX PRO 6000.
Category: Open source. Built with Jev.
Author: ggml-org
More Jev projects are on Jev projects and apps. Related: Laya projects and apps.