Concurrent LLM request pool with
Part of the llm-cpp toolkit -- 26 single-header C++ libraries for LLM infrastructure. Drop in what you need.
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Concurrent LLM request pool with
Part of the llm-cpp toolkit -- 26 single-header C++ libraries for LLM infrastructure. Drop in what you need.