Fast, small, and fully autonomous AI personal assistant infrastructure, any OS, any platform — deploy anywhere, swap anything 🦀

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Postgres with GPUs for ML/AI apps.

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

A blazing fast inference solution for text embeddings models

Framework to prove inference of ML models blazingly fast

playwright for windows computer use

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

🧠 Motorhead is a memory and information retrieval server for LLMs.

Fast, streaming indexing, query, and agentic LLM applications in Rust

An Open-Source Machine Learning Framework in Rust Δ

⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.

SciRS2 - Scientific Computing and AI in Rust., providing SciPy-compatible APIs while leveraging Rust's performance, safety, and concurrency features. Unlike traditional scientific libraries

Powerful Powerful Machine Learning library with GPU, CPU and WASM backends

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

AI no jimaku gumi (AIの字幕組), a subtitle maker for video using AI.

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework in Rust

Real-time data processing/feature engineering tailored for modern AI/ML systems.

Rust implementation of Qwen3-TTS speech synthesis