A wannabe Ollama equivalent for Apple MlX models
-
Updated
Mar 2, 2025 - Shell
#
model-serving
Here are 13 public repositories matching this topic...
🚀 The Ultimate Curated List of LLMOps Tools, Frameworks, and Resources - A comprehensive collection of the best tools for Large Language Model Operations
machine-learning deep-learning inference artificial-intelligence openai awesome-list model-serving model-training rag mlops huggingface vector-database ml-tools ai-tools large-language-models llm prompt-engineering generative-ai langchain llmops
-
Updated
Jul 5, 2026 - Shell
Docker compose configs for serving Qwen3.8-27B on a DGX Spark (GB10): vLLM+MTP current, SGLang+DSPARK + FP8 rollback stacks
docker docker-compose nvidia quantization mtp model-serving blackwell llm fp8 llm-serving vllm qwen speculative-decoding sglang qwen3 gb10 nvfp4 dgx-spark
-
Updated
Aug 22, 2026 - Shell
Production-ready checklists and frameworks for deploying LLMs, GenAI models, and AI infrastructure. Covers vLLM, Kubernetes, GPU optimization, observability, compliance, and Day-0 to Day-2 operations.
kubernetes machine-learning deployment optimization best-practices checklists model-serving gpu-optimization mlops production-readiness ai-governance vllm genai llm-deployment ai-infrastructure
-
Updated
Aug 25, 2026 - Shell
Run GPT-OSS 120B on NVIDIA DGX Spark with vLLM, build an API server, and create a local AI coding assistant
amd cuda self-hosted nvidia llama hetzner model-serving dgx generative-ai local-llm gb10 dgx-spark moltbot openclaw nemoclaw hitechcloud
-
Updated
Aug 27, 2026 - Shell
Enterprise-grade, high-performance LLM serving on Kubernetes. OpenAI-compatible inference powered by vLLM and OpenVINO™ Model Server behind a unified AI gateway, with NUMA-aware CPU optimization for Intel® Xeon® - production model serving, routing, and security built in.
kubernetes openai inference-server model-serving mlops openai-api generative-ai llmops llm-serving vllm genai llm-inference openai-compatible
-
Updated
Aug 27, 2026 - Shell
Production-ready platform for deploying OpenAI-compatible LLM inference on Kubernetes. A one-command installer for enterprise generative AI on Intel® Xeon®, with vLLM and other serving engines, secure Keycloak authentication, and built-in observability - from bare metal to a scalable AI endpoint.
kubernetes openai inference-server model-serving mlops openai-api llm generative-ai llmops llm-serving vllm genai llm-inference openai-compatible
-
Updated
Aug 28, 2026 - Shell
Enterprise-grade, high-performance LLM serving on Kubernetes. OpenAI-compatible inference powered by vLLM and OpenVINO™ Model Server behind a unified AI gateway, with NUMA-aware CPU optimization for Intel® Xeon® — production model serving, routing, and security built in.
kubernetes openai inference-server model-serving mlops openai-api generative-ai llmops llm-serving vllm genai llm-inference openai-compatible
-
Updated
Aug 27, 2026 - Shell
Customize Nvidia Triton to use OpenShift Source to Image building
-
Updated
Jun 2, 2025 - Shell
End-to-end MLOps platform: Terraform + K3s + ArgoCD + MLflow + BentoML + Evidently AI + Prometheus/Grafana — self-hosted on a homelab
kubernetes devops terraform prometheus xgboost homelab model-serving gitops platform-engineering mlops mlflow argocd drift-detection github-actions k3s bentoml evidently-ai
-
Updated
May 31, 2026 - Shell
Production-ready platform for deploying OpenAI-compatible LLM inference on Kubernetes. A one-command installer for enterprise generative AI on Intel® Xeon®, with vLLM and other serving engines, secure Keycloak authentication, and built-in observability — from bare metal to a scalable AI endpoint.
kubernetes openai inference-server model-serving mlops openai-api generative-ai llmops llm-serving vllm genai llm-inference openai-compatible
-
Updated
Aug 28, 2026 - Shell
Local LLM inference lab with llama.cpp-compatible serving, GGUF model profiles, OpenAI-compatible API checks, and OpenWebUI integration.
bash automation inference developer-tools model-serving llm llama-cpp local-llm gguf openwebui ai-tooling openai-compatible
-
Updated
May 31, 2026 - Shell
Achieve state of the art inference performance with modern accelerators on Kubernetes
-
Updated
Aug 13, 2026 - Shell
Improve this page
Add a description, image, and links to the model-serving topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the model-serving topic, visit your repo's landing page and select "manage topics."