feat: add MiniCPM5-1B model support

doc/source/getting_started/installation.rst

@@ -65,7 +65,7 @@ Currently, supported models include:
 
 .. vllm_start
 
-- ``code-llama``, ``code-llama-instruct``, ``code-llama-python``, ``deepseek``, ``deepseek-chat``, ``deepseek-coder``, ``deepseek-coder-instruct``, ``deepseek-r1-distill-llama``, ``gorilla-openfunctions-v2``, ``HuatuoGPT-o1-LLaMA-3.1``, ``llama-2``, ``llama-2-chat``, ``llama-3``, ``llama-3-instruct``, ``llama-3.1``, ``llama-3.1-instruct``, ``llama-3.3-instruct``, ``tiny-llama``, ``wizardcoder-python-v1.0``, ``wizardmath-v1.0``, ``Yi``, ``Yi-1.5``, ``Yi-1.5-chat``, ``Yi-1.5-chat-16k``, ``Yi-200k``, ``Yi-chat``
+- ``code-llama``, ``code-llama-instruct``, ``code-llama-python``, ``deepseek``, ``deepseek-chat``, ``deepseek-coder``, ``deepseek-coder-instruct``, ``deepseek-r1-distill-llama``, ``gorilla-openfunctions-v2``, ``HuatuoGPT-o1-LLaMA-3.1``, ``llama-2``, ``llama-2-chat``, ``llama-3``, ``llama-3-instruct``, ``llama-3.1``, ``llama-3.1-instruct``, ``llama-3.3-instruct``, ``minicpm5-1b``, ``tiny-llama``, ``wizardcoder-python-v1.0``, ``wizardmath-v1.0``, ``Yi``, ``Yi-1.5``, ``Yi-1.5-chat``, ``Yi-1.5-chat-16k``, ``Yi-200k``, ``Yi-chat``
 - ``codestral-v0.1``, ``mistral-instruct-v0.1``, ``mistral-instruct-v0.2``, ``mistral-instruct-v0.3``, ``mistral-large-instruct``, ``mistral-nemo-instruct``, ``mistral-v0.1``, ``openhermes-2.5``, ``seallm_v2``
 - ``Baichuan-M2``, ``codeqwen1.5``, ``codeqwen1.5-chat``, ``deepseek-r1-distill-qwen``, ``DianJin-R1``, ``fin-r1``, ``HuatuoGPT-o1-Qwen2.5``, ``KAT-V1``, ``marco-o1``, ``qwen1.5-chat``, ``qwen2-instruct``, ``qwen2.5``, ``qwen2.5-coder``, ``qwen2.5-coder-instruct``, ``qwen2.5-instruct``, ``qwen2.5-instruct-1m``, ``qwenLong-l1``, ``QwQ-32B``, ``QwQ-32B-Preview``, ``seallms-v3``, ``skywork-or1``, ``skywork-or1-preview``, ``XiYanSQL-QwenCoder-2504``
 - ``llama-3.2-vision``, ``llama-3.2-vision-instruct``
@@ -98,6 +98,7 @@ Currently, supported models include:
 - ``MiniMax-M2``, ``MiniMax-M2.5``, ``MiniMax-M2.7``
 - ``GLM-4.7-Flash``
 - ``glm-5``, ``glm-5.1``
+- ``DeepSeek-V4-Flash``, ``DeepSeek-V4-Pro``
 .. vllm_end
 
 To install Xinference and vLLM::

doc/source/models/builtin/llm/deepseek-v4-flash.rst

@@ -20,7 +20,7 @@ Model Spec 1 (pytorch, 284 Billion)
 - **Model Format:** pytorch
 - **Model Size (in billions):** 284
 - **Quantizations:** none
-- **Engines**: Transformers
+- **Engines**: vLLM, Transformers
 - **Model ID:** deepseek-ai/DeepSeek-V4-Flash
 - **Model Hubs**:  `Hugging Face <https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash>`__, `ModelScope <https://modelscope.cn/models/deepseek-ai/DeepSeek-V4-Flash>`__
 

doc/source/models/builtin/llm/deepseek-v4-pro.rst

@@ -20,7 +20,7 @@ Model Spec 1 (pytorch, 1600 Billion)
 - **Model Format:** pytorch
 - **Model Size (in billions):** 1600
 - **Quantizations:** none
-- **Engines**: Transformers
+- **Engines**: vLLM, Transformers
 - **Model ID:** deepseek-ai/DeepSeek-V4-Pro
 - **Model Hubs**:  `Hugging Face <https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro>`__, `ModelScope <https://modelscope.cn/models/deepseek-ai/DeepSeek-V4-Pro>`__
 

doc/source/models/builtin/llm/dianjin-r1.rst

@@ -7,7 +7,7 @@ DianJin-R1
 - **Context Length:** 32768
 - **Model Name:** DianJin-R1
 - **Languages:** en, zh
-- **Abilities:** chat, tools
+- **Abilities:** chat, reasoning, hybrid, tools
 - **Description:** Tongyi DianJin is a financial intelligence solution platform built by Alibaba Cloud, dedicated to providing financial business developers with a convenient artificial intelligence application development environment.
 
 Specifications

doc/source/models/builtin/llm/index.rst

@@ -187,7 +187,7 @@ The following is a list of built-in LLM in Xinference:
      - DeepSeek-VL2, an advanced series of large Mixture-of-Experts (MoE) Vision-Language Models that significantly improves upon its predecessor, DeepSeek-VL. DeepSeek-VL2 demonstrates superior capabilities across various tasks, including but not limited to visual question answering, optical character recognition, document/table/chart understanding, and visual grounding.
 
    * - :ref:`dianjin-r1 <models_llm_dianjin-r1>`
-     - chat, tools
+     - chat, reasoning, hybrid, tools
      - 32768
      - Tongyi DianJin is a financial intelligence solution platform built by Alibaba Cloud, dedicated to providing financial business developers with a convenient artificial intelligence application development environment.
 
@@ -426,6 +426,11 @@ The following is a list of built-in LLM in Xinference:
      - 32768
      - MiniCPM4 series are highly efficient large language models (LLMs) designed explicitly for end-side devices, which achieves this efficiency through systematic innovation in four key dimensions: model architecture, training data, training algorithms, and inference systems.
 
+   * - :ref:`minicpm5-1b <models_llm_minicpm5-1b>`
+     - chat, reasoning, hybrid, tools
+     - 131072
+     - MiniCPM5-1B is the first model in the MiniCPM5 series. It is a dense 1B Transformer built for on-device, local deployment, and resource-constrained scenarios, reaching 1B-class open-source SOTA. Supports hybrid thinking via enable_thinking and native XML-style tool calling (MCP-compatible).
+
    * - :ref:`minimax-m2 <models_llm_minimax-m2>`
      - chat, tools, reasoning
      - 196608
@@ -785,7 +790,7 @@ The following is a list of built-in LLM in Xinference:
 .. toctree::
    :maxdepth: 3
 
-  
+
    baichuan-2
 
    baichuan-2-chat
@@ -950,6 +955,8 @@ The following is a list of built-in LLM in Xinference:
 
    minicpm4
 
+   minicpm5-1b
+
    minimax-m2
 
    minimax-m2.5
@@ -1092,4 +1099,3 @@ The following is a list of built-in LLM in Xinference:
 
    yi-chat
 
-

doc/source/models/builtin/llm/minicpm5-1b.rst

@@ -0,0 +1,62 @@
+.. _models_llm_minicpm5-1b:
+
+========================================
+minicpm5-1b
+========================================
+
+- **Context Length:** 131072
+- **Model Name:** minicpm5-1b
+- **Languages:** en, zh
+- **Abilities:** chat, reasoning, hybrid, tools
+- **Description:** MiniCPM5-1B is the first model in the MiniCPM5 series. It is a dense 1B Transformer built for on-device, local deployment, and resource-constrained scenarios, reaching 1B-class open-source SOTA. Supports hybrid thinking via enable_thinking and native XML-style tool calling (MCP-compatible).
+
+Specifications
+^^^^^^^^^^^^^^
+
+
+Model Spec 1 (pytorch, 1 Billion)
+++++++++++++++++++++++++++++++++++++++++
+
+- **Model Format:** pytorch
+- **Model Size (in billions):** 1
+- **Quantizations:** none
+- **Engines**: vLLM, Transformers, SGLang
+- **Model ID:** openbmb/MiniCPM5-1B
+- **Model Hubs**:  `Hugging Face <https://huggingface.co/openbmb/MiniCPM5-1B>`__, `ModelScope <https://modelscope.cn/models/OpenBMB/MiniCPM5-1B>`__
+
+Execute the following command to launch the model, remember to replace ``${quantization}`` with your
+chosen quantization method from the options listed above::
+
+   xinference launch --model-engine ${engine} --model-name minicpm5-1b --size-in-billions 1 --model-format pytorch --quantization ${quantization}
+
+
+Model Spec 2 (ggufv2, 1 Billion)
+++++++++++++++++++++++++++++++++++++++++
+
+- **Model Format:** ggufv2
+- **Model Size (in billions):** 1
+- **Quantizations:** F16, Q4_K_M, Q8_0
+- **Engines**: vLLM, llama.cpp
+- **Model ID:** openbmb/MiniCPM5-1B-GGUF
+- **Model Hubs**:  `Hugging Face <https://huggingface.co/openbmb/MiniCPM5-1B-GGUF>`__, `ModelScope <https://modelscope.cn/models/OpenBMB/MiniCPM5-1B-GGUF>`__
+
+Execute the following command to launch the model, remember to replace ``${quantization}`` with your
+chosen quantization method from the options listed above::
+
+   xinference launch --model-engine ${engine} --model-name minicpm5-1b --size-in-billions 1 --model-format ggufv2 --quantization ${quantization}
+
+
+Model Spec 3 (mlx, 1 Billion)
+++++++++++++++++++++++++++++++++++++++++
+
+- **Model Format:** mlx
+- **Model Size (in billions):** 1
+- **Quantizations:** 4bit
+- **Engines**: MLX
+- **Model ID:** openbmb/MiniCPM5-1B-MLX
+- **Model Hubs**:  `Hugging Face <https://huggingface.co/openbmb/MiniCPM5-1B-MLX>`__, `ModelScope <https://modelscope.cn/models/OpenBMB/MiniCPM5-1B-MLX>`__
+
+Execute the following command to launch the model, remember to replace ``${quantization}`` with your
+chosen quantization method from the options listed above::
+
+   xinference launch --model-engine ${engine} --model-name minicpm5-1b --size-in-billions 1 --model-format mlx --quantization ${quantization}

doc/source/models/builtin/llm/qwen3.6.rst

@@ -46,7 +46,23 @@ chosen quantization method from the options listed above::
    xinference launch --model-engine ${engine} --model-name qwen3.6 --size-in-billions 27 --model-format fp8 --quantization ${quantization}
 
 
-Model Spec 3 (pytorch, 35 Billion)
+Model Spec 3 (awq, 27 Billion)
+++++++++++++++++++++++++++++++++++++++++
+
+- **Model Format:** awq
+- **Model Size (in billions):** 27
+- **Quantizations:** Int4
+- **Engines**: vLLM, Transformers, SGLang
+- **Model ID:** QuantTrio/Qwen3.6-27B-AWQ
+- **Model Hubs**:  `Hugging Face <https://huggingface.co/QuantTrio/Qwen3.6-27B-AWQ>`__, `ModelScope <https://modelscope.cn/models/tclf90/Qwen3.6-27B-AWQ>`__
+
+Execute the following command to launch the model, remember to replace ``${quantization}`` with your
+chosen quantization method from the options listed above::
+
+   xinference launch --model-engine ${engine} --model-name qwen3.6 --size-in-billions 27 --model-format awq --quantization ${quantization}
+
+
+Model Spec 4 (pytorch, 35 Billion)
 ++++++++++++++++++++++++++++++++++++++++
 
 - **Model Format:** pytorch
@@ -62,7 +78,7 @@ chosen quantization method from the options listed above::
    xinference launch --model-engine ${engine} --model-name qwen3.6 --size-in-billions 35 --model-format pytorch --quantization ${quantization}
 
 
-Model Spec 4 (fp8, 35 Billion)
+Model Spec 5 (fp8, 35 Billion)
 ++++++++++++++++++++++++++++++++++++++++
 
 - **Model Format:** fp8
@@ -78,7 +94,7 @@ chosen quantization method from the options listed above::
    xinference launch --model-engine ${engine} --model-name qwen3.6 --size-in-billions 35 --model-format fp8 --quantization ${quantization}
 
 
-Model Spec 5 (awq, 35 Billion)
+Model Spec 6 (awq, 35 Billion)
 ++++++++++++++++++++++++++++++++++++++++
 
 - **Model Format:** awq
@@ -94,7 +110,7 @@ chosen quantization method from the options listed above::
    xinference launch --model-engine ${engine} --model-name qwen3.6 --size-in-billions 35 --model-format awq --quantization ${quantization}
 
 
-Model Spec 6 (ggufv2, 35 Billion)
+Model Spec 7 (ggufv2, 35 Billion)
 ++++++++++++++++++++++++++++++++++++++++
 
 - **Model Format:** ggufv2
@@ -110,7 +126,7 @@ chosen quantization method from the options listed above::
    xinference launch --model-engine ${engine} --model-name qwen3.6 --size-in-billions 35 --model-format ggufv2 --quantization ${quantization}
 
 
-Model Spec 7 (mlx, 35 Billion)
+Model Spec 8 (mlx, 35 Billion)
 ++++++++++++++++++++++++++++++++++++++++
 
 - **Model Format:** mlx

doc/source/user_guide/backends.rst

@@ -128,7 +128,7 @@ Currently, supported model includes:
 
 .. vllm_start
 
-- ``code-llama``, ``code-llama-instruct``, ``code-llama-python``, ``deepseek``, ``deepseek-chat``, ``deepseek-coder``, ``deepseek-coder-instruct``, ``deepseek-r1-distill-llama``, ``gorilla-openfunctions-v2``, ``HuatuoGPT-o1-LLaMA-3.1``, ``llama-2``, ``llama-2-chat``, ``llama-3``, ``llama-3-instruct``, ``llama-3.1``, ``llama-3.1-instruct``, ``llama-3.3-instruct``, ``tiny-llama``, ``wizardcoder-python-v1.0``, ``wizardmath-v1.0``, ``Yi``, ``Yi-1.5``, ``Yi-1.5-chat``, ``Yi-1.5-chat-16k``, ``Yi-200k``, ``Yi-chat``
+- ``code-llama``, ``code-llama-instruct``, ``code-llama-python``, ``deepseek``, ``deepseek-chat``, ``deepseek-coder``, ``deepseek-coder-instruct``, ``deepseek-r1-distill-llama``, ``gorilla-openfunctions-v2``, ``HuatuoGPT-o1-LLaMA-3.1``, ``llama-2``, ``llama-2-chat``, ``llama-3``, ``llama-3-instruct``, ``llama-3.1``, ``llama-3.1-instruct``, ``llama-3.3-instruct``, ``minicpm5-1b``, ``tiny-llama``, ``wizardcoder-python-v1.0``, ``wizardmath-v1.0``, ``Yi``, ``Yi-1.5``, ``Yi-1.5-chat``, ``Yi-1.5-chat-16k``, ``Yi-200k``, ``Yi-chat``
 - ``codestral-v0.1``, ``mistral-instruct-v0.1``, ``mistral-instruct-v0.2``, ``mistral-instruct-v0.3``, ``mistral-large-instruct``, ``mistral-nemo-instruct``, ``mistral-v0.1``, ``openhermes-2.5``, ``seallm_v2``
 - ``Baichuan-M2``, ``codeqwen1.5``, ``codeqwen1.5-chat``, ``deepseek-r1-distill-qwen``, ``DianJin-R1``, ``fin-r1``, ``HuatuoGPT-o1-Qwen2.5``, ``KAT-V1``, ``marco-o1``, ``qwen1.5-chat``, ``qwen2-instruct``, ``qwen2.5``, ``qwen2.5-coder``, ``qwen2.5-coder-instruct``, ``qwen2.5-instruct``, ``qwen2.5-instruct-1m``, ``qwenLong-l1``, ``QwQ-32B``, ``QwQ-32B-Preview``, ``seallms-v3``, ``skywork-or1``, ``skywork-or1-preview``, ``XiYanSQL-QwenCoder-2504``
 - ``llama-3.2-vision``, ``llama-3.2-vision-instruct``
@@ -161,6 +161,7 @@ Currently, supported model includes:
 - ``MiniMax-M2``, ``MiniMax-M2.5``, ``MiniMax-M2.7``
 - ``GLM-4.7-Flash``
 - ``glm-5``, ``glm-5.1``
+- ``DeepSeek-V4-Flash``, ``DeepSeek-V4-Pro``
 .. vllm_end
 
 .. _sglang_backend: