You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I opened this PR to support TeleAI's new model: xingchen4.
The XingChen model is a domestically developed LLM from China Telecom AI Technology Co., Ltd. (TeleAI), originally named "telechat," and is scheduled to be open-sourced soon.
Additional information
I have opened an issue and initiated a discussion regarding this, you can check it at #28153
So far, I have completed the following work:
Registered the xingchen4 model architecture in the llama.cpp framework with parameter alignment.
Implemented conversion and quantization of the model's safetensors weights to GGUF format.
Added CPU backend inference support.
Added GPU backend inference support, along with specific GGML operator implementations.
Wrote and tested operator test cases.
Conducted llama-perplexity and llama-bench evaluations.
Per our contribution guidelines, the automated PR checker found the following issue(s) that need your attention:
Multiple open PRs from a new contributor: We limit new contributors (those without a previously merged PR) to 1 open PR at a time. You currently have 2 open PRs.
Multiple backend changes in one PR: When adding support for a new model or feature, focus on CPU support only in the initial PR. Add support for other backends like CUDA in follow-up PRs. If you have a good reason to modify multiple backends in one PR, please explain it.
Large PR: Large changes require prior discussion (e.g. an issue or RFC) and maintainers may not be able to review this PR as-is. Consider splitting it into smaller, focused PRs.
Please note that maintainers reserve the right to make final decisions on PRs. If you believe there is a mistake, please comment below.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
conversionCUDARelated to the CUDA backendggmlchanges relating to the ggml tensor library for machine learningmodelModel specifictestingEverything test related
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
I opened this PR to support TeleAI's new model: xingchen4.
The XingChen model is a domestically developed LLM from China Telecom AI Technology Co., Ltd. (TeleAI), originally named "telechat," and is scheduled to be open-sourced soon.
Additional information
I have opened an issue and initiated a discussion regarding this, you can check it at #28153
So far, I have completed the following work:
Requirements