Skip to content

Add Genesis 2 Cascade MoE - PyTorch neural network with shared neuron pool - #169

Open
larionovavi-stack wants to merge 1 commit into
bharathgs:masterfrom
larionovavi-stack:add-genesis2-cascade-moe
Open

Add Genesis 2 Cascade MoE - PyTorch neural network with shared neuron pool#169
larionovavi-stack wants to merge 1 commit into
bharathgs:masterfrom
larionovavi-stack:add-genesis2-cascade-moe

Conversation

@larionovavi-stack

Copy link
Copy Markdown

Description

Adding Genesis 2 to the list — a PyTorch-based Cascade MoE (Mixture of Experts) neural network with several notable properties:

  • Shared neuron pool: all experts share a common neuron base, reducing redundancy
  • Zero catastrophic forgetting: new knowledge is added without erasing previous training
  • CPU-only inference at 18ms: runs efficiently without GPU at runtime
  • 10,800+ experts: large-scale expert routing

Entry added (item 347)

347. [Genesis 2](https://github.com/larionovavi-stack/genesis2-cascade-moe) - Cascade MoE neural network built with PyTorch. Shared neuron pool, zero catastrophic forgetting, CPU-only inference (18ms), 10,800+ experts.

Fits the existing pattern of novel PyTorch architecture implementations in the list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant