Skip to content

Kernel-aware architecture search: use kernel perf data to design models #81

Description

@peaktwilight

Use Noeris's kernel performance database (110+ shape buckets, 3 GPUs) as a hardware cost model for NAS. What attention head_dim / FFN ratio / norm placement is fastest given real kernel measurements? Nobody has closed this loop with real Triton data. This flips the problem from "optimize kernels for models" to "design models for kernels."

Metadata

Metadata

Labels

enhancementNew feature or requestnovelNovel contribution / first-of-kindresearchNovel contributions, ablation, paper work

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions