Skip to content

feat: decoder-only KV-cached trunk (5-19x cheaper serving), FlexAttention long-context training, and anti-overfitting for patch policy #688

feat: decoder-only KV-cached trunk (5-19x cheaper serving), FlexAttention long-context training, and anti-overfitting for patch policy

feat: decoder-only KV-cached trunk (5-19x cheaper serving), FlexAttention long-context training, and anti-overfitting for patch policy #688

Workflow file for this run

---
name: CI
on:
push:
branches: [main]
pull_request:
workflow_dispatch:
env:
UV_CACHE_DIR: /tmp/.uv-cache
jobs:
ci:
runs-on: ubuntu-latest
defaults:
run:
shell: nix develop -c bash --noprofile --norc -eo pipefail {0}
steps:
- name: checkout
uses: actions/checkout@v6
with:
submodules: recursive
persist-credentials: false
lfs: true
- uses: DeterminateSystems/nix-installer-action@main
- uses: DeterminateSystems/magic-nix-cache-action@main
- uses: DeterminateSystems/flake-checker-action@main
- uses: actions/cache@v5
with:
path: /tmp/.uv-cache
key: uv-${{ runner.os }}-${{ hashFiles('uv.lock') }}
restore-keys: |
uv-${{ runner.os }}-${{ hashFiles('uv.lock') }}
uv-${{ runner.os }}
- run: just sync
- run: just check
- run: just test