Skip to content

Controlnet support: Control space & controlnet nodes - #17

Merged
imprsnst merged 6 commits into
mainfrom
controlnet-support
Jul 29, 2026
Merged

Controlnet support: Control space & controlnet nodes#17
imprsnst merged 6 commits into
mainfrom
controlnet-support

Conversation

@imprsnst

@imprsnst imprsnst commented Jul 29, 2026

Copy link
Copy Markdown
Collaborator

ControlNet support + Control Space

Four commits on top of main. Adds ControlNet to the local Core gen nodes, a new
3D editor to drive it, and generation recipes embedded in output images.

Control Space (new)

A full-screen 3D editor for posing OpenPose characters and framing a camera, then
rendering that as a control map. Multi-character, presets, orbit camera, output
aspect picker, pose or depth output.

Depth output builds a volumetric body: limb capsules with anatomical thickness, a
closed torso, and a skull with a face and nose along its forward axis, standing on
a ground plane against a backdrop. Facing reads straight off the pixels, and the
face hides behind the skull when a character turns away.

Pulls in three.js, @react-three/fiber and drei.

ControlNet

  • Z-Image: Control input port, controlnet picker and conditioning scale.
    Loads the Fun Union checkpoint offline via a bundled config.
  • Krea 2: depth control through the public Patil/Krea-2-depth-controlnet
    control-LoRA. Rank-64 on every block plus a wider input projection, so a
    VAE-encoded depth latent rides next to the noisy one.
  • Apply ControlNet node: turns any image into a pose, depth or canny map.

Control maps are now typed CONTROL so they can only feed a Control input. Wiring
one into img2img was silently running image-to-image from a black map, which looked
exactly like "ControlNet not working".

Generation recipes

  • Drag drop generated image to load graph
  • Generated assets now carries entire generation info & settings.

@imprsnst
imprsnst marked this pull request as ready for review July 29, 2026 13:22
@imprsnst
imprsnst merged commit aa7a246 into main Jul 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant