60615db4ed
Squash of 54 work commits (Sep 1–12):6251f7cai-hub: body domain — live pose packets ride the realtime sessionea50c77chat_ui: the feed's session gets its profile brief backf51b5f3ai-body: the crate for the native SAM 3D Body port, with its weights reader8211ae6ai-body: the MHR rig and the pose head's parameter decoding, oracle-exact9e343a8ai-body: the DINOv3 ViT-H+/16 backbone, crop and ray conditioning; Metal gains rope-half and affine layer norm69d842cai-body: the promptable pose decoder and its refinement loop, oracle-matched on Metal66e5e2fai-hub: SAM 3D Body runs natively — `sam3dbody` on the body domain, oracle-matched end to enda634198ai-hub: the body-native commit carried a peer's in-flight hub hunks; put them back where they were9ff44e8ai-hub: the body-native wiring, this time only the lane's hunks6a1c16bai-body: third-party notices — what the port is implemented after, and what it is notd78411aai-body: the per-step work moves to the GPUb22259bai-body: the context stays on the GPU; only the pose token leaves the loop346f31fai-body: flash attention for the head-dim-64 blocks45b5b98ai-body: the crop size is a runtime knob, and the loop reports where its time goes4be6d19ai-body: the test modules import the grid constants they still use7598346ai-body: tensor-core GEMMs for the backbone, and the rig's correctives only where they counta9ce596ai-body: the crop warp runs across cores8964ba6ai-body: an FP8 backbone mode, off by default, measured against the oraclea2aaa8fai-body: the FP8 bias rides a column-broadcast add on the deviced53c77dmetal: a device-resident ViT stack, and the body backbone rides itd006d0ametal: resident f32 linears keep their weight on the device525ba1cmetal: a device-resident two-way decoder layer, and the body decoder rides itc9e6d88ai-body: the hands pass — hand crops, the hand decoder, the hand-mode rig and the wrist fusion62dff26ai-body: the mask prompt — a person's segmentation mask conditions the body passa648cf8ai-hub: body session options — hands, detect, persons=N8c568dfai-hub: drop the SAM 3D Body reference worker backend7ff875aai-hub: keep a peer's in-flight beats/notes/local work out of the body commits31e5faaai-hub: local model runner, licence acknowledgements, a shared install panel; Beat This!, Basic Pitch and the Salamander drum-kit entriesb94bc58ai-services: the wire, the app port and the panel state — one conversation, many apps2acb798ai-services: wire v2 — endpoints, receiver-side caps, result disposition8ae0ffbai-services: the engine core — registry, router and conversation, tested against a scripted model2308736ai-services: the real models behind the engine feature — local through the hub, Claude, and nonec3f631dlivepipe: one reusable pipe from a camera to a fleet node and backff62db3ai libs: the runtime env-var cleanup — precision is a per-caller policy, not an environment side channel04a94efrealtime: one service-log line when a live session opens and one when it closes0ecb81cai models: the model-crates env-var cleanup — 172 research knobs gone, the unset default is the code4ca36c1ai hub + services: the assistant's model comes from wherever it is resident — the fleet chat box, with tools, then the local weights432121eaichat engine + wm: launch, then use — the assistant continues in the same turn once the app it started is on the bus7a5bf69ai-hub registry: the Salamander drumkit samples come from the makepad.nl mirror — the GitHub repo only carries the .sfz files102ffc5ai-services: messages on the bus — a manifest declares topics, the engine subscribes on a tool's behalf or by ToolResult.subscribe, a service publishes Message frames, an idle conversation wakes on a message as an event turn under rate laws; the WM bus forwards the new frames; every app that matches the wire gets its arma837792hub + flow: a whitespace-only chat completion is retried once and then fails instead of passing as an answer; a flow's model is a fleet model id unless it names a weight file on disk; chat models show under the text domain in /v1/modelsbc6c620hub + flow: what the chat review found — the in-process route retries an empty completion too, a node says whether its prefill opened thinking so a brief-mode answer is never discarded, a preferred model falls back to normal election when no node has it, discovery keeps looking for the preferred model until patience runs out75c3441hub: the PRO 6000 serves image as well as chat and textad5e98bhub registry: flux2-dev's VRAM estimate is its measured peak, 30 GBc7241e0hub: a node that evicted every resident releases its cached allocator pool before refusing a load or publishing usable VRAM30575f0flow: route generation by request workload1be1e21ai-hub: gate downloads by disk capacity and recover fleet admission df6b394 filesystem_watcher, bounded_http, ai services: live and tool prerequisites 79ebdb9 ai-hub: add a native Pixal3D image-to-3D backend 0ba0d74 ai-hub: propagate typed refusals under reject queue policy cc6c872 Speed up H3 conditioning and video decoding e512059 Fix Qwen vision residency and generated material colors 2864f68 ai-hub http client: bound every plain TCP connect to 3 s per address 3d93229 ai: CUDA is a Linux/Windows-only dependency; the hub library defaults to llm + stt Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
247 lines
5.4 KiB
TOML
247 lines
5.4 KiB
TOML
[package]
|
|
name = "makepad-diffusion"
|
|
version = "0.1.0"
|
|
edition = "2021"
|
|
description = "Diffusion pipeline scaffolding for Makepad ggml backends"
|
|
license = "MIT"
|
|
|
|
[dependencies]
|
|
# Bake ggml-metal.metallib at build time (same as llama/tts). Without this
|
|
# the first Metal dispatch compiles the shader source at runtime.
|
|
makepad-ai-llm = { path = "../ai/llm" }
|
|
# Safetensors reader moved out of mlx (lane T2, /aiarch.md §1): mlx's other
|
|
# ~89k LOC (chat/KV, qwen35moe, ...) has no consumers here. mlx itself stays
|
|
# in the tree unbuilt until lane T3 deletes it.
|
|
makepad-ai-loader = { path = "../ai/loader" }
|
|
# DiffusionError/Result + the plain sharded-safetensors reader moved out to
|
|
# the ai model workspace (lane T6a, /aiarch.md §1) so the family crates that
|
|
# split out of this one later can share them without depending on all of
|
|
# diffusion.
|
|
makepad-ai-common = { path = "../ai/models/common" }
|
|
makepad-ai-h3 = { path = "../ai/models/h3" }
|
|
makepad-ai-flux = { path = "../ai/models/flux" }
|
|
makepad-ai-vision = { path = "../ai/models/vision" }
|
|
makepad-ai-rig = { path = "../ai/models/rig" }
|
|
makepad-ai-motion = { path = "../ai/models/motion" }
|
|
makepad-ai-sfx = { path = "../ai/models/sfx" }
|
|
makepad-ai-music = { path = "../ai/models/music" }
|
|
makepad-ai-speech = { path = "../ai/models/speech" }
|
|
makepad-ai-trellis = { path = "../ai/models/trellis" }
|
|
makepad-gltf = { path = "../gltf" }
|
|
makepad-micro-serde = { path = "../micro_serde" }
|
|
makepad-zune-core = { path = "../zune/zune-core" }
|
|
makepad-zune-png = { path = "../zune/zune-png" }
|
|
|
|
[workspace]
|
|
|
|
[[bin]]
|
|
name = "flux-smoke"
|
|
path = "src/bin/flux_smoke.rs"
|
|
|
|
[[bin]]
|
|
name = "flux-tokenize"
|
|
path = "src/bin/flux_tokenize.rs"
|
|
|
|
[[bin]]
|
|
name = "flux-clip-smoke"
|
|
path = "src/bin/flux_clip_smoke.rs"
|
|
|
|
[[bin]]
|
|
name = "flux-t5-smoke"
|
|
path = "src/bin/flux_t5_smoke.rs"
|
|
|
|
[[bin]]
|
|
name = "flux-generate"
|
|
path = "src/bin/flux_generate.rs"
|
|
|
|
[[bin]]
|
|
name = "flux-warm-bench"
|
|
path = "src/bin/flux_warm_bench.rs"
|
|
|
|
[[bin]]
|
|
name = "flux-t5-stage-compare"
|
|
path = "src/bin/flux_t5_stage_compare.rs"
|
|
|
|
[[bin]]
|
|
name = "safetensors-query"
|
|
path = "src/bin/safetensors_query.rs"
|
|
|
|
[[bin]]
|
|
name = "h3-validate"
|
|
path = "src/bin/h3_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "h3-vae-validate"
|
|
path = "src/bin/h3_vae_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "h3-generate"
|
|
path = "src/bin/h3_generate.rs"
|
|
|
|
[[bin]]
|
|
name = "h3-tokenize"
|
|
path = "src/bin/h3_tokenize.rs"
|
|
|
|
[[bin]]
|
|
name = "h3-audio-validate"
|
|
path = "src/bin/h3_audio_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "h3-vision-validate"
|
|
path = "src/bin/h3_vision_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "h3-vae-encode-validate"
|
|
path = "src/bin/h3_vae_encode_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "sa3-validate"
|
|
path = "src/bin/sa3_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "moss-validate"
|
|
path = "src/bin/moss_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "moss-generate"
|
|
path = "src/bin/moss_generate.rs"
|
|
|
|
[[bin]]
|
|
name = "trellis-validate"
|
|
path = "src/bin/trellis_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "sa3-generate"
|
|
path = "src/bin/sa3_generate.rs"
|
|
|
|
[[bin]]
|
|
name = "sa3-bake"
|
|
path = "src/bin/sa3_bake.rs"
|
|
|
|
[[bin]]
|
|
name = "trellis-generate"
|
|
path = "src/bin/trellis_generate.rs"
|
|
|
|
[[bin]]
|
|
name = "woosh-validate"
|
|
path = "src/bin/woosh_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "woosh-generate"
|
|
path = "src/bin/woosh_generate.rs"
|
|
|
|
[[bin]]
|
|
name = "indextts-w2v-validate"
|
|
path = "src/bin/indextts_w2v_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "indextts-gpt-validate"
|
|
path = "src/bin/indextts_gpt_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "indextts-s2mel-validate"
|
|
path = "src/bin/indextts_s2mel_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "indextts-bigvgan-validate"
|
|
path = "src/bin/indextts_bigvgan_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "hy-motion-checkpoint"
|
|
path = "src/bin/hy_motion_checkpoint.rs"
|
|
|
|
[[bin]]
|
|
name = "hy-motion-validate"
|
|
path = "src/bin/hy_motion_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "hy-motion-text-validate"
|
|
path = "src/bin/hy_motion_text_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "hy-motion-clip-validate"
|
|
path = "src/bin/hy_motion_clip_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "hy-motion-decode-validate"
|
|
path = "src/bin/hy_motion_decode_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "hy-motion-pipeline-validate"
|
|
path = "src/bin/hy_motion_pipeline_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "skin-tokens-validate"
|
|
path = "src/bin/skin_tokens_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "skin-tokens-qwen-validate"
|
|
path = "src/bin/skin_tokens_qwen_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "skin-tokens-beam-ops-validate"
|
|
path = "src/bin/skin_tokens_beam_ops_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "skin-tokens-output-validate"
|
|
path = "src/bin/skin_tokens_output_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "birefnet-validate"
|
|
path = "src/bin/birefnet_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "realesrgan-validate"
|
|
path = "src/bin/realesrgan_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "da3-validate"
|
|
path = "src/bin/da3_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "sam3-validate"
|
|
path = "src/bin/sam3_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "flux2-check-te"
|
|
path = "src/bin/flux2_check_te.rs"
|
|
|
|
[[bin]]
|
|
name = "flux2-edit-validate"
|
|
path = "src/bin/flux2_edit_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "flux2-dev-validate"
|
|
path = "src/bin/flux2_dev_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "h3-gguf-validate"
|
|
path = "src/bin/h3_gguf_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "flux-gguf-inspect"
|
|
path = "src/bin/flux_gguf_inspect.rs"
|
|
|
|
[[bin]]
|
|
name = "music3-validate"
|
|
path = "src/bin/music3_validate.rs"
|
|
|
|
[[bin]]
|
|
name = "music3-gguf-inspect"
|
|
path = "src/bin/music3_gguf_inspect.rs"
|
|
|
|
[[bin]]
|
|
name = "music3-gguf-generate"
|
|
path = "src/bin/music3_gguf_generate.rs"
|
|
|
|
[[bin]]
|
|
name = "music3-generate"
|
|
path = "src/bin/music3_generate.rs"
|
|
|
|
[[bin]]
|
|
name = "music3-native-bench"
|
|
path = "src/bin/music3_generate.rs"
|
|
|
|
[[bin]]
|
|
name = "ace-validate"
|
|
path = "src/bin/ace_validate.rs"
|