makepad/libs/ai/metal/src
Admin 525ba1c2f4 metal: a device-resident two-way decoder layer, and the body decoder rides it
One backend call per SAM-style decoder layer (PE norms, token
self-attention, token-to-image cross-attention, erf-GELU feed-forward,
final norm) inside one command buffer, with the layer's f32 weights cached
on the device under their content identity and pooled transients.
gpu_two_way_layer_resident in the common backend; CUDA declines and the
per-op path stays. Body decoder loop on the M3 Max: layers 100 -> 9 ms,
frame 405 -> 266 ms, oracle parity unchanged (kp3d 1.5 mm).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-02 00:25:59 +02:00
..
bin libs/ai: one AI stack, replacing libs/ggml, llama, mlx, cuda, tts, voice2 and pbr_paint 2026-08-23 01:34:35 +02:00
affine.rs libs/ai: one AI stack, replacing libs/ggml, llama, mlx, cuda, tts, voice2 and pbr_paint 2026-08-23 01:34:35 +02:00
backend_kind.rs libs/ai: one AI stack, replacing libs/ggml, llama, mlx, cuda, tts, voice2 and pbr_paint 2026-08-23 01:34:35 +02:00
gpu_tensor.rs metal: a device-resident two-way decoder layer, and the body decoder rides it 2026-09-02 00:25:59 +02:00
gpu_types.rs metal: resident f32 linears keep their weight on the device 2026-09-02 00:20:46 +02:00
lib.rs libs/ai: the step cost model per device, the cold-turn speculative path, and RIFE on Metal with its device-parity check 2026-08-26 08:49:46 +02:00
rife.rs metal: resident f32 linears keep their weight on the device 2026-09-02 00:20:46 +02:00
runtime.rs libs/ai: one AI stack, replacing libs/ggml, llama, mlx, cuda, tts, voice2 and pbr_paint 2026-08-23 01:34:35 +02:00
shim.rs metal: a device-resident two-way decoder layer, and the body decoder rides it 2026-09-02 00:25:59 +02:00