andodeki/makepad
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
makepad/libs/ai/hub/python/fw_cameras_forward.json
Admin e37c263b9c ai backbone: the hub era — makepad_ai deleted, every backend is a hub pipe; machine residency elections, job leases, ETA placement; the store only stores; creator pipelines run in the app (aicore) 
Squashed from work:
- asset-ai: FastH3 4-step fast video backend; clip keyframes on the wire
- asset-ui: loop video chains — text→image→video that ends where it began
- h3: safetensors -> pruned-Q4_K GGUF quantizer for the 24GB DiT tiers
- h3_quant_gguf verify: row-error gates calibrated to the measured Q4_K floor
- asset-ai realtime: the feedback loop — the source anchors, the drifted frame inits
- asset-ai realtime: a feedback loop survives a resize and travels by default
- asset-ai realtime: the feedback loop frees itself from the feed handshake and pauses for its listener
- asset-ai realtime: the outbound encode leaves the loop's critical path
- asset-ai ocr: the ocr domain — Chandra 2 at page resolution, and the tower goes planner-owned
- llm slots: a lane can hold an image span — embedding prefill and a rope cursor of its own
- vision tower on CUDA: the encode leg gets its two missing kernels
- llm/ocr: one M-RoPE grid encoder for both image paths, and a livelock made an error
- vision tower on CUDA: the f16 GEMM keeps the precision it was throwing away
- live: a feed that moves box takes its trip with it — one seed image
- vision tower on CUDA: the tiled attention becomes bit-exact, and tensor cores go
- llm prefill on CUDA: the MMA attention kernel gets the tile a 4-to-1 model needs
- asset-ai ocr: the CUDA encode lane joins the integration — vision-parity sits beside run's three arms, and the kernels
- Merge branch 'ocr-perf-integration' into work
- asset-ai: the live anchor can follow the trip, and text leaves the 5090
- asset-ai: the camera moves the world, and the world starts still
- asset-import: the EA strategy classics, in the one 2D contract
- rtsmap: one seeded generator for tiled strategy maps
- asset-ui: one card for the strategy classics, with a pack dropdown
- asset-ai: music3 reference-audio path, ocr/h3 backends, registry
- asset: mp4 sample index for range-streaming, chat tools, import profiles
- cnc: tiberium is twelve growth frames, not twelve empty variants
- platform: native file and save dialogs, in-house on all three desktops
- chat: the scan holds out for a lane home
- chat: a full home queues you — take the free lane
- chat: the preload has a percentage, and the boundless cap stops showing
- llm cuda: the 32x2 attention tile — even GQA ratios stay on MMA
- sa3 gets a bake path: the sfx model's tables precomputed by a diffusion-side bin
- sqlite_query: anti-join regression test
- td import: HARV's second frame block is its harvesting cycle, not a turret
- asset-ui: sprite enhancement runs on the 32B dev DiT — distillation, not the prompt, was the ceiling
- ai-hub: makepad-asset-ai becomes makepad-ai-hub at libs/ai/hub, the chat pane becomes makepad-chat-ui, the service bin
- asset-ui: test health fixtures grow the realtime field they were born without
- ai-hub: one home at ~/.makepad — weights/ run/ cache/ logs/, the service cache migrates from ai_content by a single re
- ai-hub: subprocess workers die with the node — process groups everywhere, PDEATHSIG on linux, one KILL_ON_JOB_CLOSE Jo
- ai-hub: the hub object — AiHub::in_process, pipes vocabulary, and the local LLM engine generalized out of mpfiles (aic
- strict-json: the dependency-free JSON module gets its own crate; asset-client re-exports it so nothing downstream move
- ai-hub: the machine layer — node entries, the 0600 machine token, and the residency election that IS the lock (aicore
- ai-hub: MPHUB1 — the fabric beacon only dedicated nodes can send (aicore §4)
- ai-hub: job leases — work lives only while it is renewed (aicore §8)
- asset-creator: the pipeline library is born — specs, the deps gate, and the derived-state law (aicore §9)
- ai-hub: RAM residency facts — the CPU-side twin of residency.rs (aicore §3)
- ai-hub: ETA placement primitives — relative GPU throughput, the four-term estimate, and an observable breakdown (aicor
- ai-hub: leases go live on the wire — origin fields on submit, /job/<id>/keepalive, /bye, and the reaper that cancels w
- ai-hub: the chat providers move in — fleet qwen, openai, grok, claude/codex/grok CLIs, the responses driver, and the w
- asset-creator: the engine — one pipeline run against the hub, deps-gated, spliced, cancellable, resumable-by-construct
- ai-hub: the machine node mode — --machine binds loopback, registers in ~/.makepad/run, and exits on its own once idle
- asset-creator: makepad-creator-run — the detached client for runs that must outlive a window (aicore §9)
- ai-hub: a native Claude Messages-API provider — API-key or Claude Code OAuth, bounded SSE streaming, injected tools (a
- route + converse: off makepad_ai — the Agent seam moves to converse, route's cloud dispatcher rides the hub's Claude p
- asset-creator: the preset tables move in — fifteen chain-policy constants shared by every creator app (aicore §9 / P6)
- makepad_ai is deleted — every backend is a hub pipe, the agent seam lives with its consumers (aicore §14, decided 2026
- ai-hub: loads hold the machine residency election — set_model_state claims on Loaded and publishes the service port (a
- ai-hub: chats run the machine election — route to a serving holder, wait on a loading one, claim and publish when open
- ai-hub: pick_for_domain_eta — ETA-ranked placement over the shared hard-filter core (aicore §6 / P4)
- asset-creator: the engine picks a provider per stage at dispatch time — a chain's later stages see fresh fleet state (
- ai-hub: the fabric secret gates the service HTTP surface — bearer on everything but /health and the ticketed peer path
- vj: DREAM runs execute in the app — pipelines.rs becomes the run it used to watch (aicore §9 / F1)
- asset-creator: the runner — generate one thing and put it in the catalog, one implementation for every surface (aicore
- chat-ui: the session runs in the app — no broker anywhere on the chat path (aicore P8 / F5)
- asset-store: assets.query is a first-class query endpoint — the bounded SQL surface outlives the broker (aicore P8 / F
- asset-creator: CreatorTools — the chat tool pack for a store that only stores (aicore §9 / P8)
- asset-store: the shrink — the store stores (aicore P7)
- importer + asset-server host: the coordination era ends (aicore P7)
- store config purge + asset-ui goes fleet-direct; the derive protocol gets its route proof (aicore P7)
- client + chat dispatcher: the dead wire comes out (aicore P7/P8)
- ai-hub: 0.3.0 — the health version says which era a node runs
- ai-hub: the default fleet is 'gen' — apps hear the LAN without env plumbing
- ai-hub: the preload note percents the prefill, not the job bar
- ai-hub: conversations keep their KV — the wire mirror, the lane identity, the in-turn dynamic context (aicore §7)
- ai-hub: an open-think model is thinking from its first token
- libs: the zero-warning sweep — stitch casts say what they mean, xatlas keeps upstream's surface quietly
- zero-warning sweep, round two — the first full-workspace pass
- zero-warning sweep, round three — the model lanes and the deep examples
- zero-warning sweep, round four — the last stragglers
- zero-warning sweep, round five — vj and chat-ui
- zero-warning sweep, round six — three cascades

Co-authored-by: Claude <info@makepad.nl>
2026-09-01 16:46:31 +02:00

418 lines
No EOL
8.2 KiB
JSON
Raw Permalink Blame History

{
"resolution": [
24,
480,
704
],
"image_index": 10,
"cameras": [
{
"quaternion": [
0.001987793017178774,
0.9999967217445374,
-0.0007265954045578837,
0.001432784483768046
],
"position": [
-0.012694079428911209,
-0.027021178975701332,
0.47809672355651855
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.0012487346539273858,
0.9999983310699463,
-0.0003698058717418462,
0.0012709713773801923
],
"position": [
-0.02209807001054287,
-0.028396081179380417,
0.7302180528640747
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.0007165579590946436,
0.9999986886978149,
-0.0008601424051448703,
0.0011686172802001238
],
"position": [
-0.03878502920269966,
-0.036565519869327545,
0.9888129234313965
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.00035390592529438436,
-0.999999463558197,
0.0007258786354213953,
-0.0006121002952568233
],
"position": [
-0.08900470286607742,
-0.05190418288111687,
1.272307276725769
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.0013570546871051192,
-0.9999990463256836,
0.00012168261309852824,
-0.00010768009815365076
],
"position": [
-0.13158278167247772,
-0.07310780882835388,
1.5382602214813232
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.0024070863146334887,
-0.999997079372406,
-0.00016657022933941334,
-1.665854870225303e-05
],
"position": [
-0.1555110216140747,
-0.09020282328128815,
1.8321199417114258
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.002597839804366231,
-0.999996542930603,
0.00015665378305129707,
0.00039154061232693493
],
"position": [
-0.17050829529762268,
-0.10099127143621445,
2.1094980239868164
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.003647162113338709,
-0.9999924898147583,
-0.0002909854520112276,
0.001299740863032639
],
"position": [
-0.1922527551651001,
-0.12038353830575943,
2.4038853645324707
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.004032268188893795,
-0.9999867677688599,
-0.0007617153460159898,
0.0031047400552779436
],
"position": [
-0.21000710129737854,
-0.13244503736495972,
2.690300464630127
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.005155135877430439,
-0.9999687075614929,
-0.0010867994278669357,
0.005896856542676687
],
"position": [
-0.21349617838859558,
-0.14608745276927948,
2.9946906566619873
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.005830287467688322,
-0.9999255537986755,
-0.0008806278347037733,
0.010681758634746075
],
"position": [
-0.21843039989471436,
-0.1604079157114029,
3.29284930229187
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.006989217828959227,
-0.9997259974479675,
-0.001066825003363192,
0.022314267233014107
],
"position": [
-0.2130976766347885,
-0.18375685811042786,
3.559507131576538
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.007401507347822189,
-0.9991003274917603,
-0.0015597585588693619,
0.04172897711396217
],
"position": [
-0.18894557654857635,
-0.19164252281188965,
3.8061439990997314
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.008550153113901615,
-0.9979974627494812,
-0.0016151751624420285,
0.06265230476856232
],
"position": [
-0.14919018745422363,
-0.2063056230545044,
4.050567626953125
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.009110995568335056,
-0.9966618418693542,
-0.0017904693959280849,
0.08111056685447693
],
"position": [
-0.11564077436923981,
-0.21853213012218475,
4.272879600524902
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.010119105689227581,
-0.995058536529541,
-0.002413993701338768,
0.0987437441945076
],
"position": [
-0.07922744750976562,
-0.26129889488220215,
4.491872787475586
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.010885373689234257,
-0.9936608076095581,
-0.003361019305884838,
0.11184078454971313
],
"position": [
-0.02564195729792118,
-0.2890564501285553,
4.706950664520264
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.01174420490860939,
-0.9928699135780334,
-0.003186487825587392,
0.11858011037111282
],
"position": [
0.03916303068399429,
-0.32638466358184814,
4.9038591384887695
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.012136038392782211,
-0.992453932762146,
-0.0031729976180940866,
0.12197473645210266
],
"position": [
0.08750500530004501,
-0.3588458299636841,
5.086713790893555
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.012904392555356026,
-0.9920569062232971,
-0.003142524277791381,
0.12508679926395416
],
"position": [
0.1270555853843689,
-0.3776203989982605,
5.260650634765625
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.013404089957475662,
-0.9914901852607727,
-0.00356214283965528,
0.129440575838089
],
"position": [
0.1636473387479782,
-0.35828882455825806,
5.385830402374268
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.014149981550872326,
-0.9907848834991455,
-0.004179483745247126,
0.13463863730430603
],
"position": [
0.2147812843322754,
-0.2700505256652832,
5.526253700256348
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.015214832499623299,
-0.9902054667472839,
-0.004111886024475098,
0.13872523605823517
],
"position": [
0.2820548117160797,
-0.18617337942123413,
5.68379545211792
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
},
{
"quaternion": [
0.015771372243762016,
-0.9898132085800171,
-0.0048758541233837605,
0.14141176640987396
],
"position": [
0.3260829448699951,
-0.1531827449798584,
5.825693130493164
],
"fx": 492.68400955200195,
"fy": 492.6840591430664,
"cx": 352.38185119628906,
"cy": 240.33416748046875
}
]
}
Reference in a new issue View git blame Copy permalink