makepad/libs/asset/importer/examples/repair_games.rs
Admin e37c263b9c ai backbone: the hub era — makepad_ai deleted, every backend is a hub pipe; machine residency elections, job leases, ETA placement; the store only stores; creator pipelines run in the app (aicore)
Squashed from work:
- asset-ai: FastH3 4-step fast video backend; clip keyframes on the wire
- asset-ui: loop video chains — text→image→video that ends where it began
- h3: safetensors -> pruned-Q4_K GGUF quantizer for the 24GB DiT tiers
- h3_quant_gguf verify: row-error gates calibrated to the measured Q4_K floor
- asset-ai realtime: the feedback loop — the source anchors, the drifted frame inits
- asset-ai realtime: a feedback loop survives a resize and travels by default
- asset-ai realtime: the feedback loop frees itself from the feed handshake and pauses for its listener
- asset-ai realtime: the outbound encode leaves the loop's critical path
- asset-ai ocr: the ocr domain — Chandra 2 at page resolution, and the tower goes planner-owned
- llm slots: a lane can hold an image span — embedding prefill and a rope cursor of its own
- vision tower on CUDA: the encode leg gets its two missing kernels
- llm/ocr: one M-RoPE grid encoder for both image paths, and a livelock made an error
- vision tower on CUDA: the f16 GEMM keeps the precision it was throwing away
- live: a feed that moves box takes its trip with it — one seed image
- vision tower on CUDA: the tiled attention becomes bit-exact, and tensor cores go
- llm prefill on CUDA: the MMA attention kernel gets the tile a 4-to-1 model needs
- asset-ai ocr: the CUDA encode lane joins the integration — vision-parity sits beside run's three arms, and the kernels
- Merge branch 'ocr-perf-integration' into work
- asset-ai: the live anchor can follow the trip, and text leaves the 5090
- asset-ai: the camera moves the world, and the world starts still
- asset-import: the EA strategy classics, in the one 2D contract
- rtsmap: one seeded generator for tiled strategy maps
- asset-ui: one card for the strategy classics, with a pack dropdown
- asset-ai: music3 reference-audio path, ocr/h3 backends, registry
- asset: mp4 sample index for range-streaming, chat tools, import profiles
- cnc: tiberium is twelve growth frames, not twelve empty variants
- platform: native file and save dialogs, in-house on all three desktops
- chat: the scan holds out for a lane home
- chat: a full home queues you — take the free lane
- chat: the preload has a percentage, and the boundless cap stops showing
- llm cuda: the 32x2 attention tile — even GQA ratios stay on MMA
- sa3 gets a bake path: the sfx model's tables precomputed by a diffusion-side bin
- sqlite_query: anti-join regression test
- td import: HARV's second frame block is its harvesting cycle, not a turret
- asset-ui: sprite enhancement runs on the 32B dev DiT — distillation, not the prompt, was the ceiling
- ai-hub: makepad-asset-ai becomes makepad-ai-hub at libs/ai/hub, the chat pane becomes makepad-chat-ui, the service bin
- asset-ui: test health fixtures grow the realtime field they were born without
- ai-hub: one home at ~/.makepad — weights/ run/ cache/ logs/, the service cache migrates from ai_content by a single re
- ai-hub: subprocess workers die with the node — process groups everywhere, PDEATHSIG on linux, one KILL_ON_JOB_CLOSE Jo
- ai-hub: the hub object — AiHub::in_process, pipes vocabulary, and the local LLM engine generalized out of mpfiles (aic
- strict-json: the dependency-free JSON module gets its own crate; asset-client re-exports it so nothing downstream move
- ai-hub: the machine layer — node entries, the 0600 machine token, and the residency election that IS the lock (aicore
- ai-hub: MPHUB1 — the fabric beacon only dedicated nodes can send (aicore §4)
- ai-hub: job leases — work lives only while it is renewed (aicore §8)
- asset-creator: the pipeline library is born — specs, the deps gate, and the derived-state law (aicore §9)
- ai-hub: RAM residency facts — the CPU-side twin of residency.rs (aicore §3)
- ai-hub: ETA placement primitives — relative GPU throughput, the four-term estimate, and an observable breakdown (aicor
- ai-hub: leases go live on the wire — origin fields on submit, /job/<id>/keepalive, /bye, and the reaper that cancels w
- ai-hub: the chat providers move in — fleet qwen, openai, grok, claude/codex/grok CLIs, the responses driver, and the w
- asset-creator: the engine — one pipeline run against the hub, deps-gated, spliced, cancellable, resumable-by-construct
- ai-hub: the machine node mode — --machine binds loopback, registers in ~/.makepad/run, and exits on its own once idle
- asset-creator: makepad-creator-run — the detached client for runs that must outlive a window (aicore §9)
- ai-hub: a native Claude Messages-API provider — API-key or Claude Code OAuth, bounded SSE streaming, injected tools (a
- route + converse: off makepad_ai — the Agent seam moves to converse, route's cloud dispatcher rides the hub's Claude p
- asset-creator: the preset tables move in — fifteen chain-policy constants shared by every creator app (aicore §9 / P6)
- makepad_ai is deleted — every backend is a hub pipe, the agent seam lives with its consumers (aicore §14, decided 2026
- ai-hub: loads hold the machine residency election — set_model_state claims on Loaded and publishes the service port (a
- ai-hub: chats run the machine election — route to a serving holder, wait on a loading one, claim and publish when open
- ai-hub: pick_for_domain_eta — ETA-ranked placement over the shared hard-filter core (aicore §6 / P4)
- asset-creator: the engine picks a provider per stage at dispatch time — a chain's later stages see fresh fleet state (
- ai-hub: the fabric secret gates the service HTTP surface — bearer on everything but /health and the ticketed peer path
- vj: DREAM runs execute in the app — pipelines.rs becomes the run it used to watch (aicore §9 / F1)
- asset-creator: the runner — generate one thing and put it in the catalog, one implementation for every surface (aicore
- chat-ui: the session runs in the app — no broker anywhere on the chat path (aicore P8 / F5)
- asset-store: assets.query is a first-class query endpoint — the bounded SQL surface outlives the broker (aicore P8 / F
- asset-creator: CreatorTools — the chat tool pack for a store that only stores (aicore §9 / P8)
- asset-store: the shrink — the store stores (aicore P7)
- importer + asset-server host: the coordination era ends (aicore P7)
- store config purge + asset-ui goes fleet-direct; the derive protocol gets its route proof (aicore P7)
- client + chat dispatcher: the dead wire comes out (aicore P7/P8)
- ai-hub: 0.3.0 — the health version says which era a node runs
- ai-hub: the default fleet is 'gen' — apps hear the LAN without env plumbing
- ai-hub: the preload note percents the prefill, not the job bar
- ai-hub: conversations keep their KV — the wire mirror, the lane identity, the in-turn dynamic context (aicore §7)
- ai-hub: an open-think model is thinking from its first token
- libs: the zero-warning sweep — stitch casts say what they mean, xatlas keeps upstream's surface quietly
- zero-warning sweep, round two — the first full-workspace pass
- zero-warning sweep, round three — the model lanes and the deep examples
- zero-warning sweep, round four — the last stragglers
- zero-warning sweep, round five — vj and chat-ui
- zero-warning sweep, round six — three cascades

Co-authored-by: Claude <info@makepad.nl>
2026-09-01 16:46:31 +02:00

237 lines
8.8 KiB
Rust

//! One-off audit + repair for cross-published game sources (2026-08-26).
//!
//! The bug: a thumbnail publish raced a Play-switch and republished one
//! game's source over another (Chicane Circuit's head became arena's).
//! The store keeps history, so repair = one more publish carrying the
//! game's own last-good source.
//!
//! Usage (asset-ui server on localhost):
//! repair_games audit
//! repair_games show ast_...
//! repair_games repair <namespace> <slug> <arev_...>
//!
//! NOT a shipped tool: working-tree scaffolding for the repair session.
use makepad_asset_client::{ApiEndpoints, AssetClient, CatalogQuery, ClientConfig};
use makepad_asset_data::{AssetKind, FileRole};
use makepad_asset_importer::games_import;
use std::collections::HashMap;
use std::str::FromStr;
fn server_dir() -> std::path::PathBuf {
std::path::PathBuf::from("local/asset-ui/asset-server")
}
fn connect() -> AssetClient {
let dir = server_dir();
let listen = std::fs::read_to_string(dir.join("listen")).expect("listen file");
let mut parts = listen.trim().split(':');
let ip = parts.next().expect("ip");
let control: u16 = parts.next().expect("control").parse().expect("control port");
let data: u16 = parts.next().expect("data").parse().expect("data port");
let token = std::fs::read_to_string(dir.join("admin-token")).expect("admin token");
let id_hex = std::fs::read_to_string(dir.join("server-id")).expect("server id");
let id_hex = id_hex.trim();
let mut server_id = [0u8; 16];
for i in 0..16 {
server_id[i] = u8::from_str_radix(&id_hex[i * 2..i * 2 + 2], 16).expect("hex");
}
let cache = std::env::temp_dir().join("repair-games-cache");
let mut cfg = ClientConfig::new(cache);
cfg.token = Some(token.trim().to_string());
let endpoints = ApiEndpoints {
control: format!("{ip}:{control}").parse().expect("control addr"),
data: format!("{ip}:{data}").parse().expect("data addr"),
};
AssetClient::connect(cfg, endpoints, Some(server_id)).expect("connect")
}
/// The head source of one game, with enough identity to compare.
#[allow(dead_code)] // identity carried for the comparison prints
struct Head {
asset: makepad_asset_data::AssetId,
title: String,
alias: String,
revision: makepad_asset_data::AssetRevisionId,
blob: makepad_asset_data::BlobId,
text: String,
}
fn head_source(client: &mut AssetClient, alias_str: &str) -> Result<Head, String> {
let alias =
makepad_asset_data::AssetAlias::from_str(alias_str).map_err(|e| format!("{e}"))?;
let head = client.resolve_alias(&alias).map_err(|e| format!("resolve: {e}"))?;
let manifest = client
.fetch_asset_manifest(&head.head_revision)
.map_err(|e| format!("manifest: {e}"))?;
let source = manifest
.files
.iter()
.find(|f| f.role == FileRole::Source)
.ok_or("no source file")?;
let bytes = client
.fetch_blob_bytes(&source.blob, Some(source.byte_len))
.map_err(|e| format!("blob: {e}"))?;
Ok(Head {
asset: head.asset_id,
title: String::new(),
alias: alias_str.to_string(),
revision: head.head_revision,
blob: source.blob,
text: String::from_utf8_lossy(&bytes).to_string(),
})
}
fn games(
client: &mut AssetClient,
) -> Vec<(String, String, String, makepad_asset_data::AssetId)> {
let query = CatalogQuery {
text: String::new(),
namespace: None,
kind: Some(AssetKind::Game),
category: None,
tag: Some("game".into()),
exclude_tag: None,
creator: None,
live_only: true,
page_size: 50,
facets: 0,
};
let page = client.catalog_search(&query, None).expect("search games");
page.hits
.into_iter()
.filter_map(|hit| {
let alias = hit.alias?;
Some((hit.title, hit.snippet, alias.to_string(), hit.asset_id))
})
.collect()
}
/// A few lines that say what a source IS: the first non-empty,
/// non-boilerplate lines.
fn fingerprint(text: &str) -> String {
text.lines()
.map(str::trim)
.filter(|l| !l.is_empty())
.take(3)
.collect::<Vec<_>>()
.join(" | ")
.chars()
.take(160)
.collect()
}
fn audit(client: &mut AssetClient) {
let list = games(client);
println!("{} games listed", list.len());
let mut by_blob: HashMap<makepad_asset_data::BlobId, Vec<String>> = HashMap::new();
for (title, _snippet, alias, asset) in &list {
match head_source(client, alias) {
Ok(head) => {
let blob_hex = format!("{:?}", head.blob);
println!(
"\n== {title} ({alias})\n asset {asset}\n head {}\n blob {}\n text {}",
head.revision,
&blob_hex[..blob_hex.len().min(24)],
fingerprint(&head.text)
);
by_blob.entry(head.blob).or_default().push(format!("{title} ({alias})"));
}
Err(error) => println!("\n== {title} ({alias})\n UNREADABLE: {error}"),
}
}
let mut clean = true;
for (blob, owners) in &by_blob {
if owners.len() > 1 {
clean = false;
println!("\nDUPLICATE HEAD SOURCE {blob:?}:\n {}", owners.join("\n "));
}
}
if clean {
println!("\nno two games share a head source blob");
}
}
fn show(client: &mut AssetClient, asset: &str) {
let asset = makepad_asset_data::AssetId::from_str(asset).expect("asset id");
let detail = client.asset_detail(&asset).expect("detail");
println!("asset {asset} retired={}", detail.retired);
for candidate in &detail.candidates {
let line = match client.fetch_asset_manifest(&candidate.revision) {
Ok(manifest) => match manifest.files.iter().find(|f| f.role == FileRole::Source) {
Some(file) => {
let bytes = client
.fetch_blob_bytes(&file.blob, Some(file.byte_len))
.unwrap_or_default();
format!(
"blob {:?} ({} bytes) — {}",
file.blob,
file.byte_len,
fingerprint(&String::from_utf8_lossy(&bytes))
)
}
None => "no source file".to_string(),
},
Err(error) => format!("manifest unreadable: {error}"),
};
println!(
" {:?} {} published_ms={:?}\n {line}",
candidate.state, candidate.revision, candidate.published_ms
);
}
}
fn repair(client: &mut AssetClient, namespace: &str, slug: &str, revision: &str) {
let revision = makepad_asset_data::AssetRevisionId::from_str(revision).expect("revision id");
let manifest = client.fetch_asset_manifest(&revision).expect("manifest of the good revision");
let source = manifest
.files
.iter()
.find(|f| f.role == FileRole::Source)
.expect("good revision has a source");
let bytes = client
.fetch_blob_bytes(&source.blob, Some(source.byte_len))
.expect("good source blob");
println!(
"restoring {namespace}/{slug} from {revision}\n source blob {:?} ({} bytes)\n {}",
source.blob,
bytes.len(),
fingerprint(&String::from_utf8_lossy(&bytes))
);
// Title + description as currently listed; the picture carries over.
let listed = games(client);
let alias = games_import::game_alias(namespace, slug);
let listed_row = listed.iter().find(|(_, _, a, _)| *a == alias);
let title = listed_row.map(|(t, _, _, _)| t.clone()).unwrap_or_else(|| slug.to_string());
let description = listed_row.map(|(_, d, _, _)| d.clone()).unwrap_or_default();
let thumbnail = games_import::head_thumbnail(client, namespace, slug).expect("head thumbnail");
let rights = makepad_asset_client::PublishRights::generated_cc0();
games_import::publish_game_revision(
client,
namespace,
slug,
&title,
&description,
Some(bytes),
thumbnail,
&rights,
)
.expect("publish restored revision");
println!("restored — new head published for {alias}");
}
fn main() {
let args: Vec<String> = std::env::args().skip(1).collect();
let mut client = connect();
match args.first().map(String::as_str) {
Some("audit") => audit(&mut client),
Some("show") => show(&mut client, args.get(1).expect("show <asset_id>")),
Some("repair") => repair(
&mut client,
args.get(1).expect("repair <namespace> <slug> <arev_...>"),
args.get(2).expect("slug"),
args.get(3).expect("revision"),
),
_ => eprintln!("usage: repair_games audit | show <ast_...> | repair <ns> <slug> <arev_...>"),
}
}