Squashed from work: - asset-ai: FastH3 4-step fast video backend; clip keyframes on the wire - asset-ui: loop video chains — text→image→video that ends where it began - h3: safetensors -> pruned-Q4_K GGUF quantizer for the 24GB DiT tiers - h3_quant_gguf verify: row-error gates calibrated to the measured Q4_K floor - asset-ai realtime: the feedback loop — the source anchors, the drifted frame inits - asset-ai realtime: a feedback loop survives a resize and travels by default - asset-ai realtime: the feedback loop frees itself from the feed handshake and pauses for its listener - asset-ai realtime: the outbound encode leaves the loop's critical path - asset-ai ocr: the ocr domain — Chandra 2 at page resolution, and the tower goes planner-owned - llm slots: a lane can hold an image span — embedding prefill and a rope cursor of its own - vision tower on CUDA: the encode leg gets its two missing kernels - llm/ocr: one M-RoPE grid encoder for both image paths, and a livelock made an error - vision tower on CUDA: the f16 GEMM keeps the precision it was throwing away - live: a feed that moves box takes its trip with it — one seed image - vision tower on CUDA: the tiled attention becomes bit-exact, and tensor cores go - llm prefill on CUDA: the MMA attention kernel gets the tile a 4-to-1 model needs - asset-ai ocr: the CUDA encode lane joins the integration — vision-parity sits beside run's three arms, and the kernels - Merge branch 'ocr-perf-integration' into work - asset-ai: the live anchor can follow the trip, and text leaves the 5090 - asset-ai: the camera moves the world, and the world starts still - asset-import: the EA strategy classics, in the one 2D contract - rtsmap: one seeded generator for tiled strategy maps - asset-ui: one card for the strategy classics, with a pack dropdown - asset-ai: music3 reference-audio path, ocr/h3 backends, registry - asset: mp4 sample index for range-streaming, chat tools, import profiles - cnc: tiberium is twelve growth frames, not twelve empty variants - platform: native file and save dialogs, in-house on all three desktops - chat: the scan holds out for a lane home - chat: a full home queues you — take the free lane - chat: the preload has a percentage, and the boundless cap stops showing - llm cuda: the 32x2 attention tile — even GQA ratios stay on MMA - sa3 gets a bake path: the sfx model's tables precomputed by a diffusion-side bin - sqlite_query: anti-join regression test - td import: HARV's second frame block is its harvesting cycle, not a turret - asset-ui: sprite enhancement runs on the 32B dev DiT — distillation, not the prompt, was the ceiling - ai-hub: makepad-asset-ai becomes makepad-ai-hub at libs/ai/hub, the chat pane becomes makepad-chat-ui, the service bin - asset-ui: test health fixtures grow the realtime field they were born without - ai-hub: one home at ~/.makepad — weights/ run/ cache/ logs/, the service cache migrates from ai_content by a single re - ai-hub: subprocess workers die with the node — process groups everywhere, PDEATHSIG on linux, one KILL_ON_JOB_CLOSE Jo - ai-hub: the hub object — AiHub::in_process, pipes vocabulary, and the local LLM engine generalized out of mpfiles (aic - strict-json: the dependency-free JSON module gets its own crate; asset-client re-exports it so nothing downstream move - ai-hub: the machine layer — node entries, the 0600 machine token, and the residency election that IS the lock (aicore - ai-hub: MPHUB1 — the fabric beacon only dedicated nodes can send (aicore §4) - ai-hub: job leases — work lives only while it is renewed (aicore §8) - asset-creator: the pipeline library is born — specs, the deps gate, and the derived-state law (aicore §9) - ai-hub: RAM residency facts — the CPU-side twin of residency.rs (aicore §3) - ai-hub: ETA placement primitives — relative GPU throughput, the four-term estimate, and an observable breakdown (aicor - ai-hub: leases go live on the wire — origin fields on submit, /job/<id>/keepalive, /bye, and the reaper that cancels w - ai-hub: the chat providers move in — fleet qwen, openai, grok, claude/codex/grok CLIs, the responses driver, and the w - asset-creator: the engine — one pipeline run against the hub, deps-gated, spliced, cancellable, resumable-by-construct - ai-hub: the machine node mode — --machine binds loopback, registers in ~/.makepad/run, and exits on its own once idle - asset-creator: makepad-creator-run — the detached client for runs that must outlive a window (aicore §9) - ai-hub: a native Claude Messages-API provider — API-key or Claude Code OAuth, bounded SSE streaming, injected tools (a - route + converse: off makepad_ai — the Agent seam moves to converse, route's cloud dispatcher rides the hub's Claude p - asset-creator: the preset tables move in — fifteen chain-policy constants shared by every creator app (aicore §9 / P6) - makepad_ai is deleted — every backend is a hub pipe, the agent seam lives with its consumers (aicore §14, decided 2026 - ai-hub: loads hold the machine residency election — set_model_state claims on Loaded and publishes the service port (a - ai-hub: chats run the machine election — route to a serving holder, wait on a loading one, claim and publish when open - ai-hub: pick_for_domain_eta — ETA-ranked placement over the shared hard-filter core (aicore §6 / P4) - asset-creator: the engine picks a provider per stage at dispatch time — a chain's later stages see fresh fleet state ( - ai-hub: the fabric secret gates the service HTTP surface — bearer on everything but /health and the ticketed peer path - vj: DREAM runs execute in the app — pipelines.rs becomes the run it used to watch (aicore §9 / F1) - asset-creator: the runner — generate one thing and put it in the catalog, one implementation for every surface (aicore - chat-ui: the session runs in the app — no broker anywhere on the chat path (aicore P8 / F5) - asset-store: assets.query is a first-class query endpoint — the bounded SQL surface outlives the broker (aicore P8 / F - asset-creator: CreatorTools — the chat tool pack for a store that only stores (aicore §9 / P8) - asset-store: the shrink — the store stores (aicore P7) - importer + asset-server host: the coordination era ends (aicore P7) - store config purge + asset-ui goes fleet-direct; the derive protocol gets its route proof (aicore P7) - client + chat dispatcher: the dead wire comes out (aicore P7/P8) - ai-hub: 0.3.0 — the health version says which era a node runs - ai-hub: the default fleet is 'gen' — apps hear the LAN without env plumbing - ai-hub: the preload note percents the prefill, not the job bar - ai-hub: conversations keep their KV — the wire mirror, the lane identity, the in-turn dynamic context (aicore §7) - ai-hub: an open-think model is thinking from its first token - libs: the zero-warning sweep — stitch casts say what they mean, xatlas keeps upstream's surface quietly - zero-warning sweep, round two — the first full-workspace pass - zero-warning sweep, round three — the model lanes and the deep examples - zero-warning sweep, round four — the last stragglers - zero-warning sweep, round five — vj and chat-ui - zero-warning sweep, round six — three cascades Co-authored-by: Claude <info@makepad.nl>
237 lines
8.8 KiB
Rust
237 lines
8.8 KiB
Rust
//! One-off audit + repair for cross-published game sources (2026-08-26).
|
|
//!
|
|
//! The bug: a thumbnail publish raced a Play-switch and republished one
|
|
//! game's source over another (Chicane Circuit's head became arena's).
|
|
//! The store keeps history, so repair = one more publish carrying the
|
|
//! game's own last-good source.
|
|
//!
|
|
//! Usage (asset-ui server on localhost):
|
|
//! repair_games audit
|
|
//! repair_games show ast_...
|
|
//! repair_games repair <namespace> <slug> <arev_...>
|
|
//!
|
|
//! NOT a shipped tool: working-tree scaffolding for the repair session.
|
|
|
|
use makepad_asset_client::{ApiEndpoints, AssetClient, CatalogQuery, ClientConfig};
|
|
use makepad_asset_data::{AssetKind, FileRole};
|
|
use makepad_asset_importer::games_import;
|
|
use std::collections::HashMap;
|
|
use std::str::FromStr;
|
|
|
|
fn server_dir() -> std::path::PathBuf {
|
|
std::path::PathBuf::from("local/asset-ui/asset-server")
|
|
}
|
|
|
|
fn connect() -> AssetClient {
|
|
let dir = server_dir();
|
|
let listen = std::fs::read_to_string(dir.join("listen")).expect("listen file");
|
|
let mut parts = listen.trim().split(':');
|
|
let ip = parts.next().expect("ip");
|
|
let control: u16 = parts.next().expect("control").parse().expect("control port");
|
|
let data: u16 = parts.next().expect("data").parse().expect("data port");
|
|
let token = std::fs::read_to_string(dir.join("admin-token")).expect("admin token");
|
|
let id_hex = std::fs::read_to_string(dir.join("server-id")).expect("server id");
|
|
let id_hex = id_hex.trim();
|
|
let mut server_id = [0u8; 16];
|
|
for i in 0..16 {
|
|
server_id[i] = u8::from_str_radix(&id_hex[i * 2..i * 2 + 2], 16).expect("hex");
|
|
}
|
|
let cache = std::env::temp_dir().join("repair-games-cache");
|
|
let mut cfg = ClientConfig::new(cache);
|
|
cfg.token = Some(token.trim().to_string());
|
|
let endpoints = ApiEndpoints {
|
|
control: format!("{ip}:{control}").parse().expect("control addr"),
|
|
data: format!("{ip}:{data}").parse().expect("data addr"),
|
|
};
|
|
AssetClient::connect(cfg, endpoints, Some(server_id)).expect("connect")
|
|
}
|
|
|
|
/// The head source of one game, with enough identity to compare.
|
|
#[allow(dead_code)] // identity carried for the comparison prints
|
|
struct Head {
|
|
asset: makepad_asset_data::AssetId,
|
|
title: String,
|
|
alias: String,
|
|
revision: makepad_asset_data::AssetRevisionId,
|
|
blob: makepad_asset_data::BlobId,
|
|
text: String,
|
|
}
|
|
|
|
fn head_source(client: &mut AssetClient, alias_str: &str) -> Result<Head, String> {
|
|
let alias =
|
|
makepad_asset_data::AssetAlias::from_str(alias_str).map_err(|e| format!("{e}"))?;
|
|
let head = client.resolve_alias(&alias).map_err(|e| format!("resolve: {e}"))?;
|
|
let manifest = client
|
|
.fetch_asset_manifest(&head.head_revision)
|
|
.map_err(|e| format!("manifest: {e}"))?;
|
|
let source = manifest
|
|
.files
|
|
.iter()
|
|
.find(|f| f.role == FileRole::Source)
|
|
.ok_or("no source file")?;
|
|
let bytes = client
|
|
.fetch_blob_bytes(&source.blob, Some(source.byte_len))
|
|
.map_err(|e| format!("blob: {e}"))?;
|
|
Ok(Head {
|
|
asset: head.asset_id,
|
|
title: String::new(),
|
|
alias: alias_str.to_string(),
|
|
revision: head.head_revision,
|
|
blob: source.blob,
|
|
text: String::from_utf8_lossy(&bytes).to_string(),
|
|
})
|
|
}
|
|
|
|
fn games(
|
|
client: &mut AssetClient,
|
|
) -> Vec<(String, String, String, makepad_asset_data::AssetId)> {
|
|
let query = CatalogQuery {
|
|
text: String::new(),
|
|
namespace: None,
|
|
kind: Some(AssetKind::Game),
|
|
category: None,
|
|
tag: Some("game".into()),
|
|
exclude_tag: None,
|
|
creator: None,
|
|
live_only: true,
|
|
page_size: 50,
|
|
facets: 0,
|
|
};
|
|
let page = client.catalog_search(&query, None).expect("search games");
|
|
page.hits
|
|
.into_iter()
|
|
.filter_map(|hit| {
|
|
let alias = hit.alias?;
|
|
Some((hit.title, hit.snippet, alias.to_string(), hit.asset_id))
|
|
})
|
|
.collect()
|
|
}
|
|
|
|
/// A few lines that say what a source IS: the first non-empty,
|
|
/// non-boilerplate lines.
|
|
fn fingerprint(text: &str) -> String {
|
|
text.lines()
|
|
.map(str::trim)
|
|
.filter(|l| !l.is_empty())
|
|
.take(3)
|
|
.collect::<Vec<_>>()
|
|
.join(" | ")
|
|
.chars()
|
|
.take(160)
|
|
.collect()
|
|
}
|
|
|
|
fn audit(client: &mut AssetClient) {
|
|
let list = games(client);
|
|
println!("{} games listed", list.len());
|
|
let mut by_blob: HashMap<makepad_asset_data::BlobId, Vec<String>> = HashMap::new();
|
|
for (title, _snippet, alias, asset) in &list {
|
|
match head_source(client, alias) {
|
|
Ok(head) => {
|
|
let blob_hex = format!("{:?}", head.blob);
|
|
println!(
|
|
"\n== {title} ({alias})\n asset {asset}\n head {}\n blob {}\n text {}",
|
|
head.revision,
|
|
&blob_hex[..blob_hex.len().min(24)],
|
|
fingerprint(&head.text)
|
|
);
|
|
by_blob.entry(head.blob).or_default().push(format!("{title} ({alias})"));
|
|
}
|
|
Err(error) => println!("\n== {title} ({alias})\n UNREADABLE: {error}"),
|
|
}
|
|
}
|
|
let mut clean = true;
|
|
for (blob, owners) in &by_blob {
|
|
if owners.len() > 1 {
|
|
clean = false;
|
|
println!("\nDUPLICATE HEAD SOURCE {blob:?}:\n {}", owners.join("\n "));
|
|
}
|
|
}
|
|
if clean {
|
|
println!("\nno two games share a head source blob");
|
|
}
|
|
}
|
|
|
|
fn show(client: &mut AssetClient, asset: &str) {
|
|
let asset = makepad_asset_data::AssetId::from_str(asset).expect("asset id");
|
|
let detail = client.asset_detail(&asset).expect("detail");
|
|
println!("asset {asset} retired={}", detail.retired);
|
|
for candidate in &detail.candidates {
|
|
let line = match client.fetch_asset_manifest(&candidate.revision) {
|
|
Ok(manifest) => match manifest.files.iter().find(|f| f.role == FileRole::Source) {
|
|
Some(file) => {
|
|
let bytes = client
|
|
.fetch_blob_bytes(&file.blob, Some(file.byte_len))
|
|
.unwrap_or_default();
|
|
format!(
|
|
"blob {:?} ({} bytes) — {}",
|
|
file.blob,
|
|
file.byte_len,
|
|
fingerprint(&String::from_utf8_lossy(&bytes))
|
|
)
|
|
}
|
|
None => "no source file".to_string(),
|
|
},
|
|
Err(error) => format!("manifest unreadable: {error}"),
|
|
};
|
|
println!(
|
|
" {:?} {} published_ms={:?}\n {line}",
|
|
candidate.state, candidate.revision, candidate.published_ms
|
|
);
|
|
}
|
|
}
|
|
|
|
fn repair(client: &mut AssetClient, namespace: &str, slug: &str, revision: &str) {
|
|
let revision = makepad_asset_data::AssetRevisionId::from_str(revision).expect("revision id");
|
|
let manifest = client.fetch_asset_manifest(&revision).expect("manifest of the good revision");
|
|
let source = manifest
|
|
.files
|
|
.iter()
|
|
.find(|f| f.role == FileRole::Source)
|
|
.expect("good revision has a source");
|
|
let bytes = client
|
|
.fetch_blob_bytes(&source.blob, Some(source.byte_len))
|
|
.expect("good source blob");
|
|
println!(
|
|
"restoring {namespace}/{slug} from {revision}\n source blob {:?} ({} bytes)\n {}",
|
|
source.blob,
|
|
bytes.len(),
|
|
fingerprint(&String::from_utf8_lossy(&bytes))
|
|
);
|
|
// Title + description as currently listed; the picture carries over.
|
|
let listed = games(client);
|
|
let alias = games_import::game_alias(namespace, slug);
|
|
let listed_row = listed.iter().find(|(_, _, a, _)| *a == alias);
|
|
let title = listed_row.map(|(t, _, _, _)| t.clone()).unwrap_or_else(|| slug.to_string());
|
|
let description = listed_row.map(|(_, d, _, _)| d.clone()).unwrap_or_default();
|
|
let thumbnail = games_import::head_thumbnail(client, namespace, slug).expect("head thumbnail");
|
|
let rights = makepad_asset_client::PublishRights::generated_cc0();
|
|
games_import::publish_game_revision(
|
|
client,
|
|
namespace,
|
|
slug,
|
|
&title,
|
|
&description,
|
|
Some(bytes),
|
|
thumbnail,
|
|
&rights,
|
|
)
|
|
.expect("publish restored revision");
|
|
println!("restored — new head published for {alias}");
|
|
}
|
|
|
|
fn main() {
|
|
let args: Vec<String> = std::env::args().skip(1).collect();
|
|
let mut client = connect();
|
|
match args.first().map(String::as_str) {
|
|
Some("audit") => audit(&mut client),
|
|
Some("show") => show(&mut client, args.get(1).expect("show <asset_id>")),
|
|
Some("repair") => repair(
|
|
&mut client,
|
|
args.get(1).expect("repair <namespace> <slug> <arev_...>"),
|
|
args.get(2).expect("slug"),
|
|
args.get(3).expect("revision"),
|
|
),
|
|
_ => eprintln!("usage: repair_games audit | show <ast_...> | repair <ns> <slug> <arev_...>"),
|
|
}
|
|
}
|