1665069593
Use Nodejs's native implementation of globSync(), colocate all zipFs weirdness in it's own file
2026-03-01 15:48:41 -05:00
7d815833e6
Rewrote timelinize.ts to work, and added new features for it. Added aggregateColumns for aggregated header, added metaIdValue to track which aggregate has metadata for another TaskTarget, added each() to allow a method of using cmd() with .id and other properties, added execPaths to make the initial definition of TaskTarget array to be a little more succinct
2026-02-26 16:32:33 -05:00
a4fbe1618d
Fixed FB dating messages, added metadata as output table, added aggregate message thread metadata from FB
...
* aggregateId is now metadata and it's just aggregate: boolean and uses .id instead
* Use csv-parse for tests
* Update test snapshots
2026-02-26 11:21:36 -05:00
f6d0427a45
Converted TaskTargetPipelineHelper to more functional style, added aggregate() functionality to bring together multiple exports (no tests, but works)
...
* made parallel generic (not tied to TaskTarget)
* pulled common higher-order/frontend operations into io.ts
* split timelinize specific functionality into own file
* Tests made to pass and match previous facebook export snapshots _exactly_
2026-02-26 00:14:10 -05:00
9c3bdaa100
Broken AI code adding more columns
2026-02-24 03:50:15 +00:00
3e64969e05
Clean up API, make columnMeta a bit more specific
2026-02-22 08:22:38 -05:00
f6b0f02de7
setId(), types(), csvSink() become assignMeta(), clean up unused task.ts stuff
2026-02-22 05:23:17 -05:00
29a7d43851
Add facebook tests against fixtures (fixed a few bugs), add GNU parallel replacement using Typescript + AI
2026-02-21 06:01:53 -05:00
4a20a02ef5
Fix tests to be portable, fix claude's odd character choice, cleanup shEscape() after a bunch of research
2026-02-21 04:50:11 -05:00
787e281049
Claude: add tests, fix bugs
2026-02-20 20:56:17 +00:00
20a0a6b310
Removed all prototyping stuff, simplified Task, removed unnecessary state now that I'm not using streams
2026-02-20 06:07:58 -05:00
03a5fec65e
Make zip work for globbing (wasnt working before), added facebook v2 for newer 2025 format, write to :memory: sqlite db before writing to disk for speed
2025-12-04 04:50:44 -05:00
b90a66bfe2
Tighten up zip support, prune all non-existant files when searching for files to load
2025-12-04 00:06:48 -05:00
007c377ec5
Add zip support for the new shell output
2025-12-03 20:44:15 -05:00
d49c0a23f0
Added google initial, converted rest of facebook, heavily tweaked task to make it less obtuse, use GNU parallels as output instead of internally runner now
2025-12-03 16:29:42 -05:00
a904a56424
Add zipfs, zip() task, and hacked together zip work for facebook() to test with a .zip file directly (it worked\!)
2025-11-26 06:14:15 -05:00
089f1e6134
Added prototype2.ts, use old Mapcast dgraph facebook code with many modifications, add tests for ChildProcessDuplex after really annoying issue
2025-11-26 04:13:04 -05:00
