Commit graph

35 commits

Author SHA1 Message Date
e7bb41d8ab Claude: Output summary as csv with csv-stringify 2026-03-04 13:54:22 +00:00
f0df9bccf7 Claude: add summary.ts 2026-03-04 12:20:11 +00:00
312e499fac Use custom snapshots instead of nodejs's to handle carriage returns and better diffing/flow of running tests 2026-03-04 06:00:01 -05:00
d14f1ec778 Claude: Add fitbit export, though tests are broken due to snapshot oddities 2026-03-03 07:39:50 +00:00
c84d901dd5 Added fitbit test fixture 2026-03-02 08:42:47 -05:00
6fd859e057 Scrub now handles CSVs (in Typescript), scrub now has tests (for both TS and jq scrubbing), scrub has many more cases 2026-03-02 01:54:20 -05:00
1665069593 Use Nodejs's native implementation of globSync(), colocate all zipFs weirdness in it's own file 2026-03-01 15:48:41 -05:00
4a50ed5d74 Consolidate all separate export tests into single file + single test strategy 2026-03-01 13:20:10 -05:00
06d5dec7e7 Claude: added 3 new exporters + tests 2026-02-28 02:30:39 +00:00
c093fbfcee Added 3 more scrubbed fixtures for new exports, scrub added boolean and numeric key scrubbing 2026-02-27 03:39:42 -05:00
7d815833e6 Rewrote timelinize.ts to work, and added new features for it. Added aggregateColumns for aggregated header, added metaIdValue to track which aggregate has metadata for another TaskTarget, added each() to allow a method of using cmd() with .id and other properties, added execPaths to make the initial definition of TaskTarget array to be a little more succinct 2026-02-26 16:32:33 -05:00
a4fbe1618d Fixed FB dating messages, added metadata as output table, added aggregate message thread metadata from FB
* aggregateId is now metadata and it's just aggregate: boolean and uses .id instead
* Use csv-parse for tests
* Update test snapshots
2026-02-26 11:21:36 -05:00
f6d0427a45 Converted TaskTargetPipelineHelper to more functional style, added aggregate() functionality to bring together multiple exports (no tests, but works)
* made parallel generic (not tied to TaskTarget)
* pulled common higher-order/frontend operations into io.ts
* split timelinize specific functionality into own file
* Tests made to pass and match previous facebook export snapshots _exactly_
2026-02-26 00:14:10 -05:00
9c3bdaa100 Broken AI code adding more columns 2026-02-24 03:50:15 +00:00
845ceb4c84 Change up main for timelinize output 2026-02-22 11:52:42 -05:00
80be7de844 Claude: annotate all facebook tables with metadata and description preliminarily 2026-02-22 13:33:35 +00:00
3e64969e05 Clean up API, make columnMeta a bit more specific 2026-02-22 08:22:38 -05:00
f6b0f02de7 setId(), types(), csvSink() become assignMeta(), clean up unused task.ts stuff 2026-02-22 05:23:17 -05:00
fa07098549 Added zipped facebook export test 2026-02-21 06:06:50 -05:00
29a7d43851 Add facebook tests against fixtures (fixed a few bugs), add GNU parallel replacement using Typescript + AI 2026-02-21 06:01:53 -05:00
4a20a02ef5 Fix tests to be portable, fix claude's odd character choice, cleanup shEscape() after a bunch of research 2026-02-21 04:50:11 -05:00
787e281049 Claude: add tests, fix bugs 2026-02-20 20:56:17 +00:00
20a0a6b310 Removed all prototyping stuff, simplified Task, removed unnecessary state now that I'm not using streams 2026-02-20 06:07:58 -05:00
4978a97f23 Added scrub and scrubbed facebook exports, and stub test 2026-02-20 01:28:05 -05:00
03a5fec65e Make zip work for globbing (wasnt working before), added facebook v2 for newer 2025 format, write to :memory: sqlite db before writing to disk for speed 2025-12-04 04:50:44 -05:00
b90a66bfe2 Tighten up zip support, prune all non-existant files when searching for files to load 2025-12-04 00:06:48 -05:00
0b1d63c314 Bundled the parallels and other stuff into the typescript program, use csv extension and virtual csv tables to load everything _really_ fast 2025-12-03 23:16:53 -05:00
007c377ec5 Add zip support for the new shell output 2025-12-03 20:44:15 -05:00
d49c0a23f0 Added google initial, converted rest of facebook, heavily tweaked task to make it less obtuse, use GNU parallels as output instead of internally runner now 2025-12-03 16:29:42 -05:00
a904a56424 Add zipfs, zip() task, and hacked together zip work for facebook() to test with a .zip file directly (it worked\!) 2025-11-26 06:14:15 -05:00
6a9b2228ba facebook2 -> facebook 2025-11-26 04:50:03 -05:00
af221041b1 Converted a few more facebook documents 2025-11-26 04:25:55 -05:00
089f1e6134 Added prototype2.ts, use old Mapcast dgraph facebook code with many modifications, add tests for ChildProcessDuplex after really annoying issue 2025-11-26 04:13:04 -05:00
a0b8a8913d Added initial prototype.ts/prototype task for generating the UI 2025-11-25 03:27:20 -05:00
73f3e62dd0 Initial commit 2025-11-24 22:42:27 -05:00