Commit graph

18 commits

Author SHA1 Message Date
312e499fac Use custom snapshots instead of nodejs's to handle carriage returns and better diffing/flow of running tests 2026-03-04 06:00:01 -05:00
d14f1ec778 Claude: Add fitbit export, though tests are broken due to snapshot oddities 2026-03-03 07:39:50 +00:00
c84d901dd5 Added fitbit test fixture 2026-03-02 08:42:47 -05:00
6fd859e057 Scrub now handles CSVs (in Typescript), scrub now has tests (for both TS and jq scrubbing), scrub has many more cases 2026-03-02 01:54:20 -05:00
4a50ed5d74 Consolidate all separate export tests into single file + single test strategy 2026-03-01 13:20:10 -05:00
06d5dec7e7 Claude: added 3 new exporters + tests 2026-02-28 02:30:39 +00:00
c093fbfcee Added 3 more scrubbed fixtures for new exports, scrub added boolean and numeric key scrubbing 2026-02-27 03:39:42 -05:00
a4fbe1618d Fixed FB dating messages, added metadata as output table, added aggregate message thread metadata from FB
* aggregateId is now metadata and it's just aggregate: boolean and uses .id instead
* Use csv-parse for tests
* Update test snapshots
2026-02-26 11:21:36 -05:00
f6d0427a45 Converted TaskTargetPipelineHelper to more functional style, added aggregate() functionality to bring together multiple exports (no tests, but works)
* made parallel generic (not tied to TaskTarget)
* pulled common higher-order/frontend operations into io.ts
* split timelinize specific functionality into own file
* Tests made to pass and match previous facebook export snapshots _exactly_
2026-02-26 00:14:10 -05:00
3e64969e05 Clean up API, make columnMeta a bit more specific 2026-02-22 08:22:38 -05:00
f6b0f02de7 setId(), types(), csvSink() become assignMeta(), clean up unused task.ts stuff 2026-02-22 05:23:17 -05:00
fa07098549 Added zipped facebook export test 2026-02-21 06:06:50 -05:00
29a7d43851 Add facebook tests against fixtures (fixed a few bugs), add GNU parallel replacement using Typescript + AI 2026-02-21 06:01:53 -05:00
4a20a02ef5 Fix tests to be portable, fix claude's odd character choice, cleanup shEscape() after a bunch of research 2026-02-21 04:50:11 -05:00
787e281049 Claude: add tests, fix bugs 2026-02-20 20:56:17 +00:00
20a0a6b310 Removed all prototyping stuff, simplified Task, removed unnecessary state now that I'm not using streams 2026-02-20 06:07:58 -05:00
4978a97f23 Added scrub and scrubbed facebook exports, and stub test 2026-02-20 01:28:05 -05:00
089f1e6134 Added prototype2.ts, use old Mapcast dgraph facebook code with many modifications, add tests for ChildProcessDuplex after really annoying issue 2025-11-26 04:13:04 -05:00