Commit graph

13 commits

Author SHA1 Message Date
7d815833e6 Rewrote timelinize.ts to work, and added new features for it. Added aggregateColumns for aggregated header, added metaIdValue to track which aggregate has metadata for another TaskTarget, added each() to allow a method of using cmd() with .id and other properties, added execPaths to make the initial definition of TaskTarget array to be a little more succinct 2026-02-26 16:32:33 -05:00
a4fbe1618d Fixed FB dating messages, added metadata as output table, added aggregate message thread metadata from FB
* aggregateId is now metadata and it's just aggregate: boolean and uses .id instead
* Use csv-parse for tests
* Update test snapshots
2026-02-26 11:21:36 -05:00
f6d0427a45 Converted TaskTargetPipelineHelper to more functional style, added aggregate() functionality to bring together multiple exports (no tests, but works)
* made parallel generic (not tied to TaskTarget)
* pulled common higher-order/frontend operations into io.ts
* split timelinize specific functionality into own file
* Tests made to pass and match previous facebook export snapshots _exactly_
2026-02-26 00:14:10 -05:00
9c3bdaa100 Broken AI code adding more columns 2026-02-24 03:50:15 +00:00
80be7de844 Claude: annotate all facebook tables with metadata and description preliminarily 2026-02-22 13:33:35 +00:00
3e64969e05 Clean up API, make columnMeta a bit more specific 2026-02-22 08:22:38 -05:00
f6b0f02de7 setId(), types(), csvSink() become assignMeta(), clean up unused task.ts stuff 2026-02-22 05:23:17 -05:00
29a7d43851 Add facebook tests against fixtures (fixed a few bugs), add GNU parallel replacement using Typescript + AI 2026-02-21 06:01:53 -05:00
20a0a6b310 Removed all prototyping stuff, simplified Task, removed unnecessary state now that I'm not using streams 2026-02-20 06:07:58 -05:00
03a5fec65e Make zip work for globbing (wasnt working before), added facebook v2 for newer 2025 format, write to :memory: sqlite db before writing to disk for speed 2025-12-04 04:50:44 -05:00
d49c0a23f0 Added google initial, converted rest of facebook, heavily tweaked task to make it less obtuse, use GNU parallels as output instead of internally runner now 2025-12-03 16:29:42 -05:00
a904a56424 Add zipfs, zip() task, and hacked together zip work for facebook() to test with a .zip file directly (it worked\!) 2025-11-26 06:14:15 -05:00
6a9b2228ba facebook2 -> facebook 2025-11-26 04:50:03 -05:00
Renamed from data-export/facebook2.ts (Browse further)