cobertos/base-data-manager
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
base-data-manager/test/fixtures
History
Exact
cobertos fa07098549 Added zipped facebook export test
2026-02-21 06:06:50 -05:00
..
facebook-json-2021-05-01 Added scrub and scrubbed facebook exports, and stub test 2026-02-20 01:28:05 -05:00
facebook-json-2025-11-29 Added scrub and scrubbed facebook exports, and stub test 2026-02-20 01:28:05 -05:00
facebook-json-2021-05-01.zip Added zipped facebook export test 2026-02-21 06:06:50 -05:00
README.md Added scrub and scrubbed facebook exports, and stub test 2026-02-20 01:28:05 -05:00

README.md

Addition process

  • Paste in a new folder
  • Manually scan through folders and delete any long lists of files. For example, facebook chats, we dont need 100 chat thread .json files
  • Run util/scrub.ts inside that folder
  • Fix any warnings that come out of the above for manual edits
  • Manually blank out any file/folder names with IDs or PII
  • Manually scan through each file for any remaining PII

Corpus

  • facebook-json-2021-05-01 - Facebook JSON export
  • facebook-json-2025-11-29 - Facebook JSON export