1
0
Fork 0
Commit graph

400 commits

Author SHA1 Message Date
Matthew Holt
1aadee917f
instagram: D'oh, actually make stories optional 2025-10-15 08:37:17 -06:00
Matthew Holt
c9accf2b4a
instagram: Allow stories to not exist (fix #149) 2025-10-14 08:22:29 -06:00
Matthew Holt
1b4b95c65c
instagram: Support 2025 export layout (fix #141) 2025-10-13 13:40:35 -06:00
Matthew Holt
e75213e841
Sanitize super-future timestamps (#145) 2025-10-13 11:03:50 -06:00
Matthew Holt
20f6c4a8f5 Sanitize zero-coordinates (fix #145) 2025-10-13 10:34:00 -06:00
Dominik Roszkowski
d0cd6f3ce9
googlelocation: add Polish translation for 'Timeline' when recognizing on-device export (#143)
Small change to handle Google Location export when using Polish langauge
2025-10-13 10:22:27 -06:00
Matthew Holt
d290f06951
twitter: Finish supporting archives from 2022
Apparently it's not only tweets.js that is tweet.js, it's also tweets_media that is tweet_media, sigh.
2025-10-12 23:19:35 -06:00
Matthew Holt
b77238f86d
twitter: Try tweet.js if tweets.js isn't found
Thanks for the report. Apparently this occurs in archives made in 2022, possibly earlier.
2025-10-12 14:35:26 -06:00
Matthew Holt
4462b4fbee
Update readme 2025-10-11 18:20:37 -06:00
Matthew Holt
765a7f0780 Improve hidden file management (close #134)
And minor fix to regression in KML recognition
2025-10-11 16:33:49 -06:00
Matthew Holt
1763b05279 strava: Permit missing activity files (close #137)
Strava bug causes missing files sometimes, indicated by filename of "#error#"
2025-10-11 16:33:49 -06:00
Matthew Holt
67798d070b
strava: Permit missing activity files (close #137)
Strava bug causes missing files sometimes, indicated by filename of "#error#"
2025-10-11 12:40:48 -06:00
Matthew Holt
0bf014cac0
kml: More rigorous filetype detection 2025-10-11 12:40:19 -06:00
Matthew Holt
1f1b60b8b1
Consider time.Local when processing update policies
Fixes unncessary item updates when repeating an import job
2025-10-10 21:27:53 -06:00
Matthew Holt
0d1d4311ae
Fix unnecessary errors in thumbnail generation 2025-10-10 14:25:52 -06:00
Matthew Holt
55b687a7aa
Make a hot path query more efficient 2025-10-10 07:23:49 -06:00
Matthew Holt
ed21032526 email: Checkpoints 2025-10-09 22:33:09 -06:00
Matthew Holt
6354e9740f
googlelocation: Improve locale support for on-device export names
This is far from a complete list, but for now let's try to get most of the user base covered and see how that goes.

Close #111
2025-10-09 17:06:40 -06:00
Matt Holt
08d5545619
Add Linux ARM 64 builds (#133)
* ci: Try to simplify builder job

* Put claude through its paces

* Nevermind on the Windows thing; may revisit later
2025-10-09 13:29:17 -06:00
Matt Holt
50a00beac2
Make arm64 container image (#130)
* Try alpine

* Test docker image in PR temporarily

* Try fix

* Try debian-slim

* Don't trust the GPTs

* Try a different arch image for arm64

* Try to fix keys

* Sighh

* Fix package name, hopefully

* Add libsqlite3 back in

* Try again

* Fix typos

* Fix error, maybe

* lskjdflkj

* Reset job config and done
2025-10-08 18:55:00 -06:00
Matt Holt
41361913d1
ci: Attempt fix Linux workflows related to old libvips (#129)
Things would be so much easier if ubuntu just updated their packages

* ci: Attempt to fix Linux workflows

See if Copilot is worth its snuff

* Revert

* Try downgrading vipsgen instead

* Try again

* Try to install vips from source

* Sigh, ok try building from source

* Sigh

* sighhhh

* Sighhhhhhhhhhhhhhhhhhhh

* Try without cache for a moment

* Try caching again

* Try composite action

* Try again?

* Set shell on composite action steps...

* Update a couple other workflows

* Try to fix test job

* Some cleanup

* Add heif

* Oops

* Pointless comment but let's see if the cache worked

* Fix go builds

* Try installing pkg-config I guess?

* Try more pkg config paths?

* Tweak

* Are we there yet

* One more tweak

* Rename some things
2025-10-08 14:21:38 -06:00
Matthew Holt
94e963e779
Hopefully fix sqlite DSN for Windows 2025-10-08 11:17:15 -06:00
Matthew Holt
576d2c8b2a
Replace govips with vipsgen
See https://github.com/davidbyttow/govips?tab=readme-ov-file#the-recommended-path-forward-vipsgen
2025-10-08 10:36:55 -06:00
Matthew Holt
feaa8f6812
ci: Publish arm64 container image (close #125) 2025-10-07 14:16:12 -06:00
Matthew Holt
eaff29e1c3
Log data file download duration 2025-10-07 13:36:57 -06:00
Matthew Holt
f7f1bcc99c
smsbackuprestore: Fix non-UTF-8 file errors 2025-10-07 13:36:48 -06:00
Matthew Holt
6fa22bed8b
Support rendering of event class items 2025-10-07 09:53:31 -06:00
Matthew Holt
7dc9312237
Super minor fixes for obfuscation mode 2025-10-04 13:14:25 -06:00
Matthew Holt
9fc0c3e5c1
Work around Google Photos bug with missing ext on sidecar video files
Also fix motion picture transcoding for data files that don't have an extension, by looking up the media type of the image
2025-10-02 18:16:24 -06:00
Matthew Holt
0a70666bc5
Random initial in name for demo mode
Replace an initial in a name with another random letter, rather than a whole name string
2025-10-01 22:39:11 -06:00
Matthew Holt
41273050b0
Just a couple more tiny tweaks 2025-10-01 22:32:33 -06:00
Matthew Holt
5b10b3b59c
Fix item display styles (again...)
There are many situations to consider:
- Gallery page
- Preview modal on gallery page
- Item mini displays (timeline page, map page)
- Items page
- Item page

And then, for each of those, additionally:
- Demo mode off
- Demo mode on (images don't have the actual content image, only the thumbhash)

-And then, for each of those, additionally:
- Image cached
- Image not cached

(When an image is cached, no thumbhash is needed because it is immediately available.)

It's tricky to get everything looking right everywhere!
2025-10-01 22:07:28 -06:00
Matthew Holt
1938dc2f1b
Replace frozen syscall package with x/sys 2025-10-01 12:29:43 -06:00
Matthew Holt
02868a90b7
Fix for determining if a folder is "empty"
When it contains multiple unintentional files
2025-09-30 21:40:08 -06:00
Matthew Holt
92dc1c7664
Show up to 100 KB of job config instead of 10 2025-09-30 15:20:55 -06:00
Matthew Holt
fb3d529228
Refactor thumbnail DB handle as well
Fix error when repo property doesn't exist
2025-09-30 14:04:53 -06:00
Matthew Holt
a4a4cfa370
Actually make exfat fix work
Oops
2025-09-30 13:04:07 -06:00
Matthew Holt
e87e5fcbaa
Fix spelling of function name 2025-09-30 12:49:15 -06:00
Matthew Holt
e9a7c03c53
Fix ExFAT crashes; refactor sql.DB handling
The crashes on ExFAT are caused by a bug in the MacOS ExFAT driver. It is unclear whether other OSes are affected too.

https://github.com/mattn/go-sqlite3/issues/1355

We now utilize sqlite's concurrency features by creating a write pool (size 1) and a read pool, and can eliminate our own RWMutex, which prevents reads at the same time as writes. Sqlite's WAL mode allows reads concurrent with writes, and our code is much cleaner.

Still need to do similar for the thumbnail DB.

Also could look into using prepared statements for more efficiency gains.
2025-09-30 12:31:41 -06:00
Matthew Holt
3659325959
Obfuscate gifs, albeit as still images
This is not ideal... should probably be a blurry video instead, (or animated webp!?) but ain't nobody got time for that right now when there's DB corruption happening
2025-09-27 20:49:26 -06:00
Matthew Holt
5994da8c75
Run ANALYZE less frequently; use write lock
Doubt this will fix the DB corruption errors, but, likely a good change anyway
2025-09-26 14:57:36 -06:00
Matthew Holt
a1ae2cae5f Minor fix for gallery display 2025-09-25 22:52:01 -06:00
Matthew Holt
039dfe5ba8
Fix and optimize entity processing; faster imports
Some certain rare edge cases were problematic, like when importing a contact list / vcard dataset after importing multiple messaging data sets, and there are entities with multiple phone numbers...

That, and a few other things are handled better. The loadEntities query has been cleaned up and corrected.

I got rid of autolink stuff with entity_attributes in the DB because it was not useful or really correct either. Added complexity causing bugs.

Imports are sometimes about 20-50% faster now.
2025-09-25 22:49:39 -06:00
Matthew Holt
64aaa2a13c
Support thumbnails for PDFs
Also a few very minor frontend fixes/tweaks
2025-09-25 22:44:57 -06:00
Matthew Holt
3b9acbb363
googlevoice: Preserve newlines in texts 2025-09-25 22:44:03 -06:00
Matthew Holt
ae3dde3e4c
Minor tweaks to the import page
- The return of the accordion button chevrons!
- Hid the Interactive option since it's not yet finished
- Moved a couple options into the advanced settings dialog
2025-09-23 21:47:18 -06:00
Matthew Holt
dab1adbf24
Force-update repo owner info when opening timeline
Bust the session storage cache in the browser

(Also load entity stored timestamp when loading entity)
2025-09-23 14:03:29 -06:00
Matthew Holt
f7899992b4
go.mod: Upgrade mholt/archives
I guess the new Google Takeout backend uses a new/upgraded archiver that makes directories implicit within an archive. It exposed a bug in the archives package that did not return a stat entry for implicit directories. That's arguably correct, but not helpful when treating an archive as a file system or, like, a normal directory.
2025-09-23 13:35:32 -06:00
Matthew Holt
44d199bbb9
googlephotos: Add support for newer 2025 Takeout archives
The archive filename format changed slightly
2025-09-23 12:48:11 -06:00
Matthew Holt
8ac13e9b8e
Try to fix Tabler bug
See https://github.com/tabler/tabler/issues/2271
2025-09-23 11:33:32 -06:00