TeamPiped-mirror/Piped-Backend
1
0
Fork 0
mirror of https://github.com/TeamPiped/Piped-Backend.git synced 2024-08-14 23:51:41 +00:00
Code Issues Projects Releases Packages Wiki Activity
1239 commits 12 branches 0 tags 3.7 MiB
Commit graph

427 commits

Author SHA1 Message Date
the_4n0nym0u53
d3d1ee420b
Feature: Implement account deletion (#248) 
* Add backend code for user deletion

* Add endpoint and delete user test

* Delete all user content from db

* Delete from playlist_videos table on user deletion

* Avoid raw SQL in unsubscribeResponse()

* Fix unsubscribeResponse()

* Don't delete PlaylistVideos from other users' playlists

* Fix pruneUnusedPlaylistVideos()

* Remove unused commented-out code

* Fix oopsie

* Proper type declaration due to false error-reporting by VSCode

* Use delete query for better performance

* Cleanup and add OneToMany relationship.

* Revert unsubscribe logic.

Co-authored-by: Kavin <20838718+FireMasterK@users.noreply.github.com>
 2022-05-05 19:51:51 +01:00
Kavin
a5296d6e5a
Add support for a different address for proxying images. (#252) 2022-04-25 07:42:59 +01:00
Kavin
11b53e8c00
Update NewPipeExtractor. (#249) 2022-04-24 18:01:00 +01:00
Kavin
9c1c165fb2
Significantly speed up import process. (#242) 2022-04-11 00:02:25 +01:00
Kavin
ce50b7523f
Handle lbryId timeout gracefully. (#241) 2022-04-09 23:22:16 +01:00
Kavin
561a4f44e1
Add index for playlist owner. (#240) 2022-04-09 22:04:16 +01:00
Kavin
cef4b1dcb7
Handle JSON data better. 2022-04-07 18:40:34 +01:00
Kavin
dc0e4c1bbb
Cache based on playlistId length. 2022-04-07 02:43:01 +01:00
Kavin
ad89de49a0
Change table declaration so unique unique constraints aren't generated. 2022-04-06 17:34:20 +01:00
Kavin
46d9dd1a2e
Add videos size to custom playlist response. 2022-04-06 16:29:30 +01:00
Kavin
76c5fe9273
Fix rss for empty playlist. 2022-04-06 16:27:04 +01:00
Kavin
9e320c914e
Set playlist thumbnail when adding first thumbnail. 2022-04-06 16:15:44 +01:00
Kavin
f7a5f5051a
Add route to delete playlist. 2022-04-06 16:11:28 +01:00
Kavin
1135e20c3d
Add support for Piped playlists in RSS. 2022-04-06 15:05:18 +01:00
Kavin
3d6aefdd0e
Add route to remove from playlist. 2022-04-06 14:31:16 +01:00
Kavin
00e32dc992
Add route to add video to playlist. 2022-04-06 13:07:50 +01:00
Kavin
797a621b51
Add tests for playlist. 2022-04-06 04:23:31 +01:00
Kavin
b049848e79
Add playlist creation route. 2022-04-06 03:46:40 +01:00
FireMaskterK
056d61f2d2
Add playlist object. 2022-04-05 21:59:56 +01:00
Kavin
11845f26fc
Fix ClassCastException. (#235) 2022-03-30 17:47:05 +01:00
Kavin
0cea0a50f5
Change future code and add uploaderSubscriberCount. (#234) 2022-03-30 17:23:56 +01:00
Kavin
5b6dc2b097
Add check for database session in healthcheck. (#232) 
* Add check for database session in healthcheck.

* Add curl test for healthcheck.
 2022-03-29 09:49:42 +01:00
Kavin
b1e875bcf5
Fix subscription imports and improve session handling. (#228) 2022-03-19 18:57:00 +00:00
Kavin
a4b6e1f804
Check if username and password is empty during registration. (#225) 2022-03-16 15:08:18 +00:00
Kavin
43d6dc93c0
Use try with for sessions (#222) 2022-03-16 03:21:24 +00:00
Kavin
6e88cf3050
Log and clear throttling cache every hour. (#220) 2022-03-14 14:54:47 +00:00
Kavin
8fb1871dce
Reduce response cache size. (#214) 2022-03-10 10:14:05 +00:00
Kavin
02ca78ee7a
Manually close okhttp responses. (#210) 
Ensure response is closed properly.
 2022-03-03 12:27:43 +00:00
Kavin
cec135933e
Update NPE and remove the caching of CommentsInfo instances. (#209) 2022-03-03 12:03:45 +00:00
Kavin
72666ecf83
Change no-cache to no-store. (#208) 2022-03-02 20:38:22 +00:00
Kavin
3d8d592768
Fix for bug where subscriptions can't be fetched on fresh accounts. (#205) 2022-03-01 21:02:35 +00:00
Kavin
597e861159
Replace in to equals. (#203) 2022-02-28 22:46:15 +00:00
Kavin
b0b651f44d
Don't perform authentication checks in subscribed route. (#201) 
If the sessionId is invalid, false should be returned for subscribed, we make it the client's responsibility to ensure the sessionId is valid.
 2022-02-24 19:06:38 +00:00
Kavin
014c9533c8
Optimize subscriptions query, by using Criteria API. (#200) 2022-02-24 12:32:39 +00:00
Kavin
78082742ad
Replace left joins with inner joins (#199) 
* Replace left joins with inner joins.

* Temporarily disable YugabyteDB CI
 2022-02-24 12:27:23 +00:00
Kavin
94f5fa37ac
Add route to display version information. (#195) 
* Add version information route.

* Use build action for tests.

* Add version test to script.

* Add testing directory to dockerignore.

* Don't unnecessarily set permission for gradle wrapper script.
 2022-02-22 09:16:45 +00:00
Kavin
a03ae434be
Replace native query with criteria api for PubSub subscriptions (#191) 2022-02-15 11:55:08 +00:00
Kavin
498849ec6b
Replace native query with criteria api for feeds (#190) 2022-02-15 11:37:21 +00:00
Kavin
166e14cf71
Add dedicated route for health check (#189) 2022-02-14 02:38:02 +00:00
FireMasterK
f28d40dffe
Add support for extracting videoId from clipId. 2022-02-10 14:57:08 +00:00
Kavin
7eeff6eec4
Refractor codebase and improve video data update handling. (#185) 2022-02-09 03:06:52 +00:00
Kavin
ec3b69b7a7
Add shortDescription parameter to StreamItem. (#184) 2022-02-08 14:43:45 +00:00
Kavin
cf32a60ed1
Add uploaded field to StreamItem. (#183) 2022-02-06 15:33:46 +00:00
Kavin
b54248b47f
Remove casts by specifying type. (#182) 2022-02-03 11:57:07 +00:00
Kavin
8ba39000b1
Simplify comparators (#181) 2022-02-03 11:29:59 +00:00
Kavin
3748afdd72
Fix for empty lbry streams. (#180) 2022-02-02 21:23:37 +00:00
Kavin
c07cf5fd1f
Refactor Utility methods and migrate to OkHttp (#179) 2022-02-02 21:05:22 +00:00
Kavin
9c926d3183
Force use HTTP 1.1 temporarily. (#177) 2022-02-02 08:05:43 +00:00
Kavin
8880a884c3
Add feed retention configuration option. (#174) 2022-01-31 04:17:16 +00:00
Kavin
9aa16b3299
Improvements to caffeine caching. (#171) 2022-01-26 04:00:56 +00:00
Kavin
322610dbbb
Rewrite chapter image URLs. (#167) 2022-01-13 04:22:09 +00:00
Kavin
c22e8d878b
Add proper mime for rss feeds, and preconnect header for proxy (#157) 2021-12-27 08:54:48 +00:00
Kavin
2923e1ec76
Fix feed validation errors (#155) 2021-12-25 16:46:39 +00:00
Kavin
49f439e761
Add null-check for SponsorBlock endpoint (#154) 2021-12-24 14:17:02 +00:00
Kavin
4c317a6158
Change rss entry from id to link (#150) 
Uri -> Link
 2021-12-20 14:36:20 +00:00
Kavin
b0872ce414
Update default frontend uri (#149) 2021-12-20 14:21:45 +00:00
FireMaskterK
d34e22790f
Add hibernate properties from env variables. 2021-11-23 01:50:06 +00:00
FireMaskterK
749cf48f4b
Read properties from environment if available. 
Closes https://github.com/TeamPiped/Piped/issues/638
 2021-11-23 00:21:18 +00:00
FireMaskterK
6ec517e0ef
Add index and improve pubsub db query. 2021-11-18 23:32:19 +00:00
FireMaskterK
376e068264
Add DownloaderImpl caching. 2021-11-17 09:54:56 +00:00
FireMaskterK
e1e5382959
Add registered users badge. 2021-11-11 11:35:50 +00:00
FireMaskterK
1c8e8b190e
Fix LBRY timeouts. 2021-11-09 08:06:13 +00:00
FireMaskterK
3de3b55d3c
Revert "Fix LBRY timeouts." 
This reverts commit a7b02e9566.
 2021-11-09 08:03:48 +00:00
FireMaskterK
a7b02e9566
Fix LBRY timeouts. 2021-11-09 08:03:21 +00:00
FireMaskterK
ced7b0ee9e
Add configuration property to disable registration. 2021-11-09 06:27:29 +00:00
FireMaskterK
2a87b7946d
Add index for session_id. 2021-11-08 23:46:56 +00:00
FireMaskterK
6012c1cd82
Attempt to fix index performance issues. 2021-11-08 21:28:08 +00:00
FireMaskterK
0d3b167e8a
Add index for video uploaded. 2021-11-08 20:53:48 +00:00
FireMaskterK
e629121c25
Log path only when exception is logged. 2021-11-08 20:35:02 +00:00
FireMaskterK
a7885f1ca1
Update privacy.resistFingerprinting UA. 2021-11-08 15:20:41 +00:00
FireMaskterK
98127b8c0e
Implement chapter segment support. 
Closes https://github.com/TeamPiped/Piped/issues/600
 2021-11-04 19:21:26 +00:00
FireMaskterK
5feec94220
Fix url rewrite issues 
Closes https://github.com/TeamPiped/Piped/issues/598
 2021-11-04 17:45:39 +00:00
FireMaskterK
759a6445f0
Fix for Comment repliesPage being "null" when not present. 2021-11-01 19:58:44 +00:00
FireMaskterK
86154a1a29
Allow Avatar URL to change in channel. 2021-10-31 17:48:34 +00:00
FireMaskterK
ceced61e60
Fix for Chromium depreciation warning. 2021-10-26 18:22:31 +01:00
FireMaskterK
f731308dcc
Implement OpenSearch api. 2021-10-25 23:55:29 +01:00
FireMaskterK
b63786a15e
Cache videos for a maximum of 30 seconds on the client side. 2021-10-23 23:13:54 +01:00
FireMaskterK
1c1dd05455
Add timeout for LBRY calls. 2021-10-12 11:44:21 +01:00
FireMaskterK
022a0af007
Include search corrections in API. 2021-10-10 00:24:29 +01:00
FireMaskterK
2c7baa0710
Don't fail hard when LBRY throws errors. 2021-10-06 16:37:47 +01:00
FireMaskterK
a1a3e717b2 Add option to disable HIBP password check. 
Usage of this option is discouraged for password security reason.
 2021-10-04 19:57:56 +01:00
FireMasterK
d03c677a7f
Fix for possible NPE. 2021-10-03 09:55:13 +01:00
FireMasterK
08aeefa099
Add support for legacy bcrypt hashes from Invidious 2021-10-03 09:02:43 +01:00
FireMasterK
cc3976b454
Improve livestream detection. 2021-10-01 18:53:54 +01:00
FireMasterK
29fb9b02a2
Add support for extracting replies and update NPE. 2021-09-22 15:18:24 +01:00
FireMasterK
84bd3aa164
Improve feed query performance. 2021-09-21 22:35:12 +01:00
FireMasterK
aae627a423
Remove debug constant. 2021-09-21 22:34:25 +01:00
FireMasterK
d6a2d92eeb
Refractor repeated code. 2021-09-10 00:55:16 +05:30
FireMasterK
baa84e9403
Refractor and improve log handling. 2021-09-10 00:19:46 +05:30
FireMasterK
e38d989a5e
Add FRONTEND_URL configuration property. 2021-09-09 13:35:19 +05:30
FireMasterK
cdcae82c4d
Check if passwords are compromised in HIBP. 2021-09-06 00:49:54 +05:30
FireMasterK
721f197bd8
Use substringAfter to cleanup code and fix YouTube music URLs. 2021-09-06 00:14:24 +05:30
FireMasterK
c7338f85f3
Fix NPE in YouTube Music search. 2021-09-05 03:31:48 +05:30
FireMasterK
0fe215ea67
Unify video/StreamInfoItem in Search Results. 2021-09-04 01:02:51 +05:30
FireMasterK
1524085577
Rename field to fix consistency issues. 2021-09-03 23:05:58 +05:30
FireMasterK
b2c9ffa789
Update NewPipeExtractor and extract more info. 2021-09-03 22:01:26 +05:30
FireMasterK
f4b0884978
Commit missing import and fix build. 2021-08-28 13:36:09 +05:30
FireMasterK
3e99d1d806
Add support for overriding subscriptions when importing. 2021-08-28 13:27:56 +05:30
FireMasterK
a15ad70817
Remove unnecessary methods. 2021-08-21 01:55:45 +05:30
FireMasterK
15f7eef82c
Cleanup PubSub query. 2021-08-21 01:52:39 +05:30
FireMasterK
f9f4dd8e74
Add verified info in more places. 2021-08-18 01:37:49 +05:30
FireMasterK
90d04f9e4f
Implement uploaderVerified for feed response. 2021-08-17 22:59:15 +05:30
FireMasterK
e4f071b72a
Add Dash URL to streams response. 2021-08-16 01:21:48 +05:30
3nprob
aed1da4aae
Make listening port configurable (#95) 
Co-authored-by: 3nprob <3nprob@3nprob>
 2021-08-14 16:12:55 +05:30
ChunkyProgrammer
b28356d0ed
get channel subscriber count (#94) 
update
 2021-08-14 09:58:52 +05:30
3nprob
ce5881bad1
Add support for outbound http proxy (#93) 
* Add support for outbound http proxy

* Simplify logic and fix typos.

Co-authored-by: 3nprob <3nprob@3nprob>
Co-authored-by: FireMasterK <20838718+FireMasterK@users.noreply.github.com>
 2021-08-14 00:08:15 +05:30
FireMasterK
a0c5898f4d
Fix CommentorURL NPE and wrong substring. 2021-08-12 22:57:44 +05:30
FireMasterK
0c4856933b
Add lbryId to streams response. 2021-08-08 16:47:58 +05:30
FireMasterK
9d09232319
Fix NPE and add comments disabled field. 2021-07-31 16:09:06 +05:30
FireMasterK
3bc9d05fc4
Update NPE fork and fix comments. 2021-07-30 00:51:37 +05:30
FireMasterK
17dc0aa1ac
Fix LBRY stream extraction. 2021-07-28 13:33:39 +05:30
FireMasterK
f66e77330e
Add route to see subscriptions. 2021-07-23 01:34:21 +05:30
FireMasterK
b4c96729b7
Alter video title's max size. 
See #pnfdBcKHoUw
 2021-07-23 00:29:13 +05:30
FireMasterK
8c6ada2acf
Resp code should be 202 and not 204. 2021-07-22 15:29:59 +05:30
FireMasterK
6641ddc043
Add null-check for logging exceptions. 2021-07-22 15:16:47 +05:30
FireMasterK
b8c6fbf9b1
Log pubsub failures. 2021-07-22 15:13:27 +05:30
FireMasterK
cf9d1cd8cf
Print stacktraces on any errors. 2021-07-21 18:07:43 +05:30
FireMasterK
3d030b6968
Update field names for better reusablity. 2021-07-21 17:49:05 +05:30
FireMasterK
e03f2661b4
Add null check for pubsub. 2021-07-21 02:57:28 +05:30
FireMasterK
a1ed146924
Handle invalid requests gracefully. 2021-07-21 02:36:29 +05:30
FireMasterK
d6e998eef7
Fix "Transaction not successfully started". 2021-07-21 02:27:02 +05:30
FireMasterK
b064d577a8
Generate RSS feed for subscriptions. 2021-07-20 01:14:18 +05:30
FireMasterK
9fe9770714
Fix NPE. 2021-07-18 16:44:31 +05:30
FireMasterK
8b0c7d1eba
Fix feed updates on manual subscription. 2021-07-17 19:32:57 +05:30
FireMasterK
dfca88952a
Use Hibernate as a database (#32) 
* Basic hibernate structure.

* Commit stash.

* Improve a lot of things.

* Implement Feed, PubSub, query optimizations.

* Update video views on channel visits.

* Allow mass importing subscriptions.

* Allow configuring database in config.properties.

* Major multi-threading and pubsub improvements.

* PubSub query improvements and fix for postgres.

* Revert docker-compose change.

* Disable showing sql statements.
 2021-07-17 04:10:46 +05:30
FireMasterK
5a8f5ec8d5
Add Playlist RSS (#80) 
* WIP Playlist rss.

* Complete adding support.
 2021-07-05 00:27:18 +05:30
bopol
ac3c43b1ed
Support region localization for trending (#79) 
* Support region localization for trending

* Revert linting, remove defaulting to US, and fix warning.

Co-authored-by: FireMasterK <20838718+FireMasterK@users.noreply.github.com>
 2021-07-04 23:23:33 +05:30
w1nst0n
9e382483d8
Use same path as youtube (#75) 2021-06-26 15:49:24 +05:30
FireMasterK
4c08c350e8
Fix npe. 2021-06-15 01:18:06 +05:30
FireMasterK
0129cc58ce
Add support for search filters and simplify continuations. 2021-06-15 01:14:41 +05:30
FireMasterK
f00153205e
Don't parse manifest and add proxyUrl for clientside rewrites. 2021-06-10 02:50:53 +05:30
FireMasterK
d53459171f
Give better responses on errors. 2021-06-07 00:15:13 +05:30
FireMasterK
2eb424dcae
Cleanup page handling + fix channel continuations. 2021-06-06 01:04:33 +05:30
FireMasterK
50e5a8871a
Fix error when playlist has no uploader. 2021-06-02 00:22:48 +05:30
FireMasterK
5b77fbed1c
Support for initial pages of other channel URL types. 2021-05-29 00:10:11 +05:30
FireMasterK
3811a7f264
Allow early expiry of cookies. 
Currently configured to 30 minutes.
 2021-05-28 20:47:25 +05:30
FireMasterK
d687446dbf
Add additional details and playlists on search endpoint. 2021-05-28 17:38:48 +05:30
FireMasterK
0e07295265
Add uploader info search. 2021-05-06 21:56:03 +05:30
FireMasterK
a2cd2baf2a
Fix channel URL in comments API. 2021-05-03 21:06:53 +05:30
FireMasterK
98ecee55aa
Allow more to be cached at the browser. 2021-04-22 19:52:32 +05:30
FireMasterK
2139b1431b
Add more info to captions. 2021-04-21 19:52:58 +05:30
FireMasterK
179025af7e
Change from ids to base64 encoded continuations. 2021-04-21 19:32:50 +05:30
FireMasterK
35fa684e4b
Add comments API. 2021-04-03 20:38:32 +05:30
FireMasterK
009c776c71
Use a better threading model. 2021-03-31 16:48:43 +05:30
FireMasterK
d9a84215d7
Implement uploaded date in search. 2021-03-30 20:26:33 +05:30
FireMasterK
8cfa00d5bb
Remove rewriting of thumbnails URLs. 
They already use WEBP.
 2021-03-30 15:17:06 +05:30
FireMasterK
0d76c7437e
Fix playlist continuation. 2021-03-30 15:06:01 +05:30
FireMasterK
8e9547ef8d
Fix channel continuation. 2021-03-30 14:52:36 +05:30
FireMasterK
efc28a8994
ActiveJ migration. (#30) 
* Initial ActiveJ migration.

* Add multi-threading.
 2021-03-29 19:29:10 +05:30
FireMasterK
a0759b4722
Add in-memory anti-captcha implementation. 2021-03-04 19:44:52 +05:30
FireMasterK
ec2d9a38cd
Remove client for now. 2021-02-24 16:02:49 +05:30
FireMasterK
9275e01c5a
Fix compile error. 2021-02-24 15:56:26 +05:30
FireMasterK
dd2ee203bb
Commit changes. 2021-02-24 15:22:29 +05:30
bopol
935ec90710
use server.onDispose().block() instead of Thread.sleep(Long.MAX_VALUE) (#19) 2021-02-10 01:00:34 +05:30
bopol
7e5256134b
Change pubsub mimetype 2021-02-05 20:33:21 +01:00
bopol
347bacdd85 add response mime type 2021-02-05 19:28:02 +01:00
bopol
554d39807b add status code to server response 2021-02-05 18:54:46 +01:00
bopol
e8c7b44e8e Use HttpHeaderNames for HTTP headers 2021-02-05 18:53:14 +01:00
FireMasterK
ec247f5bce
perf: add server timings 2021-01-30 20:39:01 +05:30
FireMasterK
2d1853d6a5
fix error 2021-01-20 21:16:29 +05:30
FireMasterK
e0b0dc946a
fix missing import. 2021-01-20 21:13:41 +05:30
FireMasterK
f712797345
livestreams: add quality selector 2021-01-20 21:05:13 +05:30
FireMasterK
701a9a4837
Fix banner URLs. 2021-01-14 21:20:01 +05:30
FireMasterK
bf42b197be
fix missing imports. 2021-01-12 13:46:49 +05:30
FireMasterK
6b22474093
performance: read and write data as byte arrays. 2021-01-12 13:45:09 +05:30
FireMasterK
208deffbd1
add playlists and small changes. 2021-01-04 11:17:28 +05:30
FireMasterK
4986fe864c
Next page in search results. 2020-12-14 12:41:42 +05:30
FireMasterK
0151b6f2d8
Remove getters. 2020-12-14 11:30:45 +05:30
FireMasterK
709478605a
Add search. 2020-12-09 19:00:42 +05:30
FireMasterK
26b92c751a
Better proxying of images. 2020-12-09 18:59:12 +05:30
FireMasterK
a395115f18
Fixed images not being proxied. 2020-11-25 12:11:06 +05:30
FireMasterK
9527ad4133
Channel Pages and search suggestions. 2020-11-25 10:56:25 +05:30
FireMasterK
f3ab50402c
Livestream and Async task for fetching data. 2020-11-17 11:04:50 +05:30
FireMasterK
669f1a7308
More cleanup. 2020-11-15 17:27:04 +05:30
FireMasterK
9e89d13518
Cleanup and fix Unicode characters. 2020-11-15 14:17:50 +05:30
FireMasterK
f18f87c736
Add support for an external proxy. 2020-11-13 03:10:50 +05:30
FireMasterK
41395b47d0
Initial commit. 2020-11-13 02:49:45 +05:30