Commit Graph

353 Commits

Author SHA1 Message Date
Kavin 43d6dc93c0
Use try with for sessions (#222) 2022-03-16 03:21:24 +00:00
Kavin 6e88cf3050
Log and clear throttling cache every hour. (#220) 2022-03-14 14:54:47 +00:00
Kavin 8fb1871dce
Reduce response cache size. (#214) 2022-03-10 10:14:05 +00:00
Kavin 02ca78ee7a
Manually close okhttp responses. (#210)
Ensure response is closed properly.
2022-03-03 12:27:43 +00:00
Kavin cec135933e
Update NPE and remove the caching of CommentsInfo instances. (#209) 2022-03-03 12:03:45 +00:00
Kavin 72666ecf83
Change no-cache to no-store. (#208) 2022-03-02 20:38:22 +00:00
Kavin 3d8d592768
Fix for bug where subscriptions can't be fetched on fresh accounts. (#205) 2022-03-01 21:02:35 +00:00
Kavin 597e861159
Replace in to equals. (#203) 2022-02-28 22:46:15 +00:00
Kavin b0b651f44d
Don't perform authentication checks in subscribed route. (#201)
If the sessionId is invalid, false should be returned for subscribed, we make it the client's responsibility to ensure the sessionId is valid.
2022-02-24 19:06:38 +00:00
Kavin 014c9533c8
Optimize subscriptions query, by using Criteria API. (#200) 2022-02-24 12:32:39 +00:00
Kavin 78082742ad
Replace left joins with inner joins (#199)
* Replace left joins with inner joins.

* Temporarily disable YugabyteDB CI
2022-02-24 12:27:23 +00:00
Kavin 94f5fa37ac
Add route to display version information. (#195)
* Add version information route.

* Use build action for tests.

* Add version test to script.

* Add testing directory to dockerignore.

* Don't unnecessarily set permission for gradle wrapper script.
2022-02-22 09:16:45 +00:00
Kavin a03ae434be
Replace native query with criteria api for PubSub subscriptions (#191) 2022-02-15 11:55:08 +00:00
Kavin 498849ec6b
Replace native query with criteria api for feeds (#190) 2022-02-15 11:37:21 +00:00
Kavin 166e14cf71
Add dedicated route for health check (#189) 2022-02-14 02:38:02 +00:00
FireMasterK f28d40dffe
Add support for extracting videoId from clipId. 2022-02-10 14:57:08 +00:00
Kavin 7eeff6eec4
Refractor codebase and improve video data update handling. (#185) 2022-02-09 03:06:52 +00:00
Kavin ec3b69b7a7
Add shortDescription parameter to StreamItem. (#184) 2022-02-08 14:43:45 +00:00
Kavin cf32a60ed1
Add uploaded field to StreamItem. (#183) 2022-02-06 15:33:46 +00:00
Kavin b54248b47f
Remove casts by specifying type. (#182) 2022-02-03 11:57:07 +00:00
Kavin 8ba39000b1
Simplify comparators (#181) 2022-02-03 11:29:59 +00:00
Kavin 3748afdd72
Fix for empty lbry streams. (#180) 2022-02-02 21:23:37 +00:00
Kavin c07cf5fd1f
Refactor Utility methods and migrate to OkHttp (#179) 2022-02-02 21:05:22 +00:00
Kavin 9c926d3183
Force use HTTP 1.1 temporarily. (#177) 2022-02-02 08:05:43 +00:00
Kavin 8880a884c3
Add feed retention configuration option. (#174) 2022-01-31 04:17:16 +00:00
Kavin 9aa16b3299
Improvements to caffeine caching. (#171) 2022-01-26 04:00:56 +00:00
Kavin 322610dbbb
Rewrite chapter image URLs. (#167) 2022-01-13 04:22:09 +00:00
Kavin c22e8d878b
Add proper mime for rss feeds, and preconnect header for proxy (#157) 2021-12-27 08:54:48 +00:00
Kavin 2923e1ec76
Fix feed validation errors (#155) 2021-12-25 16:46:39 +00:00
Kavin 49f439e761
Add null-check for SponsorBlock endpoint (#154) 2021-12-24 14:17:02 +00:00
Kavin 4c317a6158
Change rss entry from id to link (#150)
Uri -> Link
2021-12-20 14:36:20 +00:00
Kavin b0872ce414
Update default frontend uri (#149) 2021-12-20 14:21:45 +00:00
FireMaskterK d34e22790f
Add hibernate properties from env variables. 2021-11-23 01:50:06 +00:00
FireMaskterK 749cf48f4b
Read properties from environment if available.
Closes https://github.com/TeamPiped/Piped/issues/638
2021-11-23 00:21:18 +00:00
FireMaskterK 6ec517e0ef
Add index and improve pubsub db query. 2021-11-18 23:32:19 +00:00
FireMaskterK 376e068264
Add DownloaderImpl caching. 2021-11-17 09:54:56 +00:00
FireMaskterK e1e5382959
Add registered users badge. 2021-11-11 11:35:50 +00:00
FireMaskterK 1c8e8b190e
Fix LBRY timeouts. 2021-11-09 08:06:13 +00:00
FireMaskterK 3de3b55d3c
Revert "Fix LBRY timeouts."
This reverts commit a7b02e9566.
2021-11-09 08:03:48 +00:00
FireMaskterK a7b02e9566
Fix LBRY timeouts. 2021-11-09 08:03:21 +00:00
FireMaskterK ced7b0ee9e
Add configuration property to disable registration. 2021-11-09 06:27:29 +00:00
FireMaskterK 2a87b7946d
Add index for session_id. 2021-11-08 23:46:56 +00:00
FireMaskterK 6012c1cd82
Attempt to fix index performance issues. 2021-11-08 21:28:08 +00:00
FireMaskterK 0d3b167e8a
Add index for video uploaded. 2021-11-08 20:53:48 +00:00
FireMaskterK e629121c25
Log path only when exception is logged. 2021-11-08 20:35:02 +00:00
FireMaskterK a7885f1ca1
Update privacy.resistFingerprinting UA. 2021-11-08 15:20:41 +00:00
FireMaskterK 98127b8c0e
Implement chapter segment support.
Closes https://github.com/TeamPiped/Piped/issues/600
2021-11-04 19:21:26 +00:00
FireMaskterK 5feec94220
Fix url rewrite issues
Closes https://github.com/TeamPiped/Piped/issues/598
2021-11-04 17:45:39 +00:00
FireMaskterK 759a6445f0
Fix for Comment repliesPage being "null" when not present. 2021-11-01 19:58:44 +00:00
FireMaskterK 86154a1a29
Allow Avatar URL to change in channel. 2021-10-31 17:48:34 +00:00
FireMaskterK ceced61e60
Fix for Chromium depreciation warning. 2021-10-26 18:22:31 +01:00
FireMaskterK f731308dcc
Implement OpenSearch api. 2021-10-25 23:55:29 +01:00
FireMaskterK b63786a15e
Cache videos for a maximum of 30 seconds on the client side. 2021-10-23 23:13:54 +01:00
FireMaskterK 1c1dd05455
Add timeout for LBRY calls. 2021-10-12 11:44:21 +01:00
FireMaskterK 022a0af007
Include search corrections in API. 2021-10-10 00:24:29 +01:00
FireMaskterK 2c7baa0710
Don't fail hard when LBRY throws errors. 2021-10-06 16:37:47 +01:00
FireMaskterK a1a3e717b2 Add option to disable HIBP password check.
Usage of this option is discouraged for password security reason.
2021-10-04 19:57:56 +01:00
FireMasterK d03c677a7f
Fix for possible NPE. 2021-10-03 09:55:13 +01:00
FireMasterK 08aeefa099
Add support for legacy bcrypt hashes from Invidious 2021-10-03 09:02:43 +01:00
FireMasterK cc3976b454
Improve livestream detection. 2021-10-01 18:53:54 +01:00
FireMasterK 29fb9b02a2
Add support for extracting replies and update NPE. 2021-09-22 15:18:24 +01:00
FireMasterK 84bd3aa164
Improve feed query performance. 2021-09-21 22:35:12 +01:00
FireMasterK aae627a423
Remove debug constant. 2021-09-21 22:34:25 +01:00
FireMasterK d6a2d92eeb
Refractor repeated code. 2021-09-10 00:55:16 +05:30
FireMasterK baa84e9403
Refractor and improve log handling. 2021-09-10 00:19:46 +05:30
FireMasterK e38d989a5e
Add FRONTEND_URL configuration property. 2021-09-09 13:35:19 +05:30
FireMasterK cdcae82c4d
Check if passwords are compromised in HIBP. 2021-09-06 00:49:54 +05:30
FireMasterK 721f197bd8
Use substringAfter to cleanup code and fix YouTube music URLs. 2021-09-06 00:14:24 +05:30
FireMasterK c7338f85f3
Fix NPE in YouTube Music search. 2021-09-05 03:31:48 +05:30
FireMasterK 0fe215ea67
Unify video/StreamInfoItem in Search Results. 2021-09-04 01:02:51 +05:30
FireMasterK 1524085577
Rename field to fix consistency issues. 2021-09-03 23:05:58 +05:30
FireMasterK b2c9ffa789
Update NewPipeExtractor and extract more info. 2021-09-03 22:01:26 +05:30
FireMasterK f4b0884978
Commit missing import and fix build. 2021-08-28 13:36:09 +05:30
FireMasterK 3e99d1d806
Add support for overriding subscriptions when importing. 2021-08-28 13:27:56 +05:30
FireMasterK a15ad70817
Remove unnecessary methods. 2021-08-21 01:55:45 +05:30
FireMasterK 15f7eef82c
Cleanup PubSub query. 2021-08-21 01:52:39 +05:30
FireMasterK f9f4dd8e74
Add verified info in more places. 2021-08-18 01:37:49 +05:30
FireMasterK 90d04f9e4f
Implement uploaderVerified for feed response. 2021-08-17 22:59:15 +05:30
FireMasterK e4f071b72a
Add Dash URL to streams response. 2021-08-16 01:21:48 +05:30
3nprob aed1da4aae
Make listening port configurable (#95)
Co-authored-by: 3nprob <3nprob@3nprob>
2021-08-14 16:12:55 +05:30
ChunkyProgrammer b28356d0ed
get channel subscriber count (#94)
update
2021-08-14 09:58:52 +05:30
3nprob ce5881bad1
Add support for outbound http proxy (#93)
* Add support for outbound http proxy

* Simplify logic and fix typos.

Co-authored-by: 3nprob <3nprob@3nprob>
Co-authored-by: FireMasterK <20838718+FireMasterK@users.noreply.github.com>
2021-08-14 00:08:15 +05:30
FireMasterK a0c5898f4d
Fix CommentorURL NPE and wrong substring. 2021-08-12 22:57:44 +05:30
FireMasterK 0c4856933b
Add lbryId to streams response. 2021-08-08 16:47:58 +05:30
FireMasterK 9d09232319
Fix NPE and add comments disabled field. 2021-07-31 16:09:06 +05:30
FireMasterK 3bc9d05fc4
Update NPE fork and fix comments. 2021-07-30 00:51:37 +05:30
FireMasterK 17dc0aa1ac
Fix LBRY stream extraction. 2021-07-28 13:33:39 +05:30
FireMasterK f66e77330e
Add route to see subscriptions. 2021-07-23 01:34:21 +05:30
FireMasterK b4c96729b7
Alter video title's max size.
See #pnfdBcKHoUw
2021-07-23 00:29:13 +05:30
FireMasterK 8c6ada2acf
Resp code should be 202 and not 204. 2021-07-22 15:29:59 +05:30
FireMasterK 6641ddc043
Add null-check for logging exceptions. 2021-07-22 15:16:47 +05:30
FireMasterK b8c6fbf9b1
Log pubsub failures. 2021-07-22 15:13:27 +05:30
FireMasterK cf9d1cd8cf
Print stacktraces on any errors. 2021-07-21 18:07:43 +05:30
FireMasterK 3d030b6968
Update field names for better reusablity. 2021-07-21 17:49:05 +05:30
FireMasterK e03f2661b4
Add null check for pubsub. 2021-07-21 02:57:28 +05:30
FireMasterK a1ed146924
Handle invalid requests gracefully. 2021-07-21 02:36:29 +05:30
FireMasterK d6e998eef7
Fix "Transaction not successfully started". 2021-07-21 02:27:02 +05:30
FireMasterK b064d577a8
Generate RSS feed for subscriptions. 2021-07-20 01:14:18 +05:30
FireMasterK 9fe9770714
Fix NPE. 2021-07-18 16:44:31 +05:30
FireMasterK 8b0c7d1eba
Fix feed updates on manual subscription. 2021-07-17 19:32:57 +05:30
FireMasterK dfca88952a
Use Hibernate as a database (#32)
* Basic hibernate structure.

* Commit stash.

* Improve a lot of things.

* Implement Feed, PubSub, query optimizations.

* Update video views on channel visits.

* Allow mass importing subscriptions.

* Allow configuring database in config.properties.

* Major multi-threading and pubsub improvements.

* PubSub query improvements and fix for postgres.

* Revert docker-compose change.

* Disable showing sql statements.
2021-07-17 04:10:46 +05:30
FireMasterK 5a8f5ec8d5
Add Playlist RSS (#80)
* WIP Playlist rss.

* Complete adding support.
2021-07-05 00:27:18 +05:30
bopol ac3c43b1ed
Support region localization for trending (#79)
* Support region localization for trending

* Revert linting, remove defaulting to US, and fix warning.

Co-authored-by: FireMasterK <20838718+FireMasterK@users.noreply.github.com>
2021-07-04 23:23:33 +05:30
w1nst0n 9e382483d8
Use same path as youtube (#75) 2021-06-26 15:49:24 +05:30
FireMasterK 4c08c350e8
Fix npe. 2021-06-15 01:18:06 +05:30
FireMasterK 0129cc58ce
Add support for search filters and simplify continuations. 2021-06-15 01:14:41 +05:30
FireMasterK f00153205e
Don't parse manifest and add proxyUrl for clientside rewrites. 2021-06-10 02:50:53 +05:30
FireMasterK d53459171f
Give better responses on errors. 2021-06-07 00:15:13 +05:30
FireMasterK 2eb424dcae
Cleanup page handling + fix channel continuations. 2021-06-06 01:04:33 +05:30
FireMasterK 50e5a8871a
Fix error when playlist has no uploader. 2021-06-02 00:22:48 +05:30
FireMasterK 5b77fbed1c
Support for initial pages of other channel URL types. 2021-05-29 00:10:11 +05:30
FireMasterK 3811a7f264
Allow early expiry of cookies.
Currently configured to 30 minutes.
2021-05-28 20:47:25 +05:30
FireMasterK d687446dbf
Add additional details and playlists on search endpoint. 2021-05-28 17:38:48 +05:30
FireMasterK 0e07295265
Add uploader info search. 2021-05-06 21:56:03 +05:30
FireMasterK a2cd2baf2a
Fix channel URL in comments API. 2021-05-03 21:06:53 +05:30
FireMasterK 98ecee55aa
Allow more to be cached at the browser. 2021-04-22 19:52:32 +05:30
FireMasterK 2139b1431b
Add more info to captions. 2021-04-21 19:52:58 +05:30
FireMasterK 179025af7e
Change from ids to base64 encoded continuations. 2021-04-21 19:32:50 +05:30
FireMasterK 35fa684e4b
Add comments API. 2021-04-03 20:38:32 +05:30
FireMasterK 009c776c71
Use a better threading model. 2021-03-31 16:48:43 +05:30
FireMasterK d9a84215d7
Implement uploaded date in search. 2021-03-30 20:26:33 +05:30
FireMasterK 8cfa00d5bb
Remove rewriting of thumbnails URLs.
They already use WEBP.
2021-03-30 15:17:06 +05:30
FireMasterK 0d76c7437e
Fix playlist continuation. 2021-03-30 15:06:01 +05:30
FireMasterK 8e9547ef8d
Fix channel continuation. 2021-03-30 14:52:36 +05:30
FireMasterK efc28a8994
ActiveJ migration. (#30)
* Initial ActiveJ migration.

* Add multi-threading.
2021-03-29 19:29:10 +05:30
FireMasterK a0759b4722
Add in-memory anti-captcha implementation. 2021-03-04 19:44:52 +05:30
FireMasterK ec2d9a38cd
Remove client for now. 2021-02-24 16:02:49 +05:30
FireMasterK 9275e01c5a
Fix compile error. 2021-02-24 15:56:26 +05:30
FireMasterK dd2ee203bb
Commit changes. 2021-02-24 15:22:29 +05:30
bopol 935ec90710
use server.onDispose().block() instead of Thread.sleep(Long.MAX_VALUE) (#19) 2021-02-10 01:00:34 +05:30
bopol 7e5256134b
Change pubsub mimetype 2021-02-05 20:33:21 +01:00
bopol 347bacdd85 add response mime type 2021-02-05 19:28:02 +01:00
bopol 554d39807b add status code to server response 2021-02-05 18:54:46 +01:00
bopol e8c7b44e8e Use HttpHeaderNames for HTTP headers 2021-02-05 18:53:14 +01:00
FireMasterK ec247f5bce
perf: add server timings 2021-01-30 20:39:01 +05:30
FireMasterK 2d1853d6a5
fix error 2021-01-20 21:16:29 +05:30
FireMasterK e0b0dc946a
fix missing import. 2021-01-20 21:13:41 +05:30
FireMasterK f712797345
livestreams: add quality selector 2021-01-20 21:05:13 +05:30
FireMasterK 701a9a4837
Fix banner URLs. 2021-01-14 21:20:01 +05:30
FireMasterK bf42b197be
fix missing imports. 2021-01-12 13:46:49 +05:30
FireMasterK 6b22474093
performance: read and write data as byte arrays. 2021-01-12 13:45:09 +05:30
FireMasterK 208deffbd1
add playlists and small changes. 2021-01-04 11:17:28 +05:30
FireMasterK 4986fe864c
Next page in search results. 2020-12-14 12:41:42 +05:30
FireMasterK 0151b6f2d8
Remove getters. 2020-12-14 11:30:45 +05:30
FireMasterK 709478605a
Add search. 2020-12-09 19:00:42 +05:30
FireMasterK 26b92c751a
Better proxying of images. 2020-12-09 18:59:12 +05:30
FireMasterK a395115f18
Fixed images not being proxied. 2020-11-25 12:11:06 +05:30
FireMasterK 9527ad4133
Channel Pages and search suggestions. 2020-11-25 10:56:25 +05:30
FireMasterK f3ab50402c
Livestream and Async task for fetching data. 2020-11-17 11:04:50 +05:30
FireMasterK 669f1a7308
More cleanup. 2020-11-15 17:27:04 +05:30
FireMasterK 9e89d13518
Cleanup and fix Unicode characters. 2020-11-15 14:17:50 +05:30
FireMasterK f18f87c736
Add support for an external proxy. 2020-11-13 03:10:50 +05:30
FireMasterK 41395b47d0
Initial commit. 2020-11-13 02:49:45 +05:30