CypherpunkSamurai
/
NewPipeExtractor
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,302 Commits 2 Branches 0 Tags 95 MiB
Commit Graph

1302 Commits

Author SHA1 Message Date
bopol ff5273b882
Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/extractors/YoutubeCommentsExtractor.java 
Co-authored-by: Tobi <TobiGr@users.noreply.github.com>
 2021-03-05 14:39:01 +01:00
bopol ed850d0688 [youtube] improve comments extraction performance 
- do not parse responseBody twice for continuation
instead try to get commentsTokenInside with the new pattern ("sectionListRenderer")
and try again with the old pattern ("commentSectionRenderer") on failure
- do not unescape responseBody multiple times
   -> parse responseBody less times
 2021-03-05 13:37:08 +01:00
Tobi b608587e4d
Merge pull request #572 from golfinq/fixed-comments 
Fixes missing comments under videos
 2021-03-05 11:42:40 +01:00
golfinq 05213175cd
minor edit, made variable final 2021-03-05 02:49:15 -05:00
golfinq 8bceb57a6c
formatting fix 2021-03-05 02:46:06 -05:00
golfinq ae48bdea4c
Updated to reflect variable name change 2021-03-05 02:40:36 -05:00
XiangRongLin 9256b3b848
Merge pull request #567 from XiangRongLin/playlist_continuations 
Playlist continuations
 2021-03-04 19:05:32 +01:00
XiangRongLin 506cc5fbe9 regenerate mocks 2021-03-04 19:01:58 +01:00
XiangRongLin 03b00ff1d6 Move toJsonArray and toJsonObject to JsonUtils 2021-03-04 18:58:51 +01:00
FireMasterK 668b080b3a Use dynamic key. 2021-03-04 08:45:14 +01:00
XiangRongLin 43b46bd408 Use new youtube continuations api for playlists 
Requires sending a POST request instead of GET.
clientName and clientVersion, which were required as headers previously now need to be part of the request payload.
continuation id also needs to be part of request body.

quick and dirty solution.
 2021-03-03 19:49:26 +01:00
XiangRongLin beb05bd05c Replace test url, because playlist was deleted 2021-03-03 19:46:14 +01:00
Tobi 5d594cfded
Merge pull request #549 from FireMasterK/gradle-update 
Update gradle wrapper.
 2021-02-24 15:59:28 +01:00
Tobi 965a66bc87
Merge pull request #557 from TiA4f8R/fix-encoding-errors-windows 
Set extractor encoding to UTF-8
 2021-02-24 15:49:58 +01:00
TiA4f8R b2cf41496d
Set extractor encoding to UTF-8 
When compiling the extractor on Windows, you get more than 100 errors with the message error: unmappable character for encoding Cp1252, especially in timeago-parser tasks. This commit fixes it by setting the encoding for all compileJava and compileTestJava tasks to UTF-8.
 2021-02-23 14:38:20 +01:00
bopol a9aa385bb3
Merge pull request #554 from B0pol/test-verified 
use DownloaderFactory instead of DownloaderTestImpl for search Channe…
 2021-02-20 12:12:43 +01:00
bopol 0c831afa7b use DownloaderFactory instead of DownloaderTestImpl for search ChannelVerified 2021-02-20 11:41:30 +01:00
bopol 27a20e41cd
Merge pull request #550 from FireMasterK/add-more-data 
Add more data.
 2021-02-18 20:28:27 +01:00
FireMasterK 5333d8a98b
Add more data. 2021-02-19 00:55:03 +05:30
FireMasterK 88890d81a5
Update gradle wrapper. 2021-02-18 21:15:12 +05:30
bopol 9c1a7f7df6
Merge pull request #521 from B0pol/verified 
Add uploader verified by service extraction
 2021-02-18 16:39:53 +01:00
bopol 1a322ad8ed Add uploader verified by service extraction 2021-02-18 16:36:40 +01:00
bopol db253e202b
Merge pull request #535 from TeamPiped/adaptive-parsing 
Adaptive Stream parsing
 2021-02-18 15:55:27 +01:00
FireMasterK c24afa2cbb Permalink URL. 2021-02-18 20:16:53 +05:30
FireMasterK 8d54401233 Add fps field as well. 2021-02-18 20:16:53 +05:30
FireMasterK 4d096be14a Revert "Update gradle wrapper." 
This reverts commit 591856e3a11998c4b8ba87b5e361e2b9556d760f.
 2021-02-18 20:16:53 +05:30
FireMasterK 5b70645d85 Add data to muxed streams aswell. 2021-02-18 20:16:53 +05:30
FireMasterK e975d33fbe Change jdoc / comments. 2021-02-18 20:16:53 +05:30
FireMasterK f31b2a68fd use getters/setters. 2021-02-18 20:16:53 +05:30
FireMasterK d4945ac55c Constructor cleanup. 2021-02-18 20:16:52 +05:30
FireMasterK 3f6a601be8 Fix jdoc / comments. 2021-02-18 20:16:52 +05:30
FireMasterK a7c9905183 Fix requested changes. 2021-02-18 20:16:52 +05:30
FireMasterK 0c0f2d74bc Make fields private 
Co-authored-by: bopol <bopol@e.email>
 2021-02-18 20:16:52 +05:30
FireMasterK d1054338d3 Fix error with livestreams. 2021-02-18 20:16:52 +05:30
FireMasterK 11eb4932f4 Add data to respective classes. 2021-02-18 20:16:52 +05:30
FireMasterK 525e345ed8 remove duplicate field. 2021-02-18 20:16:52 +05:30
FireMasterK e844d2aed3 Add dash fields to the ItagItem. 2021-02-18 20:16:52 +05:30
FireMasterK b713a7af8c Update gradle wrapper. 2021-02-18 20:16:52 +05:30
bopol 64f6b0478f
Merge pull request #545 from XiangRongLin/comment_reset 
Add comment explaining YoutubeParsingHelper.resetClientVersionAndKey
 2021-02-18 15:14:03 +01:00
XiangRongLin 26d50aca05 Add comment explaining YoutubeParsingHelper.resetClientVersionAndKey 2021-02-17 19:21:39 +01:00
bopol 84380e4c3a
Merge pull request #536 from B0pol/watchendpoints 
support /watch/, /v/ and /w/ subpaths
 2021-02-16 20:23:27 +01:00
bopol 41f689b099 Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/linkHandler/YoutubeStreamLinkHandlerFactory.java 
Co-authored-by: Stypox <stypox@pm.me>
 2021-02-16 19:17:10 +01:00
XiangRongLin a9594f531f
Merge pull request #543 from XiangRongLin/unignore1 
Unignore and fix some tests
 2021-02-16 18:00:16 +01:00
XiangRongLin a28e0226c5
Merge pull request #519 from XiangRongLin/better_logging_error_handling 
Better logging, error handling, doc for mock tests
 2021-02-16 15:06:06 +01:00
XiangRongLin 05cb22c654 Unignore Gronkh.testDescription 
Remove special character ü from assertion
 2021-02-16 08:59:35 +01:00
XiangRongLin d9b4c2779f Unignore YoutubeSearchQHTest.testRegularValues 2021-02-16 08:59:35 +01:00
XiangRongLin 137272b7a4 Unignore YoutubeCommentsExtractorTest.EmptyComment 
Mock files were missing
 2021-02-16 08:59:34 +01:00
bopol 416cf17b7a
Merge pull request #532 from B0pol/utf8 
Code improvement
 2021-02-15 18:56:28 +01:00
bopol 7a3d9bdb7d Description: add .equals() and .hashCode() 2021-02-15 18:51:47 +01:00
bopol 557934cb17 use EMPTY_STRING 2021-02-15 18:51:46 +01:00