CypherpunkSamurai/NewPipeExtractor
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Commit graph

  • 883f16e0ad [YouTube] Set CONSENT cookie TobiGr 2021-04-07 12:25:59 +02:00
  • aee3838ed5 Ignore unreliable SoundcloudGoPlusTrack.testRelatedItems XiangRongLin 2021-04-06 18:26:06 +02:00
  • 90afd6162a
         Merge pull request #599 from XiangRongLin/post_body XiangRongLin 2021-04-06 18:23:26 +02:00
  • 7b06c696e2 Use Page.body for YoutubeChannelExtractor XiangRongLin 2021-04-02 21:42:22 +02:00
  • eda1b6e199 Use Page.body for YoutubePlaylistExtractor XiangRongLin 2021-04-02 21:34:47 +02:00
  • 3af26a2821 Add body field to Page XiangRongLin 2021-04-02 21:34:04 +02:00
  • 4e0be60ddc
         Merge pull request #601 from XiangRongLin/fix_tests Tobi 2021-04-04 09:55:54 +02:00
  • 7b36469807 Fix SoundcloudGoPlusTrack XiangRongLin 2021-04-04 09:39:26 +02:00
  • b481a228cd
         Merge pull request #598 from XiangRongLin/fix_tests Tobi 2021-04-03 23:44:23 +02:00
  • 3d70b6d46a Fix a test and ignore rest XiangRongLin 2021-04-02 20:23:03 +02:00
  • 1925dcf4dc
         Merge pull request #597 from fynngodau/related-items XiangRongLin 2021-04-02 19:54:22 +02:00
  • c877712647 Add deprecated old method calls to avoid breaking API Fynn Godau 2021-04-01 22:31:01 +02:00
  • 14f6f1b7c3 Generify related streams calls and rename method Fynn Godau 2021-03-31 20:21:49 +02:00
  • 9dbc152d44
         Merge pull request #594 from TeamNewPipe/conersions Stypox 2021-03-31 14:34:46 +02:00
  • 1498e1905e Reduce number of type conversions in YouTubeSearchExtractor.collectStreamsFrom by introducing new variable TobiGr 2021-03-31 13:30:06 +02:00
  • 7ea2cd73d3
         Merge pull request #589 from fynngodau/bandcamp-more-recent-pages Tobi 2021-03-31 12:15:12 +02:00
  • 705f6c6e33 Apply review Fynn Godau 2021-03-31 10:43:13 +02:00
  • 564d74c250
         Merge pull request #578 from TeamNewPipe/code_improvements XiangRongLin 2021-03-30 18:12:22 +02:00
  • 657b00ca11 Smaller code improvements TobiGr 2021-03-30 10:10:45 +02:00
  • 8fbd1a2bcf FIx potential NullPointerException TobiGr 2021-03-14 01:06:26 +01:00
  • f2e7c7ebd6 Replace Vector with ArrayList for performance improvements TobiGr 2021-03-14 01:05:58 +01:00
  • 48fd8ca7b3 Remove redundant type declaration TobiGr 2021-03-14 00:58:17 +01:00
  • 22bd16fca3 Make vars private, final and static TobiGr 2021-03-14 00:58:42 +01:00
  • 6a0f6e846a Fix possible bug when language.id field is not present and this the languageCode an empty String. TobiGr 2021-03-14 00:47:22 +01:00
  • b9282bbe94 Remove checks which are always true TobiGr 2021-03-14 00:45:44 +01:00
  • 46eab1ec17 Remove declarations of exceptions which are not thrown from method signatures TobiGr 2021-03-14 00:43:46 +01:00
  • c3e23559d7 Remove unused imports TobiGr 2021-03-14 00:41:56 +01:00
  • e4c40ae6d1 Use List.isEmpty() TobiGr 2021-03-14 00:43:57 +01:00
  • af2183855a
         Merge pull request #591 from TotalCaesar659/update-url-to-https XiangRongLin 2021-03-29 09:33:59 +02:00
  • cf3f54f438 Update URL to HTTPS TotalCaesar659 2021-03-28 22:06:56 +03:00
  • d663be5a78 [Bandcamp] Fix featured albums not showing thumbnails Fynn Godau 2021-03-28 13:12:22 +02:00
  • dbcf61c6f7 [Bandcamp] Load more featured pages Fynn Godau 2021-03-28 12:53:05 +02:00
  • b4dee6d08f
         Merge pull request #306 from B0pol/metadata Stypox 2021-03-27 08:45:47 +01:00
  • e61ceef005 Release 0.21.0 TobiGr 2021-03-25 21:59:15 +01:00
  • e2500fb7cc
         Merge pull request #583 from TeamNewPipe/peertube_playlist Tobi 2021-03-25 21:53:41 +01:00
  • 070a40e181 [YouTube] Mix Playlist - Fix getting name TobiGr 2021-03-25 21:47:10 +01:00
  • b029779217 [media.cc.de] Disable unreliable tests for now TobiGr 2021-03-25 19:44:44 +01:00
  • bbee15474d [PeerTube] Fix playlist extraction TobiGr 2021-03-25 19:10:11 +01:00
  • d4f83a1782
         Merge pull request #575 from TiA4f8R/fix-peertube-test Tobi 2021-03-25 19:14:51 +01:00
  • ae283314da
         Add a comment explaining subscribers count calculation TiA4f8R 2021-03-25 17:54:46 +01:00
  • abb790f465
         Remove println in getSubscriberCount from PeertubeAccountExtractor class TiA4f8R 2021-03-18 19:02:25 +01:00
  • 772de53a66
         Increase the number of subscribers in PeertubeAccountExtractorTest TiA4f8R 2021-03-14 18:41:07 +01:00
  • efe2b964f0
         Extract real subscribers of a Peertube account Apply fix provided in the PR and move all accounts/ strings to a constant, ACCOUNTS. TiA4f8R 2021-03-05 19:12:06 +01:00
  • 12835bfae1
         Merge pull request #551 from FireMasterK/ff-privacy Tobi 2021-03-24 17:58:34 +01:00
  • cae6cea551
         Merge pull request #582 from Stypox/fix-trending Tobi 2021-03-24 10:49:46 +01:00
  • ce7cbbc9a0
         [YouTube] Fix trending getName() Stypox 2021-03-24 09:04:43 +01:00
  • 9009f1e277
         Merge pull request #517 from XiangRongLin/flaky_test XiangRongLin 2021-03-20 18:04:14 +01:00
  • 152221c7fb
         ignore a test with encoding problems bopol 2021-02-15 19:21:28 +01:00
  • 8806fb4e6b
         address reviews bopol 2021-02-12 20:34:46 +01:00
  • c47cc54908
         Extract metadata for YouTube, SoundCloud & MediaCCC bopol 2020-02-09 11:59:23 +01:00
  • f71cfd489c
         Merge pull request #526 from TiA4f8R/snd-hls-workaround Stypox 2021-03-19 10:09:54 +01:00
  • 379d7312fa
         Don't use a regular expression to find the last segment URL and do code improvements Apply suggestions provided in the PR and remove a redundant import. TiA4f8R 2021-03-14 17:53:08 +01:00
  • 0e3e420a25
         Fix tests TiA4f8R 2021-03-13 15:49:59 +01:00
  • d61d9d116d
         Refactor getAudioStreams method of SoundcloudStreamExtractor Split the method into private methods, in order to have a better reading. TiA4f8R 2021-03-13 15:26:05 +01:00
  • a7b15b51e6
         Change t to transcodingJsonObject in SoundcloudStreamExtractor TiA4f8R 2021-03-03 13:03:38 +01:00
  • 0438828e36
         Add a test for the number of audioStreams in CreativeCommonsPlaysWellWithOthers test It should be only two audio streams for track "Plays Well with Others, Ep 2: What Do an Army of Ants and an Online Encyclopedia Have in Common?" by Creative Commons (https://soundcloud.com/wearecc/plays-well-with-others-ep-2-what-do-an-army-of-ants-and-an-online-encyclopedia-have-in-common): - one which is a progressive stream, in MP3 format with a bitrate of 128 kbps - one which is an HLS stream, in OPUS format with a bitrate of 64 kbps. TiA4f8R 2021-03-02 18:20:10 +01:00
  • 3bd08a2880
         Adress requested changes and use final where possible in SoundcloudStreamExtractor This commit moved the HLS parsing task to a separate method, did little performance improvements and used final where possible in the SoundcloudStreamExtractor file. TiA4f8R 2021-02-20 15:59:05 +01:00
  • cbacd3c0a5
         Add a check to don't show MP3 128kbps stream twice and catch IOException when fetching the HLS Manifest If a progressive stream is present in the transcodings, it's unnecessary to show twice an MP3 128kbps stream so if this is the case, the MP3 HLS stream will be not added to the audioStreams, else it will. This commit also catch fetching errors in HLS manifests parsing and don't add the corresponding stream if an error occurs. TiA4f8R 2021-01-25 20:42:08 +01:00
  • 26f1b4e7dc
         Support SoundCloud HLS by using a workaround This commit tries to support SoundCloud HLS streams by parsing M3U manifests, get the last segment URL (in order to get track length) and request a segment URL equals to track's duration so it's a single URL. TiA4f8R 2021-01-23 18:17:35 +01:00
  • def745b801
         Merge pull request #579 from fynngodau/bandcamp-fix-linkhandler Tobi 2021-03-14 12:56:10 +01:00
  • 2e57a8f24f [Bandcamp] Fix link handler acceptance behaviour Fynn Godau 2021-03-14 09:48:22 +01:00
  • 70d9e389b9 [Bandcamp] Add tests for external bandcamp artists TobiGr 2021-03-13 20:51:54 +01:00
  • f9d06252f2 [Bandcamp] Fix tests TobiGr 2021-03-13 17:42:39 +01:00
  • 7e6f464407
         Merge pull request #509 from TiA4f8R/soundcloud-improvements Tobi 2021-03-07 13:51:15 +01:00
  • ac51134aed
         Merge pull request #546 from XiangRongLin/unignore2 Tobi 2021-03-07 13:15:24 +01:00
  • 021da75f24
         Merge pull request #232 from fynngodau/dev Tobi 2021-03-05 21:37:57 +01:00
  • 22fa131922 Merge branch 'dev' into bandcamp TobiGr 2021-03-05 19:45:37 +01:00
  • e55284bb8f
         Code style improvements Use final where possible in YoutubeStreamExtractor and do some other code style improvements TiA4f8R 2021-02-24 17:06:38 +01:00
  • d0a1041afd
         Prevent NullPointerException and use equalsIgnorecase TobiGr 2021-02-24 14:13:12 +01:00
  • 890cbba625
         Update PaidContent exception TiA4f8R 2021-02-24 13:01:27 +01:00
  • da3cfa967d
         Handle age-restricted videos TobiGr 2021-02-24 12:06:19 +01:00
  • 448b68700c
         Use final in exceptions and add AgeRestrictedException AgeRestrictedException will be thrown only if the reason message equals to "Sign in to confirm your age" and if the age limit is 18. TiA4f8R 2021-02-23 19:03:34 +01:00
  • 22e6f33f0a
         Ignore SoundCloudGeoRestrictedTest until HLS stream extraction is added TobiGr 2021-02-22 11:03:44 +01:00
  • 21158744b1
         Add expectedDescriptionIsEmpty() to DefaultStreamExtractorTest TobiGr 2021-02-21 21:19:54 +01:00
  • f15d7837a1
         Fix SoundCloud tests TiA4f8R 2021-02-21 19:18:27 +01:00
  • 4e45aef2b3
         Fix SoundCloud CreativeCommonsPlaysWellWithOthers test TiA4f8R 2021-02-21 18:16:59 +01:00
  • 59d6d3f04e
         Fix YouTube tests TiA4f8R 2021-02-21 17:43:15 +01:00
  • 3925204658
         Add tests and rename SoundcloudGoPlusException to SoundcloudGoPlusContentException TiA4f8R 2021-02-20 14:53:57 +01:00
  • 771bb1a2cb
         Add three new exceptions for unavailable YouTube contents These exceptions are thrown on a test with the error messages text, because YouTube returns only "UNPLAYABLE" status in most error cases. Tests are based with English strings, so changing the lang used by extractor will throw the generic exception (ContentNotAvailableException). TiA4f8R 2021-02-14 15:22:45 +01:00
  • 35325d980d
         Add GeographicRestrictionException and SoundCloudGoPlusException in NewPipe Extractor to be able to display different error messages TiA4f8R 2021-01-10 19:03:20 +01:00
  • cb07ffa1eb Release 0.20.11 TobiGr 2021-03-05 15:35:11 +01:00
  • bc0cda68d1
         Merge pull request #570 from TiA4f8R/fix-yt-channels-playlists Tobi 2021-03-05 15:26:49 +01:00
  • a3c6fceef5
         Merge pull request #573 from B0pol/comments-performance Tobi 2021-03-05 14:46:27 +01:00
  • ff5273b882
         Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/extractors/YoutubeCommentsExtractor.java bopol 2021-03-05 14:39:01 +01:00
  • ec1127dd6a
         Merge pull request #571 from TeamNewPipe/soundcloud_client_id Tobi 2021-03-05 14:21:14 +01:00
  • ed850d0688 [youtube] improve comments extraction performance bopol 2021-03-05 13:33:25 +01:00
  • 440a808b8a Update mocks for channels TobiGr 2021-03-05 13:12:11 +01:00
  • b608587e4d
         Merge pull request #572 from golfinq/fixed-comments Tobi 2021-03-05 11:42:40 +01:00
  • 05213175cd
         minor edit, made variable final golfinq 2021-03-05 02:49:15 -05:00
  • 8bceb57a6c
         formatting fix golfinq 2021-03-05 02:46:06 -05:00
  • ae48bdea4c
         Updated to reflect variable name change golfinq 2021-03-05 02:40:36 -05:00
  • b27efdc9a4
         Remove clickTrackingParams in getNextPage method of YoutubeChannelExtractor TiA4f8R 2021-03-04 22:50:20 +01:00
  • 2b671b15ce [YouTube] Use new continuation API for channels TobiGr 2021-03-04 21:38:23 +01:00
  • 33594d4aff [SoundCloud] Fix client id extraction TobiGr 2021-03-04 21:28:22 +01:00
  • fb2f37d223 [SoundCloud] Update hardcoded client id TobiGr 2021-03-04 21:21:37 +01:00
  • 9256b3b848
         Merge pull request #567 from XiangRongLin/playlist_continuations XiangRongLin 2021-03-04 19:05:32 +01:00
  • 506cc5fbe9 regenerate mocks XiangRongLin 2021-03-04 19:01:58 +01:00
  • 03b00ff1d6 Move toJsonArray and toJsonObject to JsonUtils XiangRongLin 2021-03-04 18:58:51 +01:00
  • 668b080b3a Use dynamic key. FireMasterK 2021-03-04 10:01:13 +05:30
  • 43b46bd408 Use new youtube continuations api for playlists XiangRongLin 2021-03-03 19:49:26 +01:00