CypherpunkSamurai/NewPipeExtractor
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
1769 commits 2 branches 0 tags 95 MiB
Commit graph

1769 commits

This branch
This branch
All branches
Author SHA1 Message Date
TobiGr
ce8cabb9f8 Release NewPipe Exttractor 0.21.10 2021-09-13 13:59:35 +02:00
Tobi
a031289a63
Merge pull request #727 from TeamNewPipe/dependabot/gradle/com.github.spotbugs-spotbugs-annotations-4.4.1 
Bump spotbugs-annotations from 4.4.0 to 4.4.1
 2021-09-10 18:25:27 +02:00
dependabot[bot]
82ae322cb8
Bump spotbugs-annotations from 4.4.0 to 4.4.1 
Bumps [spotbugs-annotations](https://github.com/spotbugs/spotbugs) from 4.4.0 to 4.4.1.
- [Release notes](https://github.com/spotbugs/spotbugs/releases)
- [Changelog](https://github.com/spotbugs/spotbugs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/spotbugs/spotbugs/compare/4.4.0...4.4.1)

---
updated-dependencies:
- dependency-name: com.github.spotbugs:spotbugs-annotations
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-09-10 09:11:27 +00:00
Tobi
62b87552f5
Merge pull request #725 from FireMasterK/related-uploader-avatar 
Extract Channel Avatar in related videos.
 2021-09-03 22:14:28 +02:00
FireMasterK
feb09e9997
Extract Channel Avatar in related videos. 2021-09-04 01:09:40 +05:30
Tobi
f0aa46b008
Merge pull request #724 from FireMasterK/streams-uploader-verified 
Extract uploaderVerified to StreamInfo.
 2021-09-03 18:18:04 +02:00
Tobi
c8037f5e00
Merge pull request #723 from FireMasterK/uploader-avatar 
Extract Uploader's Avatar on YouTube and PeerTube
 2021-09-03 18:13:59 +02:00
FireMasterK
857b2f39e8
Extract uploaderVerified to StreamInfo. 2021-09-03 21:27:58 +05:30
FireMasterK
1db463b55f
Add a default test for the Uploader's Avatar. 2021-09-03 21:05:36 +05:30
Kavin
db6b3b2c29
Extract uploader's avatar in peertube. 
Co-authored-by: Tobi <TobiGr@users.noreply.github.com>
 2021-09-02 16:14:45 +05:30
FireMasterK
a0c1dcc8d8
Remove throws parsing exception. 2021-09-02 16:14:45 +05:30
FireMasterK
0ba03c552c
Improve based on review/feedback. 2021-09-02 00:35:56 +05:30
FireMasterK
b9fad4fcc8
Extract Uploader's Avatar on YouTube. 2021-09-02 00:19:00 +05:30
Stypox
68f1fa994a
Merge pull request #721 from Stypox/yt-csv-import 
[YouTube] Small improvements to subscription import
 2021-08-31 12:02:59 +02:00
TobiGr
b644f1d67b [SoundCloud] Update client id 2021-08-31 07:42:21 +02:00
Stypox
a5e9eeb790
[YouTube] Small improvements to subscription import 2021-08-30 15:45:45 +02:00
Tobi
9570882c73
Merge pull request #712 from magicbrothers/add-eduvid-tubus 
Add invidious instance EduVid Tubus
 2021-08-24 16:07:07 +02:00
Stypox
db6c729678
Merge pull request #709 from talanc/dev 
[YouTube] Support csv and zip subscription import (Google Takeout)
 2021-08-24 15:46:03 +02:00
talanc
94a29fd63f
[YouTube] csv and zip subscription import (Google Takeout) 
csv:
Improved error messages
Exits early if it hasnt found any items in the first few lines

zip:
Now checks all CSV files instead of hard-coded paths

final qualifiers for immutable locals and parameters

Co-authored-by: litetex <40789489+litetex@users.noreply.github.com>
 2021-08-24 15:42:49 +02:00
dependabot[bot]
816bc7137f Bump gson from 2.8.7 to 2.8.8 
Bumps [gson](https://github.com/google/gson) from 2.8.7 to 2.8.8.
- [Release notes](https://github.com/google/gson/releases)
- [Changelog](https://github.com/google/gson/blob/master/CHANGELOG.md)
- [Commits](https://github.com/google/gson/compare/gson-parent-2.8.7...gson-parent-2.8.8)

---
updated-dependencies:
- dependency-name: com.google.code.gson:gson
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-08-23 13:04:10 +02:00
TobiGr
6d487e0dad Bump version to 0.21.9 2021-08-22 19:29:22 +02:00
Tobi
7823dcd99d
Merge pull request #715 from TeamNewPipe/dependabot/gradle/com.github.spotbugs-spotbugs-annotations-4.4.0 
Bump spotbugs-annotations from 4.2.3 to 4.4.0
 2021-08-22 16:41:20 +02:00
dependabot[bot]
d75d54e1c6
Bump spotbugs-annotations from 4.2.3 to 4.4.0 
Bumps [spotbugs-annotations](https://github.com/spotbugs/spotbugs) from 4.2.3 to 4.4.0.
- [Release notes](https://github.com/spotbugs/spotbugs/releases)
- [Changelog](https://github.com/spotbugs/spotbugs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/spotbugs/spotbugs/compare/4.2.3...4.4.0)

---
updated-dependencies:
- dependency-name: com.github.spotbugs:spotbugs-annotations
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-08-22 07:12:54 +00:00
dependabot[bot]
72393995bb
Bump jsoup from 1.13.1 to 1.14.2 (#716) 
Bumps [jsoup](https://github.com/jhy/jsoup) from 1.13.1 to 1.14.2.
- [Release notes](https://github.com/jhy/jsoup/releases)
- [Changelog](https://github.com/jhy/jsoup/blob/master/CHANGES)
- [Commits](https://github.com/jhy/jsoup/compare/jsoup-1.13.1...jsoup-1.14.2)

---
updated-dependencies:
- dependency-name: org.jsoup:jsoup
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-08-22 09:12:14 +02:00
Stypox
d8179dc35a
Merge pull request #713 from TiA4f8R/regexes-yt-signatureciphers 
[YouTube] Consolidate the regular expressions used to find the cipher decryption function
 2021-08-17 18:58:27 +02:00
Tobi
89bab241b9
Merge pull request #717 from XiangRongLin/fix_tests 
Fix failing PeertubeStreamExtractorTest
 2021-08-17 17:48:28 +02:00
XiangRongLin
61acdae4b8 Fix failing PeertubeStreamExtractorTest 2021-08-17 17:06:36 +02:00
FireMasterK
4f86b8ce43
Add verified info to ChannelInfo. (#714) 2021-08-17 13:08:49 +02:00
Stypox
52910ce970
Keep original exception when there is an error message (#710) 2021-08-13 16:13:58 +02:00
TiA4f8R
f8309d546a
[YouTube] Consolidate current regexes of the cipher decryption function 
Also add more regexes
 2021-08-12 18:26:43 +02:00
magicfelix
0e16091ce0
Add invidious instance EduVid Tubus 2021-08-12 10:06:41 +02:00
Tobi
b6f951edb4
Merge pull request #711 from gardenappl/dev 
Fix minor typos in Javadoc
 2021-08-11 18:16:34 +02:00
gardenapple
50bba32239
Fix typos in Javadoc 2021-08-11 12:01:25 +03:00
Tobi
78f2192cbb
Merge pull request #687 from TacoTheDank/gradle7 
Upgrade to Gradle 7.1.1
 2021-08-08 12:38:29 +02:00
TacoTheDank
4a7c1723a6 Use new 'maven-publish' plugin 2021-08-07 17:51:32 -04:00
TacoTheDank
8919a53d95 Update gradle wrapper to 7.1.1 2021-08-07 17:51:18 -04:00
TacoTheDank
cf9e678223 Declare common dependency versions in root gradle 2021-08-07 17:51:09 -04:00
FireMasterK
71b9fd0076
Faster iframe api based player extraction. (#694) 
* Faster iframe api based player extraction.

Uses the IFrame API to reduce the required download to less than 1/50 of the size.

* Remove debug code.

* Extract to two methods.

* Add tests for player URL extraction.

* Add assertThat for tests.
 2021-08-07 12:35:48 +02:00
Tobi
4b147863ec
Merge pull request #705 from FireMasterK/suppored-countries 
Update supported countries list for YouTube.
 2021-08-06 10:14:27 +02:00
FireMasterK
ee32317315
Update supported countries list for YouTube. 2021-08-05 23:48:38 +05:30
Stypox
8ca5e5e364
Merge pull request #702 from TeamNewPipe/master 
This merges master into dev
 2021-08-03 20:52:04 +02:00
Stypox
bb3815d19b
Merge pull request #701 from Stypox/v0.21.8 
V0.21.8
 2021-08-03 20:43:15 +02:00
Stypox
5b38b3ae97
Merge branch 'master' into v0.21.8 2021-08-03 20:38:07 +02:00
Stypox
4b5907e18c
Release version 0.21.8 2021-08-03 20:33:24 +02:00
Stypox
5a88263785
Merge pull request #604 from TiA4f8R/youtubei-api 
[YouTube] Use the new internal API in NewPipe Extractor
 2021-08-03 19:01:14 +02:00
TiA4f8R
79cc5c8d12
Fix tests of YoutubePlaylistExtractorTest and YoutubeMixPlaylistExtractorTest 
Without removing RunWith and SuiteClasses annotations (and the corresponding imports) in YoutubePlaylistExtractorTest and YoutubeMixPlaylistExtractorTest, some mocks cannot be generated, so the CI fails because of the missing mocks. Mocks of workings tests have been also updated.
 2021-08-01 17:28:01 +02:00
TiA4f8R
b74a39c176
Reformat some code and don't use the clickTrackingParams in continuations of YouTube Music search results 
The clickTrackingParams of YouTube Music search results are not needed to get continuations. This commit removes their use, which may improve privacy.
 2021-08-01 17:25:59 +02:00
TiA4f8R
f8197da09e
Update YouTube comments and YouTube playlist continuations mocks 2021-08-01 12:39:05 +02:00
FireMasterK
f3e4c9d689
Use the youtubei API for YouTube comments 
Migrate YouTube comments to the desktop version by using the `next` endpoint of the InnerTube internal API.
With the desktop version, we are able to get the exact like count of YouTube comments (by parsing the accessibility data) (the current extraction is used as a fallback). We are also now able to get if the uploader of the comment is verified or not.

Co-authored-by: TiA4f8R <74829229+TiA4f8R@users.noreply.github.com>
 2021-08-01 12:39:05 +02:00
TiA4f8R
286d839a3b
Update mocks (except mocks of YoutubeCommentsExtractorTest) 2021-08-01 12:39:04 +02:00