Commit Graph

560 Commits

Author SHA1 Message Date
Yen Chi Hsuan 9c14fe9681
[gaskrank] Minor change and update ChangeLog after #11685 2017-02-06 00:25:28 +08:00
Yen Chi Hsuan 019f4c0371
[bandcamp] Fix extraction for incomplete albums
Closes #11727
2017-02-05 22:47:04 +08:00
Yen Chi Hsuan caf0f5f8b7
[iwara] Fix extraction (closes #11781) 2017-02-05 21:48:13 +08:00
Yen Chi Hsuan e4e50f60b1
[googledrive] Fix extraction on Python 3.6
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
2017-02-05 21:41:08 +08:00
Sergey M․ a713a86755
release 2017.02.04.1 2017-02-04 23:26:39 +07:00
Sergey M․ 7bccd5fc8a
[ChangeLog] Actualize 2017-02-04 23:23:38 +07:00
Sergey M․ 3144eccf55
[ChangeLog] Actualize 2017-02-04 23:22:28 +07:00
Sergey M․ 31487eb974
release 2017.02.04 2017-02-04 22:57:48 +07:00
Yen Chi Hsuan daac118bf4
[ChangeLog] Update after #11901 2017-02-03 18:56:40 +08:00
Yen Chi Hsuan d7f9242e30
[ChangeLog] Update after #11565 2017-02-03 12:13:24 +08:00
Yen Chi Hsuan a22b2fd19b
[youtube] Fix ytsearch* when cookies are provided
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
2017-02-03 01:28:24 +08:00
Yen Chi Hsuan bd8f48c78b
[bilibili] Support new Bangumi URLs (closes #11845)
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in #10190:

http://bangumi.bilibili.com/anime/v/40062
2017-02-02 21:51:31 +08:00
Jaime Marquínez Ferrándiz 020c5df52d [elpais] Fix extraction for some URLs (closes #11765) 2017-02-01 23:48:34 +01:00
Sergey M․ 5069594993
release 2017.02.01 2017-02-01 03:20:09 +07:00
Sergey M․ b996b88092
[ChangeLog] Actualize 2017-02-01 23:29:59 +07:00
Yen Chi Hsuan 000f207944
[prosiebensat1] Update ChangeLog 2017-02-01 23:16:35 +08:00
Sergey M․ d7e215b42d
release 2017.01.31 2017-01-31 22:24:45 +07:00
Sergey M․ 3a528ffd89
[ChangeLog] Actualize 2017-01-31 22:22:42 +07:00
Sergey M․ 4d2fdb07c4
release 2017.01.29 2017-01-29 13:21:42 +07:00
Sergey M․ fe323a4800
[ChangeLog] Actualize 2017-01-29 21:21:26 +07:00
Sergey M․ d41ed6d243
release 2017.01.28 2017-01-28 00:33:55 +07:00
Sergey M․ 815d2a36d8
[ChangeLog] Actualize 2017-01-28 00:03:21 +07:00
Sergey M․ 2417d41535
release 2017.01.25 2017-01-25 23:36:03 +07:00
Sergey M․ 2c302cf66b
[ChangeLog] Actualize 2017-01-25 23:33:46 +07:00
Sergey M․ c3a65c3de0
release 2017.01.24 2017-01-24 02:58:37 +07:00
Sergey M․ ee4c091ce5
[ChangeLog] Actualize 2017-01-24 02:56:19 +07:00
Yen Chi Hsuan bc35ed3fb6
[nextmedia] Add support for NextTV (壹電視) 2017-01-23 23:38:31 +08:00
Sergey M․ 9d5b29c881
release 2017.01.22 2017-01-22 18:59:04 +07:00
Sergey M․ 6c031a35f3
[ChangeLog] Actualize 2017-01-22 18:57:15 +07:00
Yen Chi Hsuan 7c20b7484c
[nextmedia] Support redirected URLs 2017-01-22 02:06:34 +08:00
Yen Chi Hsuan 4447fb2332
[cspan] Support Ustream embedded videos
Closes #11547
2017-01-20 22:27:13 +08:00
Sergey M․ 1560baacc6
release 2017.01.18 2017-01-18 23:10:00 +07:00
Sergey M․ 460f61fac4
[ChangeLog] Actualize 2017-01-18 23:06:46 +07:00
Sergey M․ c1c2fe2045
release 2017.01.16 2017-01-16 23:44:04 +07:00
Sergey M․ ddd53c392e
[ChangeLog] Actualize 2017-01-16 23:42:04 +07:00
Yen Chi Hsuan 16e2c8f771
[brightcove] Recognize another player ID
Closes #11688
2017-01-16 00:06:52 +08:00
Yen Chi Hsuan dcae7b3fdc
[niconico] Allow login via cookies
Some codes are borrowed from #7968, which is by @jlhg

Closes #7968
2017-01-15 22:51:54 +08:00
Sergey M․ 5d4c7daa49
release 2017.01.14 2017-01-14 07:31:07 +07:00
Sergey M․ 0b94510cd0
[ChangeLog] Actualize 2017-01-14 07:30:32 +07:00
Sergey M․ 31ea2ad89d
release 2017.01.10 2017-01-10 21:29:20 +07:00
Sergey M․ 2184d44361
[ChangeLog] Actualize 2017-01-10 21:27:17 +07:00
Philipp Hagemeister bfedb2cc5a small fix to Changelog format 2017-01-09 11:26:01 +01:00
Philipp Hagemeister 8084951b7f [egghead:course] Add support for egghead.io course playlists
Individual egghead videos are already handled by the generic/Wistia extractors.
2017-01-09 11:24:40 +01:00
Sergey M․ e7ea724cb9
release 2017.01.08 2017-01-08 20:58:43 +07:00
Sergey M․ e60166020b
[ChangeLog] Actualize 2017-01-08 20:56:38 +07:00
Yen Chi Hsuan 1219201143
[ChangeLog] Update after #11581
[ci skip]
2017-01-06 01:07:30 +08:00
Yen Chi Hsuan 24d8a75982
[discoverygo] Fix JSON data parsing
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
2017-01-05 18:50:34 +08:00
Sergey M․ 7232bb299b
release 2017.01.05 2017-01-05 04:10:15 +07:00
Sergey M․ 2b12e34076
[ChangeLog] Actualize 2017-01-05 04:07:32 +07:00
Sergey M․ 2021b650dd
release 2017.01.02 2017-01-02 23:55:04 +07:00
Sergey M․ b890caaf21
[ChangeLog] Actualize 2017-01-02 23:54:29 +07:00
Sergey M․ dc48a35404
release 2016.12.31 2016-12-31 23:58:41 +07:00
Sergey M․ 1ea0b727c4
[ChangeLog] Actualize 2016-12-31 23:53:30 +07:00
Sergey M․ 5e77c0b58e
release 2016.12.22 2016-12-22 22:52:54 +07:00
Remita Amine ab3091feda
[ChangeLog] Actualize 2016-12-22 22:51:51 +07:00
Sergey M․ 90352a8041
release 2016.12.20 2016-12-20 22:39:39 +07:00
Sergey M․ 1f6a79b0af
[ChangeLog] Actualize 2016-12-20 22:37:06 +07:00
Yen Chi Hsuan 8ab7e6c4cc
[kaltura] Improve widget ID extraction (closes #11480) 2016-12-20 18:45:52 +08:00
Sergey M․ f73d7d5074
release 2016.12.18 2016-12-18 19:50:33 +07:00
Sergey M․ 52a1d48d9f
[ChangeLog] Actualize 2016-12-18 19:48:59 +07:00
Sergey M․ 38be3bc568
release 2016.12.15 2016-12-15 21:16:55 +07:00
Sergey M․ d7ef47bffd
[ChangeLog] Actualize 2016-12-15 21:15:45 +07:00
Yen Chi Hsuan 5c32a5be95 [openload] Recognize oload.tv URLs (#10408) 2016-12-15 17:51:26 +08:00
Yen Chi Hsuan 30918999f5
[facebook] Recognize .onion URLs (closes #11443) 2016-12-15 01:04:49 +08:00
Sergey M․ 3c1e9dc4ec
release 2016.12.12 2016-12-12 01:44:50 +07:00
Sergey M․ 62faf9b55e
[ChangeLog] Actualize 2016-12-12 01:41:08 +07:00
Sergey M․ 18ece70c4d
release 2016.12.09 2016-12-09 02:46:18 +07:00
Sergey M․ 9ed3495eae
[ChangeLog] Actualize 2016-12-09 02:41:49 +07:00
Yen Chi Hsuan 6c20a0bb99
[openload] Fix extraction (closes #10408) 2016-12-09 02:15:16 +08:00
Yen Chi Hsuan d17bfe4095
[thisoldhouse] Recognize /tv-episode/ URLs and update _TESTS
Closes #11271
2016-12-01 14:56:52 +08:00
Sergey M․ 73ec479c7d
release 2016.12.01 2016-12-01 00:15:12 +07:00
Sergey M․ f150530f4d
[ChangeLog] Actualize 2016-12-01 00:13:06 +07:00
Sergey M․ 2b380fc299
release 2016.11.27 2016-11-27 20:05:32 +07:00
Sergey M․ 294d4926d7
[ChangeLog] Actualize 2016-11-27 20:04:03 +07:00
Yen Chi Hsuan 44444f0d3b
[cbslocal] Support newyork.cbslocal.com
Closes #11285
2016-11-24 20:32:17 +08:00
Sergey M․ 3b5daf0736
release 2016.11.22 2016-11-22 22:32:16 +07:00
Sergey M․ c8f56741dd
[ChangeLog] Actualize 2016-11-22 22:29:37 +07:00
Yen Chi Hsuan 1d6ae5628f
[amcnetworks] Recognize more BBC America URLs
Closes #11263
2016-11-22 20:40:57 +08:00
Yen Chi Hsuan 303b38fa84
[ChangeLog] Update for #9028 2016-11-20 00:06:44 +08:00
Sergey M․ 08ec95a6db
[ChangeLog] Actualize 2016-11-19 03:10:20 +07:00
Sergey M․ b25459b88a
release 2016.11.18 2016-11-18 00:25:24 +07:00
Sergey M․ 5f75c4a4ad
[ChangeLog] Actualize 2016-11-18 00:19:55 +07:00
Yen Chi Hsuan d76767c90e
[ChangeLog] Update after #11122 landed 2016-11-16 20:47:15 +08:00
Sergey M․ 6b4dfa2819
release 2016.11.14.1 2016-11-14 02:48:15 +07:00
Sergey M․ 9f60134a9d
[ChangeLog] Actualize 2016-11-14 02:46:12 +07:00
Sergey M․ b3d4bd05f9
release 2016.11.14 2016-11-14 02:39:50 +07:00
Sergey M․ dbffd00ba9
[ChangeLog] Actualize 2016-11-14 02:37:21 +07:00
Yen Chi Hsuan 3eaaa8abac [audioboom] Recognize /posts/ URLs (closes #11149) 2016-11-10 14:52:34 +08:00
Sergey M․ db3367f43e
release 2016.11.08.1 2016-11-08 22:30:53 +07:00
Sergey M․ 6590925c27
[ChangeLog] Actualize 2016-11-08 22:29:16 +07:00
Sergey M․ c58e07a7aa
release 2016.11.08 2016-11-08 22:11:21 +07:00
Sergey M․ f700afa24c
[ChangeLog] Actualize 2016-11-08 22:09:03 +07:00
Yen Chi Hsuan 5d47b38cf5 [tmz:article] Fix extraction (closes #11052) 2016-11-08 21:53:41 +08:00
DarkZeros cb882540e8 [mitele] Fix extraction after website redesign (fixes #10824) 2016-11-07 11:13:59 +01:00
Sergey M․ b30e4c2754
release 2016.11.04 2016-11-04 22:07:54 +07:00
Sergey M․ 09ffe34b00
[ChangeLog] Actualize 2016-11-04 21:59:42 +07:00
Sergey M․ cc99a77ac1
[extractor/generic] Add support for ISM manifests 2016-11-02 03:01:13 +07:00
Sergey M․ 8956d6608a
release 2016.11.02 2016-11-02 02:39:36 +07:00
Sergey M․ a18aeee803
[ChangeLog] Actualize 2016-11-02 02:33:17 +07:00
Sergey M․ e70a5e6566
release 2016.10.30 2016-10-30 18:24:49 +07:00
Sergey M․ 3bf55be466
[ChangeLog] Actualize 2016-10-30 18:19:29 +07:00
Yen Chi Hsuan d9ee2e5cf6
[facebook] Remove SWF params so that 1080P are detected
Closes #11073

In the provided link, SWF params give up to 720P, and VideoConfig
gives 1080P for both best and bestvideo. I guess all Facebook videos
supports HTML5 now, so I remove the old detection for SWF params
2016-10-30 18:20:55 +08:00
Yen Chi Hsuan e1a0b3b81c
[imgur] Recognize /r/ URLs (closes #11071) 2016-10-30 17:02:03 +08:00
Yen Chi Hsuan f02700a1fa
[openload] Fix extraction (#10408)
Thanks @TwelveCharzz again for studying openload codes
2016-10-29 18:00:30 +08:00
Yen Chi Hsuan a5a8877f9c
[adultswim] Fix extraction (closes #10979) 2016-10-27 02:16:48 +08:00
Yen Chi Hsuan ec8705117a
[hornbunny] Fix extraction (#10981) 2016-10-27 00:10:51 +08:00
Sergey M․ 88839f4380
release 2016.10.26 2016-10-26 19:55:09 +07:00
Sergey M․ 83e9374464
[ChangeLog] Actualize 2016-10-26 19:53:44 +07:00
Sergey M․ 94e08950e3
release 2016.10.25 2016-10-25 03:19:36 +07:00
Sergey M․ ee824a8d06
[ChangeLog] Actualize
[ci skip]
2016-10-25 02:51:07 +07:00
Sergey M․ b0b28b8241
[ChangeLog] Actualize 2016-10-25 01:53:41 +07:00
Yen Chi Hsuan 5ace137bf4
[dotsub] Support vimeo embed (closes #10964) 2016-10-24 15:13:33 +08:00
Yen Chi Hsuan 9dde0e04e6
[litv] Fix extraction (#11006) 2016-10-23 23:23:40 +08:00
Yen Chi Hsuan 5378f8ce0d
[ChangeLog] Update for #10996 2016-10-22 13:08:56 +08:00
Sergey M․ 69c2d42bd7
release 2016.10.21.1 2016-10-21 04:57:28 +07:00
Sergey M․ 062e2769a3
[ChangeLog] Actualize 2016-10-21 04:53:26 +07:00
Sergey M․ 9ce0077485
release 2016.10.21 2016-10-21 03:08:42 +07:00
Sergey M․ 0ebb86bd18
[ChangeLog] Actualize 2016-10-21 03:07:03 +07:00
Yen Chi Hsuan 19e447150d
[ChangeLog] Update for #10971 2016-10-20 04:19:33 +08:00
Sergey M․ 05b7996cab
[ChangeLog] Fix typos and add unreleased version header 2016-10-20 00:00:53 +07:00
Sergey M․ c8802041dd
release 2016.10.19 2016-10-19 23:55:16 +07:00
Sergey M․ c7911009a0
[ChangeLog] Actualize 2016-10-19 23:53:37 +07:00
Sergey M․ bbd7706898
release 2016.10.16 2016-10-16 03:23:05 +07:00
Sergey M․ 112740e79f
[ChangeLog] Actualize 2016-10-16 03:09:27 +07:00
Yen Chi Hsuan f605242bfc
[ChangeLog] Update for #10917 2016-10-15 14:55:36 +08:00
Yen Chi Hsuan 88ebefc054
[cmt] Fix mgid extraction (closes #10813)
The example in #10813 requires TV provider authentication in Firefox,
while youtube-dl can download it directly with an US proxy.

I'm not sure whether the mgid fix is cmt-specific or it applies to all
mtv-based sites. I keep it in cmt.py until similar patterns are found in
other websites.
2016-10-15 14:27:15 +08:00
Yen Chi Hsuan 2ecbd2ad6f
[chirbit:profile] Fix extraction 2016-10-15 00:01:46 +08:00
Yen Chi Hsuan 62a0b86e4f
[carambatv] Fix extraction
The video requested in #9815 now has videomore embeds.
2016-10-14 23:43:18 +08:00
Yen Chi Hsuan e2004ccaf7
[canalplus] Fix video_id and update _TESTS
Some tests are gone, and some redirect to different videos
2016-10-14 20:26:12 +08:00
Yen Chi Hsuan a5f8473145
[cbsinteractive] Fix extraction for cnet.com 2016-10-14 18:20:01 +08:00
Yen Chi Hsuan 580d411931
[parliamentliveuk] Recognize lower case URLs
Closes #10912

Seems parliamentliveuk matches URLs case-insentive. For example this URL
also works:
http://parliamentlive.tv/EvEnt/Index/3F24936f-130f-40bf-9a5d-b3d6479da6a4
2016-10-14 00:44:28 +08:00
Sergey M․ 5c4bfd4da5
release 2016.10.12 2016-10-12 21:30:05 +07:00
Sergey M․ 7104ae799c
[ChangeLog] Actualize 2016-10-12 21:25:04 +07:00
Yen Chi Hsuan 9feb1c9731
[dailymotion] Fix extraction and update _TESTS
Closes #10901

Seems all videos use player V5 syntax now
2016-10-12 21:45:49 +08:00
Yen Chi Hsuan a093cfc78b
[vimeo:review] Fix extraction (#10900)
Now Vimeo Review videos uses React. Thanks @davekaro for analyzing the
problem!
2016-10-12 01:48:06 +08:00
Yen Chi Hsuan cea364f70c
[extractor/common] Support HTML media elements without child nodes 2016-10-12 01:40:28 +08:00
Yen Chi Hsuan 55642487f0
[nhl] Skip invalid m3u8 formats (closes #10713) 2016-10-11 20:50:52 +08:00
Yen Chi Hsuan c452e69d3d
[footyroom] Fix extraction and update _TESTS (closes #10810) 2016-10-11 17:46:13 +08:00
Yen Chi Hsuan f165ca70eb
[abc.net.au:iview] Fix for non-series videos (closes #10895) 2016-10-11 12:53:27 +08:00
Yen Chi Hsuan 71cdcb2331
[hbo] Support episode pages (closes #10892) 2016-10-11 12:30:35 +08:00
Yen Chi Hsuan 65f4c1de3d
[allocine] Fix extraction (closes #10860)
I change the URL of the third test case, because now the original URL
does not contain a video anymore, and there's no easy to get the real
URL from the /film/ one.
2016-10-09 18:58:15 +08:00
Yen Chi Hsuan b0082629a9
[nextmedia] Support action news (動新聞) on Apple Daily 2016-10-09 18:42:15 +08:00
Yen Chi Hsuan 8204c73352
[Makefile] Fix for GNU make < 4 (closes #9387)
Shell assignment operator in BSD make != is ported to GNU make in
version 4.0, so 3.x doesn't work. I choose to drop BSD make support as
installing GNU make on *BSD systems is easier than installing newer GNU
make.
2016-10-09 18:24:45 +08:00
Sergey M․ dd4291f729
release 2016.10.07 2016-10-07 22:25:30 +07:00
Sergey M․ 888f8d6ba4
[ChangeLog] Actualize 2016-10-07 22:23:16 +07:00
Yen Chi Hsuan 38588ab977
[facebook] Fix for new handleServerJS syntax (closes #10846)
According to the dump file in #10846, handleServerJS() now accepts
an optional second argument. It's a string from available dump files.
2016-10-07 20:04:49 +08:00
Yen Chi Hsuan 9dcd6fd3aa
[generic,commonprotocols] Move mms suuport from GenericIE
And use _generic_* helpers in those extractors
2016-10-07 19:24:22 +08:00
Yen Chi Hsuan 3d83a1ae92
[generic] Support direct MMS links (closes #10838) 2016-10-07 17:50:45 +08:00
Yen Chi Hsuan c0a7b9b348
Revert "[Makefilea] Fix for GNU make < 4"
This reverts commit 831a34caa2.

The reverted commit breaks lazy extractors.
2016-10-07 16:03:34 +08:00
Yen Chi Hsuan 831a34caa2
[Makefilea] Fix for GNU make < 4
Closes #9387

The shell assignment operator != was introduced in GNU make 4.0, or
specifically the commit in [1]. This fix removes such usages and
fallback to a more portable syntax. Tested with:

* GNU make 3.82 on CentOS 7.2
* bmake 20150910 on CentOS 7.2, source RPM from Fedora 24 [2]
* GNU make 4.2.1 on Arch Linux (Arch official package)
* bmake 20160926 on Arch Linux (Arch official package)
* GNU make 3.82 on Arch Linux (Compiled from source)
* Apple bsdmake-24 on macOS Sierra, binary package from Homebrew

Thanks @bdeyal for the feedback of the first tests

[1] http://git.savannah.gnu.org/cgit/make.git/commit/?id=b34438bee83ee906a23b881f257e684a0993b9b1
[2] http://koji.fedoraproject.org/koji/buildinfo?buildID=716769
2016-10-07 03:28:41 +08:00
Sergey M․ 6c152ce20f
release 2016.10.02 2016-10-02 15:58:00 +07:00
Sergey M․ 26406d33c7
[ChangeLog] Actualize 2016-10-02 15:56:33 +07:00
Yen Chi Hsuan 99ed78c79e
[jwplatform] Support DASH streams 2016-10-02 14:07:49 +08:00
Yen Chi Hsuan fd15264172
[jwplatform] Support old-style jwplayer playlists 2016-10-02 13:47:06 +08:00
Yen Chi Hsuan b19e275d99
[__init__] Fix lost xattr if --embed-thumbnail used
Reported at
https://github.com/rg3/youtube-dl/issues/9054#issuecomment-250451823
2016-10-02 02:12:14 +08:00
Yen Chi Hsuan 53a7e3d287
[utils] Support xattr as well as pyxattr
Closes #9054

There are two xattr packages in Python, pyxattr [1] and xattr [2]. They
have different APIs.

In old days pyxattr supports Linux only and xattr supports Linux, Mac,
FreeBSD and Solaris, and pyxattr supports Linux only. Recently pyxattr
adds support for Mac OS X. [3]

An old version of [2] is shipped with Mac OS X. However, some Linux
distributions have pyxattr only, for example PLD-Linux [4] and old Arch
Linux. [5] As a result, supporting both is the way to go.

[1] https://github.com/iustin/pyxattr
[2] https://github.com/xattr/xattr
[3] https://github.com/iustin/pyxattr/pull/9
[4] https://github.com/rg3/youtube-dl/issues/5498
[5] https://git.archlinux.org/svntogit/community.git/commit/?id=427c4c76401e386d865ccddea4fbfdc74df80492
    https://git.archlinux.org/svntogit/community.git/commit/?id=59b40da7b69622a6761d364a8b07909e9cccaa56
    python-xattr is added on 2016/06/29 while pyxattr is there for more
    than 6 years
2016-10-01 20:13:04 +08:00
Yen Chi Hsuan e295618f9e
[dctp] Fix extraction (closes #10734) 2016-10-01 15:22:48 +08:00
Yen Chi Hsuan 0d72ff9c51
[leeco] Recognize more Le Sports URLs (#10794) 2016-09-29 21:39:35 +08:00
Sergey M․ 8f0cf20ab9
release 2016.09.27 2016-09-27 23:09:46 +07:00
Sergey M․ c8f45f763c
[ChangeLog] Remove duplicate 2016-09-27 23:03:00 +07:00
Sergey M․ dd2cffeeec
[ChangeLog] Actualize 2016-09-27 22:43:35 +07:00
Yen Chi Hsuan d75d9e343e
[einthusan] Fix extraction (closes #10714) 2016-09-27 14:38:41 +08:00
Yen Chi Hsuan f0bc5a8609
[twitter] Support Periscope embeds (closes #10737)
Also update _TESTS
2016-09-24 20:00:29 +08:00
Yen Chi Hsuan 0711995bca
[openload] Support subtitles (closes #10625) 2016-09-24 14:27:08 +08:00
Yen Chi Hsuan 5968d7d2fe
[extractor/common] Improved support for HTML5 subtitles
Ref: #10625

In a strict sense, <track>s with kind=captions are not subtitles. [1]
openload misuses this attribute, and I guess there will be more
examples, so I add it to common.py.

Also allow extracting information for subtitles-only <video> or <audio>
tags, which is the case of openload.

[1] https://www.w3.org/TR/html5/embedded-content-0.html#attr-track-kind
2016-09-24 14:20:42 +08:00
Sergey M․ e6332059ac
release 2016.09.24 2016-09-24 02:16:47 +07:00
Sergey M․ 8eec691e8a
[ChangeLog] Actualize 2016-09-24 02:12:49 +07:00
Yen Chi Hsuan 4ddcb5999d
[openload] Fix extraction (closes #10408, closes #10727)
Thanks to @daniel100097 for providing a working version
2016-09-23 01:47:51 +08:00
Yen Chi Hsuan e3d6bdc8fc
[ustream] Support HLS streams (closes #10698) 2016-09-23 01:11:13 +08:00
Sergey M․ cb57386873
release 2016.09.19 2016-09-19 02:58:32 +07:00
Sergey M․ 59fd8f931d
[ChangeLog] Actualize 2016-09-19 02:57:14 +07:00
Yen Chi Hsuan d8dbf8707d
[thisav] Improve title extraction (closes #10682)
I didn't add a test case as the one in #10682 looks like a copyrighted
product.
2016-09-18 18:35:38 +08:00
Sergey M․ 3acff9423d
release 2016.09.18 2016-09-18 17:16:55 +07:00
Sergey M․ 9ca93b99d1
[ChangeLog] Actualize 2016-09-18 17:15:22 +07:00
Yen Chi Hsuan 584d6f3457
[thisav] Recognize jwplayers (closes #10447) 2016-09-17 18:46:43 +08:00
Yen Chi Hsuan e14c82bd6b
[jwplatform] Use js_to_json to detect more JWPlayers 2016-09-17 18:45:08 +08:00
Sergey M․ f5e008d134
release 2016.09.15 2016-09-15 23:46:11 +07:00
Sergey M․ e6bf3621e7
[ChangeLog] Actualize 2016-09-15 23:31:16 +07:00
Yen Chi Hsuan 961516bfd1
[kwuo:song] Improve error detection (closes #10650) 2016-09-15 00:56:15 +08:00
Yen Chi Hsuan 86d68f906e
[bilibili] Fix extraction for videos without backup_url (#10647) 2016-09-14 22:11:49 +08:00
Yen Chi Hsuan be45730226
[nbc] Add new extractor for NBC Olympics (#10295, #10361) 2016-09-12 02:55:15 +08:00
Sergey M․ 0307d6fba6
release 2016.09.11.1 2016-09-11 23:33:20 +07:00
Sergey M․ d667ab7fad
[ChangeLog] Actualize 2016-09-11 23:30:18 +07:00
Sergey M․ 1c81476cbb
release 2016.09.11 2016-09-11 23:20:09 +07:00
Yen Chi Hsuan 6bb05b32a9
[pornhub] Extract categories and tags (closes #10499) 2016-09-11 19:22:51 +08:00
Yen Chi Hsuan 2cdbc06a1f
[foxnews] Support Fox News Articles (closes #10598) 2016-09-11 18:32:45 +08:00
Yen Chi Hsuan 001a5fd3d7
[iwara] Fix extraction after relaunch
Closes #10462, closes #3215
2016-09-11 03:02:00 +08:00
Yen Chi Hsuan 6c3affcb18
[newgrounds] Fix uploader extraction
Closes #10584

Also change test URLs to HTTPS, as proposed by
@stepshal in #10593.

Closes #10593
2016-09-10 20:09:09 +08:00
Sergey M․ b717837190
release 2016.09.08 2016-09-08 23:46:14 +07:00
Sergey M․ 2abad67e52
[ChangeLog] Actualize 2016-09-08 23:32:16 +07:00
Yen Chi Hsuan e78a5428b6
[foxgay] Fix extraction (closes #10480) 2016-09-08 02:01:09 +08:00
Yen Chi Hsuan b84d311d53
[ChangeLog] Update for #10556 2016-09-08 00:29:55 +08:00
Yen Chi Hsuan 84b91dd4e3
[gamestar] Fix metadata extraction (closes #10479) 2016-09-07 23:07:50 +08:00
Yen Chi Hsuan 973dee491f
[ChangeLog] Update for #10190 2016-09-05 13:54:35 +08:00
Yen Chi Hsuan b49ad71ce1
[ChangeLog] Update for #10524 2016-09-05 13:38:55 +08:00
Sergey M․ 4809490108
release 2016.09.04.1 2016-09-04 20:58:28 +07:00
Sergey M․ 8112bfeaba
[ChangeLog] Actualize 2016-09-04 20:57:18 +07:00
Sergey M․ d9606d9b6c
release 2016.09.04 2016-09-04 20:51:48 +07:00
Yen Chi Hsuan 919cf1a62f
[downloader/dash] Abort if the first segment fails
Closes #10497, Closes #10542
2016-09-04 17:32:29 +08:00
Yen Chi Hsuan b29cd56591
[pornovoisines] Fix extraction (closes #10469) 2016-09-04 17:01:39 +08:00
Yen Chi Hsuan 622638512b
[rottentomatoes] Fix extraction
Closes #10467
2016-09-04 16:25:59 +08:00
Yen Chi Hsuan 45aab4d30b
[youjizz] Fix extraction. The site has moved to HTML5
Closes #10437
2016-09-03 18:37:36 +08:00
Yen Chi Hsuan cdc783510b
[foxnews:insider] Add new extractor
Closes #10445
2016-09-03 18:16:19 +08:00
Yen Chi Hsuan cf0efe9636
[fc2:embed] New extractor for Flash player URLs
Closes #10512
2016-09-03 17:25:03 +08:00
Sergey M․ 86c3bbbced
release 2016.09.03 2016-09-03 01:46:41 +07:00
Sergey M․ 4b3a607658
[ChangeLog] Actualize 2016-09-03 01:45:17 +07:00
Yen Chi Hsuan 4c8ab6fd71
[thvideo] Remove extractor. Website down.
Closes #10464

According to a screenshot in http://tieba.baidu.com/p/4691302183,
thvideo.tv is shut down "temporarily". I see no clues that it will be up
again, so I remove it here.
2016-09-01 17:04:41 +08:00
Yen Chi Hsuan 05d4612947
[movingimage] Adapt to the new domain name and fix extraction
Closes #10466
2016-09-01 16:58:16 +08:00
Sergey M․ 4fd350611c
release 2016.08.31 2016-08-31 02:39:39 +07:00
Sergey M․ 263fef43de
[ChangeLog] Actualize 2016-08-31 02:37:40 +07:00
Yen Chi Hsuan 04b32c8f96
[bilibili] Fix extraction (closes #10375)
Thanks @gdkchan for the algorithm
2016-08-28 22:06:31 +08:00
Yen Chi Hsuan 40eec6b15c
[openload] Fix extraction (closes #10408)
Thanks to @yokrysty again!
2016-08-28 20:27:52 +08:00
Sergey M․ 1198fe14a1
release 2016.08.28 2016-08-28 07:24:08 +07:00
Sergey M․ d7aae610f6
[ChangeLog] Actualize 2016-08-28 07:00:15 +07:00
Yen Chi Hsuan b54a2da433
[crackle] Fix extraction and update _TESTS (closes #10333) 2016-08-25 22:22:31 +08:00
Yen Chi Hsuan dc2c37f316
[spankbang] Fix description and uploader (closes #10339) 2016-08-25 20:47:35 +08:00
Yen Chi Hsuan 0c75abbb7b [mtvservices:embedded] Use another endpoint to get feed URL
Closes #10363

In the original mtvservices:embedded test case, config.xml is still used
to get the feed URL. Some other examples, including test_Generic_40
(http://www.vulture.com/2016/06/new-key-peele-sketches-released.html),
and the video mentioned in #10363, use another endpoint to get the feed
URL. The 'index.html' approach works for the original test case, too. So
I didn't keep the old approach.
2016-08-24 23:58:22 +08:00
Sergey M․ d38b27dd9b
release 2016.08.24.1 2016-08-24 10:11:04 +07:00
Sergey M․ 6d94cbd2f4
[ChangeLog] Actualize 2016-08-24 10:07:06 +07:00
Sergey M․ c86f51ee38
release 2016.08.24 2016-08-24 01:38:46 +07:00
Sergey M․ 6e52bbb413
[ChangeLog] Actualize 2016-08-24 01:36:27 +07:00
Yen Chi Hsuan 18b6216150
[openload] Fix extraction (closes #10408)
Thanks @yokrysty for the algorithm
2016-08-23 21:55:58 +08:00
Sergey M․ 6d2679ee26
release 2016.08.22 2016-08-22 04:17:34 +07:00
Sergey M․ afbab5688e
[ChangeLog] Actualize 2016-08-22 04:15:46 +07:00
Yen Chi Hsuan ad120ae1c5
[extractor/common] Change the default m3u8 protocol in HTML5
Helper functions should have consistent default values
2016-08-22 02:26:07 +08:00
Yen Chi Hsuan 39e1c4f08c
[litv] Support 'promo' URLs (closes #10385) 2016-08-20 00:52:37 +08:00
Yen Chi Hsuan 19f35402c5
[snotr] Fix extraction (closes #10338) 2016-08-20 00:18:22 +08:00
Yen Chi Hsuan 70852b47ca
[utils] Recognize units with full names in parse_filename
Reference: https://en.wikipedia.org/wiki/Template:Quantities_of_bytes
2016-08-20 00:17:26 +08:00
Yen Chi Hsuan 520251c093
[extractor/common] Recognize m3u8 manifests in HTML5 multimedia tags 2016-08-19 23:53:47 +08:00
Yen Chi Hsuan b82232036a
[n-tv.de] Fix extraction (closes #10331) 2016-08-19 20:39:28 +08:00
Yen Chi Hsuan e4659b4547
[utils] Correct octal/hexadecimal number detection in js_to_json 2016-08-19 20:37:17 +08:00
Sergey M․ bd1bcd3ea0
release 2016.08.19 2016-08-19 00:15:12 +07:00
Sergey M․ 93a63b36f1
[ChangeLog] Actualize 2016-08-19 00:13:24 +07:00
Sergey M․ b3d7dce429
release 2016.08.17 2016-08-17 06:21:21 +07:00
Sergey M․ a44694ab4e
[ChangeLog] Actualize 2016-08-17 06:19:22 +07:00
Yen Chi Hsuan 6d8ec8c3b7
[ChangeLog] Update for CBSLocal and related changes 2016-08-15 13:39:43 +08:00
Yen Chi Hsuan fafabc0712
Update ChangeLog for #10342
[skip ci]
2016-08-14 02:33:15 +08:00
Sergey M․ 73a85620ee
release 2016.08.13 2016-08-13 23:17:11 +07:00
Sergey M․ a560f28c98
[ChangeLog] Actualize 2016-08-13 23:01:35 +07:00
Yen Chi Hsuan e581224843
[tapely] Remove extractor. It's shut down
Closes #10323
2016-08-13 16:32:07 +08:00
Sergey M․ b0081562d2
release 2016.08.12 2016-08-12 00:22:22 +07:00
Sergey M․ fff37cfd4f
[ChangeLog] Actualize 2016-08-12 00:18:28 +07:00
Yen Chi Hsuan e5f878c205
[ChangeLog] Add change log for #10269
[skip ci]
2016-08-11 19:13:41 +08:00
Yen Chi Hsuan 69d8eeeec5
[ctsnews] Fix extraction 2016-08-10 11:38:38 +08:00
Yen Chi Hsuan 81c13222c6
[utils] Recognize more formats in unified_timestamp
Used in CtsNews
2016-08-10 11:37:23 +08:00
Sergey M․ b1ce2ba197
release 2016.08.10 2016-08-10 00:20:44 +07:00
Sergey M․ 5c8411e968
[ChangeLog] Actualize 2016-08-10 00:18:28 +07:00
Yen Chi Hsuan b1c6f21c74
[aparat] Fix extraction 2016-08-08 12:59:07 +08:00
Yen Chi Hsuan b2bd968f4b
[kuwo:singer] Fix extraction 2016-08-07 22:59:34 +08:00
Sergey M․ 4a01befb34
release 2016.08.07 2016-08-07 21:12:41 +07:00
Sergey M․ 845dfcdc40
[ChangeLog] Actualize 2016-08-07 21:10:48 +07:00
Sergey M․ 491c42e690
release 2016.08.06 2016-08-06 01:23:48 +07:00
Sergey M․ 7f2339c617
[ChangeLog] Actualize 2016-08-06 01:19:47 +07:00
Yen Chi Hsuan 962250f7ea
[cbslocal] Fix timestamp parsing (closes #10213) 2016-08-05 11:44:50 +08:00
Sergey M․ 45408eb075
release 2016.08.01 2016-08-01 22:59:23 +07:00
Sergey M․ eafc66855d
[ChangeLog] Add recent changes 2016-08-01 22:56:01 +07:00
Yen Chi Hsuan 116e7e0d04
[bloomberg] Support BPlayer() players (closes #10187) 2016-07-31 14:47:19 +08:00
Sergey M․ 2903137292
release 2016.07.30 2016-07-30 14:45:07 +07:00
Sergey M․ 9361f2169c
[ChangeLog] Make extractor improvements' descriptions more concrete 2016-07-30 14:43:28 +07:00
Yen Chi Hsuan 35aa6c538f Add ChangeLog 2016-07-30 12:33:09 +08:00