Commit graph

575 commits

Author SHA1 Message Date
Yen Chi Hsuan
cea364f70c
[extractor/common] Support HTML media elements without child nodes 2016-10-12 01:40:28 +08:00
Yen Chi Hsuan
55642487f0
[nhl] Skip invalid m3u8 formats (closes #10713) 2016-10-11 20:50:52 +08:00
Yen Chi Hsuan
c452e69d3d
[footyroom] Fix extraction and update _TESTS (closes #10810) 2016-10-11 17:46:13 +08:00
Yen Chi Hsuan
f165ca70eb
[abc.net.au:iview] Fix for non-series videos (closes #10895) 2016-10-11 12:53:27 +08:00
Yen Chi Hsuan
71cdcb2331
[hbo] Support episode pages (closes #10892) 2016-10-11 12:30:35 +08:00
Yen Chi Hsuan
65f4c1de3d
[allocine] Fix extraction (closes #10860)
I change the URL of the third test case, because now the original URL
does not contain a video anymore, and there's no easy to get the real
URL from the /film/ one.
2016-10-09 18:58:15 +08:00
Yen Chi Hsuan
b0082629a9
[nextmedia] Support action news (動新聞) on Apple Daily 2016-10-09 18:42:15 +08:00
Yen Chi Hsuan
8204c73352
[Makefile] Fix for GNU make < 4 (closes #9387)
Shell assignment operator in BSD make != is ported to GNU make in
version 4.0, so 3.x doesn't work. I choose to drop BSD make support as
installing GNU make on *BSD systems is easier than installing newer GNU
make.
2016-10-09 18:24:45 +08:00
Sergey M․
dd4291f729
release 2016.10.07 2016-10-07 22:25:30 +07:00
Sergey M․
888f8d6ba4
[ChangeLog] Actualize 2016-10-07 22:23:16 +07:00
Yen Chi Hsuan
38588ab977
[facebook] Fix for new handleServerJS syntax (closes #10846)
According to the dump file in #10846, handleServerJS() now accepts
an optional second argument. It's a string from available dump files.
2016-10-07 20:04:49 +08:00
Yen Chi Hsuan
9dcd6fd3aa
[generic,commonprotocols] Move mms suuport from GenericIE
And use _generic_* helpers in those extractors
2016-10-07 19:24:22 +08:00
Yen Chi Hsuan
3d83a1ae92
[generic] Support direct MMS links (closes #10838) 2016-10-07 17:50:45 +08:00
Yen Chi Hsuan
c0a7b9b348
Revert "[Makefilea] Fix for GNU make < 4"
This reverts commit 831a34caa2.

The reverted commit breaks lazy extractors.
2016-10-07 16:03:34 +08:00
Yen Chi Hsuan
831a34caa2
[Makefilea] Fix for GNU make < 4
Closes #9387

The shell assignment operator != was introduced in GNU make 4.0, or
specifically the commit in [1]. This fix removes such usages and
fallback to a more portable syntax. Tested with:

* GNU make 3.82 on CentOS 7.2
* bmake 20150910 on CentOS 7.2, source RPM from Fedora 24 [2]
* GNU make 4.2.1 on Arch Linux (Arch official package)
* bmake 20160926 on Arch Linux (Arch official package)
* GNU make 3.82 on Arch Linux (Compiled from source)
* Apple bsdmake-24 on macOS Sierra, binary package from Homebrew

Thanks @bdeyal for the feedback of the first tests

[1] http://git.savannah.gnu.org/cgit/make.git/commit/?id=b34438bee83ee906a23b881f257e684a0993b9b1
[2] http://koji.fedoraproject.org/koji/buildinfo?buildID=716769
2016-10-07 03:28:41 +08:00
Sergey M․
6c152ce20f
release 2016.10.02 2016-10-02 15:58:00 +07:00
Sergey M․
26406d33c7
[ChangeLog] Actualize 2016-10-02 15:56:33 +07:00
Yen Chi Hsuan
99ed78c79e
[jwplatform] Support DASH streams 2016-10-02 14:07:49 +08:00
Yen Chi Hsuan
fd15264172
[jwplatform] Support old-style jwplayer playlists 2016-10-02 13:47:06 +08:00
Yen Chi Hsuan
b19e275d99
[__init__] Fix lost xattr if --embed-thumbnail used
Reported at
https://github.com/rg3/youtube-dl/issues/9054#issuecomment-250451823
2016-10-02 02:12:14 +08:00
Yen Chi Hsuan
53a7e3d287
[utils] Support xattr as well as pyxattr
Closes #9054

There are two xattr packages in Python, pyxattr [1] and xattr [2]. They
have different APIs.

In old days pyxattr supports Linux only and xattr supports Linux, Mac,
FreeBSD and Solaris, and pyxattr supports Linux only. Recently pyxattr
adds support for Mac OS X. [3]

An old version of [2] is shipped with Mac OS X. However, some Linux
distributions have pyxattr only, for example PLD-Linux [4] and old Arch
Linux. [5] As a result, supporting both is the way to go.

[1] https://github.com/iustin/pyxattr
[2] https://github.com/xattr/xattr
[3] https://github.com/iustin/pyxattr/pull/9
[4] https://github.com/rg3/youtube-dl/issues/5498
[5] https://git.archlinux.org/svntogit/community.git/commit/?id=427c4c76401e386d865ccddea4fbfdc74df80492
    https://git.archlinux.org/svntogit/community.git/commit/?id=59b40da7b69622a6761d364a8b07909e9cccaa56
    python-xattr is added on 2016/06/29 while pyxattr is there for more
    than 6 years
2016-10-01 20:13:04 +08:00
Yen Chi Hsuan
e295618f9e
[dctp] Fix extraction (closes #10734) 2016-10-01 15:22:48 +08:00
Yen Chi Hsuan
0d72ff9c51
[leeco] Recognize more Le Sports URLs (#10794) 2016-09-29 21:39:35 +08:00
Sergey M․
8f0cf20ab9
release 2016.09.27 2016-09-27 23:09:46 +07:00
Sergey M․
c8f45f763c
[ChangeLog] Remove duplicate 2016-09-27 23:03:00 +07:00
Sergey M․
dd2cffeeec
[ChangeLog] Actualize 2016-09-27 22:43:35 +07:00
Yen Chi Hsuan
d75d9e343e
[einthusan] Fix extraction (closes #10714) 2016-09-27 14:38:41 +08:00
Yen Chi Hsuan
f0bc5a8609
[twitter] Support Periscope embeds (closes #10737)
Also update _TESTS
2016-09-24 20:00:29 +08:00
Yen Chi Hsuan
0711995bca
[openload] Support subtitles (closes #10625) 2016-09-24 14:27:08 +08:00
Yen Chi Hsuan
5968d7d2fe
[extractor/common] Improved support for HTML5 subtitles
Ref: #10625

In a strict sense, <track>s with kind=captions are not subtitles. [1]
openload misuses this attribute, and I guess there will be more
examples, so I add it to common.py.

Also allow extracting information for subtitles-only <video> or <audio>
tags, which is the case of openload.

[1] https://www.w3.org/TR/html5/embedded-content-0.html#attr-track-kind
2016-09-24 14:20:42 +08:00
Sergey M․
e6332059ac
release 2016.09.24 2016-09-24 02:16:47 +07:00
Sergey M․
8eec691e8a
[ChangeLog] Actualize 2016-09-24 02:12:49 +07:00
Yen Chi Hsuan
4ddcb5999d
[openload] Fix extraction (closes #10408, closes #10727)
Thanks to @daniel100097 for providing a working version
2016-09-23 01:47:51 +08:00
Yen Chi Hsuan
e3d6bdc8fc
[ustream] Support HLS streams (closes #10698) 2016-09-23 01:11:13 +08:00
Sergey M․
cb57386873
release 2016.09.19 2016-09-19 02:58:32 +07:00
Sergey M․
59fd8f931d
[ChangeLog] Actualize 2016-09-19 02:57:14 +07:00
Yen Chi Hsuan
d8dbf8707d
[thisav] Improve title extraction (closes #10682)
I didn't add a test case as the one in #10682 looks like a copyrighted
product.
2016-09-18 18:35:38 +08:00
Sergey M․
3acff9423d
release 2016.09.18 2016-09-18 17:16:55 +07:00
Sergey M․
9ca93b99d1
[ChangeLog] Actualize 2016-09-18 17:15:22 +07:00
Yen Chi Hsuan
584d6f3457
[thisav] Recognize jwplayers (closes #10447) 2016-09-17 18:46:43 +08:00
Yen Chi Hsuan
e14c82bd6b
[jwplatform] Use js_to_json to detect more JWPlayers 2016-09-17 18:45:08 +08:00
Sergey M․
f5e008d134
release 2016.09.15 2016-09-15 23:46:11 +07:00
Sergey M․
e6bf3621e7
[ChangeLog] Actualize 2016-09-15 23:31:16 +07:00
Yen Chi Hsuan
961516bfd1
[kwuo:song] Improve error detection (closes #10650) 2016-09-15 00:56:15 +08:00
Yen Chi Hsuan
86d68f906e
[bilibili] Fix extraction for videos without backup_url (#10647) 2016-09-14 22:11:49 +08:00
Yen Chi Hsuan
be45730226
[nbc] Add new extractor for NBC Olympics (#10295, #10361) 2016-09-12 02:55:15 +08:00
Sergey M․
0307d6fba6
release 2016.09.11.1 2016-09-11 23:33:20 +07:00
Sergey M․
d667ab7fad
[ChangeLog] Actualize 2016-09-11 23:30:18 +07:00
Sergey M․
1c81476cbb
release 2016.09.11 2016-09-11 23:20:09 +07:00
Yen Chi Hsuan
6bb05b32a9
[pornhub] Extract categories and tags (closes #10499) 2016-09-11 19:22:51 +08:00
Yen Chi Hsuan
2cdbc06a1f
[foxnews] Support Fox News Articles (closes #10598) 2016-09-11 18:32:45 +08:00
Yen Chi Hsuan
001a5fd3d7
[iwara] Fix extraction after relaunch
Closes #10462, closes #3215
2016-09-11 03:02:00 +08:00
Yen Chi Hsuan
6c3affcb18
[newgrounds] Fix uploader extraction
Closes #10584

Also change test URLs to HTTPS, as proposed by
@stepshal in #10593.

Closes #10593
2016-09-10 20:09:09 +08:00
Sergey M․
b717837190
release 2016.09.08 2016-09-08 23:46:14 +07:00
Sergey M․
2abad67e52
[ChangeLog] Actualize 2016-09-08 23:32:16 +07:00
Yen Chi Hsuan
e78a5428b6
[foxgay] Fix extraction (closes #10480) 2016-09-08 02:01:09 +08:00
Yen Chi Hsuan
b84d311d53
[ChangeLog] Update for #10556 2016-09-08 00:29:55 +08:00
Yen Chi Hsuan
84b91dd4e3
[gamestar] Fix metadata extraction (closes #10479) 2016-09-07 23:07:50 +08:00
Yen Chi Hsuan
973dee491f
[ChangeLog] Update for #10190 2016-09-05 13:54:35 +08:00
Yen Chi Hsuan
b49ad71ce1
[ChangeLog] Update for #10524 2016-09-05 13:38:55 +08:00
Sergey M․
4809490108
release 2016.09.04.1 2016-09-04 20:58:28 +07:00
Sergey M․
8112bfeaba
[ChangeLog] Actualize 2016-09-04 20:57:18 +07:00
Sergey M․
d9606d9b6c
release 2016.09.04 2016-09-04 20:51:48 +07:00
Yen Chi Hsuan
919cf1a62f
[downloader/dash] Abort if the first segment fails
Closes #10497, Closes #10542
2016-09-04 17:32:29 +08:00
Yen Chi Hsuan
b29cd56591
[pornovoisines] Fix extraction (closes #10469) 2016-09-04 17:01:39 +08:00
Yen Chi Hsuan
622638512b
[rottentomatoes] Fix extraction
Closes #10467
2016-09-04 16:25:59 +08:00
Yen Chi Hsuan
45aab4d30b
[youjizz] Fix extraction. The site has moved to HTML5
Closes #10437
2016-09-03 18:37:36 +08:00
Yen Chi Hsuan
cdc783510b
[foxnews:insider] Add new extractor
Closes #10445
2016-09-03 18:16:19 +08:00
Yen Chi Hsuan
cf0efe9636
[fc2:embed] New extractor for Flash player URLs
Closes #10512
2016-09-03 17:25:03 +08:00
Sergey M․
86c3bbbced
release 2016.09.03 2016-09-03 01:46:41 +07:00
Sergey M․
4b3a607658
[ChangeLog] Actualize 2016-09-03 01:45:17 +07:00
Yen Chi Hsuan
4c8ab6fd71
[thvideo] Remove extractor. Website down.
Closes #10464

According to a screenshot in http://tieba.baidu.com/p/4691302183,
thvideo.tv is shut down "temporarily". I see no clues that it will be up
again, so I remove it here.
2016-09-01 17:04:41 +08:00
Yen Chi Hsuan
05d4612947
[movingimage] Adapt to the new domain name and fix extraction
Closes #10466
2016-09-01 16:58:16 +08:00
Sergey M․
4fd350611c
release 2016.08.31 2016-08-31 02:39:39 +07:00
Sergey M․
263fef43de
[ChangeLog] Actualize 2016-08-31 02:37:40 +07:00
Yen Chi Hsuan
04b32c8f96
[bilibili] Fix extraction (closes #10375)
Thanks @gdkchan for the algorithm
2016-08-28 22:06:31 +08:00
Yen Chi Hsuan
40eec6b15c
[openload] Fix extraction (closes #10408)
Thanks to @yokrysty again!
2016-08-28 20:27:52 +08:00
Sergey M․
1198fe14a1
release 2016.08.28 2016-08-28 07:24:08 +07:00
Sergey M․
d7aae610f6
[ChangeLog] Actualize 2016-08-28 07:00:15 +07:00
Yen Chi Hsuan
b54a2da433
[crackle] Fix extraction and update _TESTS (closes #10333) 2016-08-25 22:22:31 +08:00
Yen Chi Hsuan
dc2c37f316
[spankbang] Fix description and uploader (closes #10339) 2016-08-25 20:47:35 +08:00
Yen Chi Hsuan
0c75abbb7b [mtvservices:embedded] Use another endpoint to get feed URL
Closes #10363

In the original mtvservices:embedded test case, config.xml is still used
to get the feed URL. Some other examples, including test_Generic_40
(http://www.vulture.com/2016/06/new-key-peele-sketches-released.html),
and the video mentioned in #10363, use another endpoint to get the feed
URL. The 'index.html' approach works for the original test case, too. So
I didn't keep the old approach.
2016-08-24 23:58:22 +08:00
Sergey M․
d38b27dd9b
release 2016.08.24.1 2016-08-24 10:11:04 +07:00
Sergey M․
6d94cbd2f4
[ChangeLog] Actualize 2016-08-24 10:07:06 +07:00
Sergey M․
c86f51ee38
release 2016.08.24 2016-08-24 01:38:46 +07:00
Sergey M․
6e52bbb413
[ChangeLog] Actualize 2016-08-24 01:36:27 +07:00
Yen Chi Hsuan
18b6216150
[openload] Fix extraction (closes #10408)
Thanks @yokrysty for the algorithm
2016-08-23 21:55:58 +08:00
Sergey M․
6d2679ee26
release 2016.08.22 2016-08-22 04:17:34 +07:00
Sergey M․
afbab5688e
[ChangeLog] Actualize 2016-08-22 04:15:46 +07:00
Yen Chi Hsuan
ad120ae1c5
[extractor/common] Change the default m3u8 protocol in HTML5
Helper functions should have consistent default values
2016-08-22 02:26:07 +08:00
Yen Chi Hsuan
39e1c4f08c
[litv] Support 'promo' URLs (closes #10385) 2016-08-20 00:52:37 +08:00
Yen Chi Hsuan
19f35402c5
[snotr] Fix extraction (closes #10338) 2016-08-20 00:18:22 +08:00
Yen Chi Hsuan
70852b47ca
[utils] Recognize units with full names in parse_filename
Reference: https://en.wikipedia.org/wiki/Template:Quantities_of_bytes
2016-08-20 00:17:26 +08:00
Yen Chi Hsuan
520251c093
[extractor/common] Recognize m3u8 manifests in HTML5 multimedia tags 2016-08-19 23:53:47 +08:00
Yen Chi Hsuan
b82232036a
[n-tv.de] Fix extraction (closes #10331) 2016-08-19 20:39:28 +08:00
Yen Chi Hsuan
e4659b4547
[utils] Correct octal/hexadecimal number detection in js_to_json 2016-08-19 20:37:17 +08:00
Sergey M․
bd1bcd3ea0
release 2016.08.19 2016-08-19 00:15:12 +07:00
Sergey M․
93a63b36f1
[ChangeLog] Actualize 2016-08-19 00:13:24 +07:00
Sergey M․
b3d7dce429
release 2016.08.17 2016-08-17 06:21:21 +07:00
Sergey M․
a44694ab4e
[ChangeLog] Actualize 2016-08-17 06:19:22 +07:00
Yen Chi Hsuan
6d8ec8c3b7
[ChangeLog] Update for CBSLocal and related changes 2016-08-15 13:39:43 +08:00
Yen Chi Hsuan
fafabc0712
Update ChangeLog for #10342
[skip ci]
2016-08-14 02:33:15 +08:00
Sergey M․
73a85620ee
release 2016.08.13 2016-08-13 23:17:11 +07:00
Sergey M․
a560f28c98
[ChangeLog] Actualize 2016-08-13 23:01:35 +07:00
Yen Chi Hsuan
e581224843
[tapely] Remove extractor. It's shut down
Closes #10323
2016-08-13 16:32:07 +08:00
Sergey M․
b0081562d2
release 2016.08.12 2016-08-12 00:22:22 +07:00
Sergey M․
fff37cfd4f
[ChangeLog] Actualize 2016-08-12 00:18:28 +07:00
Yen Chi Hsuan
e5f878c205
[ChangeLog] Add change log for #10269
[skip ci]
2016-08-11 19:13:41 +08:00
Yen Chi Hsuan
69d8eeeec5
[ctsnews] Fix extraction 2016-08-10 11:38:38 +08:00
Yen Chi Hsuan
81c13222c6
[utils] Recognize more formats in unified_timestamp
Used in CtsNews
2016-08-10 11:37:23 +08:00
Sergey M․
b1ce2ba197
release 2016.08.10 2016-08-10 00:20:44 +07:00
Sergey M․
5c8411e968
[ChangeLog] Actualize 2016-08-10 00:18:28 +07:00
Yen Chi Hsuan
b1c6f21c74
[aparat] Fix extraction 2016-08-08 12:59:07 +08:00
Yen Chi Hsuan
b2bd968f4b
[kuwo:singer] Fix extraction 2016-08-07 22:59:34 +08:00
Sergey M․
4a01befb34
release 2016.08.07 2016-08-07 21:12:41 +07:00
Sergey M․
845dfcdc40
[ChangeLog] Actualize 2016-08-07 21:10:48 +07:00
Sergey M․
491c42e690
release 2016.08.06 2016-08-06 01:23:48 +07:00
Sergey M․
7f2339c617
[ChangeLog] Actualize 2016-08-06 01:19:47 +07:00
Yen Chi Hsuan
962250f7ea
[cbslocal] Fix timestamp parsing (closes #10213) 2016-08-05 11:44:50 +08:00
Sergey M․
45408eb075
release 2016.08.01 2016-08-01 22:59:23 +07:00
Sergey M․
eafc66855d
[ChangeLog] Add recent changes 2016-08-01 22:56:01 +07:00
Yen Chi Hsuan
116e7e0d04
[bloomberg] Support BPlayer() players (closes #10187) 2016-07-31 14:47:19 +08:00
Sergey M․
2903137292
release 2016.07.30 2016-07-30 14:45:07 +07:00
Sergey M․
9361f2169c
[ChangeLog] Make extractor improvements' descriptions more concrete 2016-07-30 14:43:28 +07:00
Yen Chi Hsuan
35aa6c538f Add ChangeLog 2016-07-30 12:33:09 +08:00