Commit Graph
17746 Commits
Author SHA1 Message Date
xarantolus 94255fa0b1 [youtube] More general title extraction
Seems like this attribute is moved every few weeks, so we just extract both and use the one that is present.
2020-08-24 14:30:08 +02:00
xarantolus 7d743516b5 [youtube] Make ytcfg.set config extraction non-fatal
If the markup of the page changes in the future, it might be possible that _FEED_DATA still works, but the other regex does not. SInce it is not necessary for the first page of videos, we make sure the program doesn't exit before extracting them.

TL;DR: Extract the first video page even if there are problems
2020-08-24 14:29:16 +02:00
xarantolus 2ad7b6ace9 Merge branch 'fixYTSearch' of https://github.com/xarantolus/youtube-dl into fixYTSearch 2020-07-31 10:05:19 +02:00
xarantolus a5e386d9fe Fix python2 compatibility and title extraction 2020-07-31 10:05:11 +02:00
PhilippandGitHub d39cf56210 Merge branch 'master' into fixYTSearch 2020-07-30 16:41:07 +02:00
xarantolus 4f37c60bf5 Run formatter 2020-07-30 16:38:56 +02:00
xarantolus c449f70965 [youtube] Fix feed extraction
In order to extract videos from further pages, we need to get various variables that are in an argument to the `ytcfg.set` call in a script on the feed page.
2020-07-30 16:34:48 +02:00
Sergey M․andxarantolus de722d3cd7 release 2020.07.28 2020-07-28 15:34:32 +02:00
Sergey M․andxarantolus f4492c4890 [ChangeLog] Actualize
[ci skip]
2020-07-28 15:34:32 +02:00
Sergey M․andxarantolus 49004a6b59 [youtube] Fix sigfunc name extraction (closes #26134, closes #26135, closes #26136, closes #26137) 2020-07-28 15:34:32 +02:00
MRWITEKandxarantolus 54ffcbb8eb [youtube] Improve description extraction (closes #25937) (#25980) 2020-07-28 15:34:32 +02:00
Sergey M․andxarantolus 9fa728f4e8 [wistia] Restrict embed regex (closes #25969) 2020-07-28 15:34:31 +02:00
Glenn Slaydenandxarantolus bb2c950b8e [youtube] Prevent excess HTTP 301 (#25786) 2020-07-28 15:34:31 +02:00
Sergey M․andxarantolus 255f31b5cb [youtube:playlists] Extend _VALID_URL (closes #25810) 2020-07-28 15:34:31 +02:00
Remita Amineandxarantolus 2bd94127a2 [bellmedia] add support for cp24.com clip URLs(closes #25764) 2020-07-28 15:34:30 +02:00
Sergey M․ a4ed50bb84 release 2020.07.28 2020-07-28 05:13:03 +07:00
Sergey M․ 570611955f [ChangeLog] Actualize
[ci skip]
2020-07-28 05:07:54 +07:00
Sergey M․ e450f6cb63 [youtube] Fix sigfunc name extraction (closes #26134, closes #26135, closes #26136, closes #26137) 2020-07-28 05:05:38 +07:00
MRWITEKandGitHub a115e07594 [youtube] Improve description extraction (closes #25937) (#25980) 2020-07-14 12:01:15 +01:00
Sergey M․ 718393c632 [wistia] Restrict embed regex (closes #25969) 2020-07-11 18:27:19 +07:00
xarantolus 7fa0a67cc1 Remove unused variable 2020-07-10 11:50:50 +02:00
xarantolus c37ca4732b [youtube] Remote download limit 2020-07-10 11:47:13 +02:00
Glenn SlaydenandGitHub 07af16b92e [youtube] Prevent excess HTTP 301 (#25786) 2020-07-01 02:56:16 +07:00
Sergey M․ e942cfd1a7 [youtube:playlists] Extend _VALID_URL (closes #25810) 2020-06-28 10:30:03 +07:00
Remita Amine 9a7e5cb88a [bellmedia] add support for cp24.com clip URLs(closes #25764) 2020-06-23 15:09:13 +01:00
xarantolus 5cbe7563be [youtube] Return to old feed extraction code as it *seems* like that change was reverted
The old code now works again, but it downloads without limit. This is why a limit of 1000 videos is added, it can be overwritten with the `--max-downloads` option - that way, only so many ids will be extracted as videos downloaded
2020-06-23 11:27:02 +02:00
xarantolus 6a3cc89394 [youtube] Make search extraction less dependent on json schema.
If an object looks like a video (it has a `videoId` key), assume that it is.
2020-06-23 08:56:21 +02:00
xarantolus b3fd4b155e run flake8 2020-06-21 09:41:42 +02:00
xarantolus 57f72370c5 [youtube] Fix feed extraction
This moves feed extraction from using html content to json metadata. However, loading additional pages no longer works.

The _extract_video_info function also returns a continuation object that contains some metadata that - together with an API key that is in the page source - might be used to request the next page.
2020-06-21 09:31:04 +02:00
xarantolus 6dad89289c [youtube] Move search URL extraction to appropriate extractor 2020-06-19 21:29:47 +02:00
xarantolus 7a74feda78 [youtube] Fix extraction of search urls (closes ytdl-org/youtube-dl#25696) 2020-06-19 14:57:57 +02:00
Sergey M․ 2391941f28 [brightcove] Improve embed detection (closes #25674) 2020-06-16 17:38:25 +07:00
Sergey M․ 9ff6165a81 release 2020.06.16.1 2020-06-16 06:22:01 +07:00
Sergey M․ 1c748722f9 [ChangeLog] Actualize
[ci skip]
2020-06-16 06:19:23 +07:00
Sergey M․ ee0b726cd7 [youtube] Force old layout (closes #25682, closes #25683, closes #25680, closes #25686) 2020-06-16 06:17:53 +07:00
Sergey M․ dbeafce5d5 [youtube] Fix categories and improve tags extraction 2020-06-16 03:13:39 +07:00
Sergey M․ ed604ce7bc release 2020.06.16 2020-06-16 02:53:33 +07:00
Sergey M․ 7adc7ca547 [ChangeLog] Actualize
[ci skip]
2020-06-16 02:52:09 +07:00
Sergey M․ a6211d237b [youtube] Fix uploader id and uploader URL extraction 2020-06-16 02:43:09 +07:00
Sergey M․ 7b16239a49 [youtube] Improve view count extraction 2020-06-16 02:38:45 +07:00
Sergey M․ 37357d21a9 [youtube] Fix upload date extraction 2020-06-16 02:37:19 +07:00
Sergey M․ b477fc1314 [youtube] Fix thumbnails extraction and remove uploader id extraction warning (closes #25676) 2020-06-16 02:29:04 +07:00
Sergey M․ d84b21b427 [youtube] Fix playlist and feed extraction (closes #25675) 2020-06-16 02:01:12 +07:00
Philipp Hagemeister 48bd042ce7 [facebook] Support single-video ID links
I stumbled upon this at https://www.facebook.com/bwfbadminton/posts/10157127020046316 . No idea how prevalent it is yet.
2020-06-14 13:17:51 +02:00
Sergey M․ 84213ea8d4 [youtube] Extract chapters from JSON (closes #24819) 2020-06-06 04:22:10 +07:00
Sergey M․ 562de77f41 [kaltura] Add support for multiple embeds on a webpage (closes #25523) 2020-06-06 02:14:35 +07:00
Sergey M․ e1723c4bac release 2020.06.06 2020-06-06 01:51:39 +07:00
Sergey M․ 607d204551 [ChangeLog] Actualize
[ci skip]
2020-06-06 01:49:27 +07:00
Sergey M․ a5b6102ea8 [tele5] Bypass geo restriction 2020-06-06 01:45:05 +07:00
Sergey M․ b77888228d [jwplatform] Add support for bypass geo restriction 2020-06-06 01:44:36 +07:00