jirayu_sri/yt-dlp
1
0
Fork 0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2026-07-22 17:37:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
18,880 Commits 1 Branch 139 Tags
41d1cca3289a274bda14c5cca4179861bdad0163
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
pukkandan 41d1cca328 Update to ytdl-commit-a726009 
[blinkx] Remove extractor
https://github.com/ytdl-org/youtube-dl/commit/a7260099873acc6dc7d76cafad2f6b139087afd0
 2021-05-06 21:31:20 +05:30
pukkandanandGitHub 717297545b Fix playlist_index and add playlist_autonumber (#302) 
Now `playlist_index` is always the position of the video in the actual playlist and `playlist_autonumber` is the position of the item in the playlist queue
 2021-05-06 20:56:19 +05:30
pukkandan e8e738406a Add experimental option --check-formats to test the URLs before format selection 2021-05-06 20:50:44 +05:30
pukkandan e625be0d10 Improve output template internal formatting 
* Allow slicing lists/strings using `field.start:end:step`
* A field can also be used as offset like `field1+num+field2`
* A default value can be given using `field|default`
* Capture all format strings and set it to `None` if invalid. This prevents invalid fields from causing errors
 2021-05-06 20:28:58 +05:30
pukkandan 12e73423f1 [plutotv] Fix format extraction for some urls 
* And fallback to the first urls if ad-free urls can't be found
Closes #299
 2021-05-06 20:28:57 +05:30
pukkandan 7700b37f39 [plutotv] Extract subtitles from manifests 2021-05-06 20:28:56 +05:30
pukkandan 848887eb7a [downloader] Fix quiet and to_stderr 2021-05-04 22:38:10 +05:30
pukkandan 3158150cb7 [utils] Add network_exceptions 2021-05-04 22:36:18 +05:30
pukkandan 6ef6bcbd6b [fragment] Ensure the file is closed on error 2021-05-04 22:27:44 +05:30
pukkandan 06425e9621 [blinkx] Minor fix 
Fixes: https://github.com/ytdl-org/youtube-dl/issues/28941
 2021-05-04 22:27:44 +05:30
pukkandan 4d224a3022 [embedthumbnail] Fix bug where jpeg thumbnails were converted again 
Closes #297
 2021-05-04 22:18:40 +05:30
pukkandan f59ae58163 Fix number of digits in %(playlist_index)s 
When used with `--playlist-(items|start|end)`, the number of digits should depend on the last index in the playlist, not number of items
 2021-05-03 22:49:05 +05:30
pukkandan 0d1bb027aa Move option warnings to YoutubeDL 
Previously, these warnings did not obey `--no-warnings` and did not output colors
 2021-05-03 22:49:04 +05:30
pukkandan 4cd0a709aa Fix preload_download_archive writing verbose message to stdout 
* And move it after all deprecated warnings
 2021-05-03 22:49:03 +05:30
pukkandan 1815d1028b [zee5] Fix py2 compatibility 2021-05-03 22:49:03 +05:30
pukkandan eb55bad5a0 [aria2c] Fix whitespace being stripped off 
Closes #276
 2021-05-02 14:03:13 +05:30
pukkandan cc0ec3e161 Do not strip out whitespaces in -o and -P 
Related: https://github.com/yt-dlp/yt-dlp/issues/276#issuecomment-827361652
 2021-05-02 14:03:12 +05:30
pukkandan 80185155a1 [ukcolumn] Add Extractor 
Closes #287
 2021-05-02 13:57:50 +05:30
pukkandan c755f1901f [CBS] Improve _VALID_URL to support movies 
Closes #290
Tested by: BeeMuffins
 2021-05-01 21:32:14 +05:30
pukkandan 68b91dc905 [youtube] Add oembed to reserved names 2021-05-01 21:24:31 +05:30
pukkandan 88f06afc0c [rmcdecouverte] Improve _VALID_URL 
Closes #291
 2021-05-01 21:24:31 +05:30
pukkandan d2558234cf [utils] Escape URL while sanitizing 
Closes #263

While this fixes the issue in question, it does not try to address the root-cause of the problem
Refer: 915f911e36, f5fa042c82
 2021-04-29 05:20:50 +05:30
pukkandan f5fa042c82 Revert "[utils] Encode URLs in YoutubeDLCookieProcessor" 
This reverts commit 915f911e36.

When the request is copied, `unredirected_hdrs` are not copied, which causes issues elsewhere
Reopens #263
 2021-04-29 05:20:18 +05:30
pukkandan 07e4a40a9a [crackle] Improve extraction (See desc) 
Closes #282

* Refactor authorization as an extension to `_download_json`
* Better error messages and warnings
* Respect `--ignore-no-formats-error`
* Extract subtitles from manifests
* Try with crackle's geo-location service if all hard-coded countries fail
 2021-04-29 05:20:16 +05:30
pukkandan e28f1c0ae8 [cleanup] Fix linter and some typos 
* Also remove inconsistent use of `"` in setup.py
 2021-04-28 19:59:40 +05:30
pukkandan ef39f8600a [curiositystream] Fix collections 
Closes #277

* A bug with authentication was reported in <https://github.com/yt-dlp/yt-dlp/issues/277#issuecomment-828254721> but cannot be tested without an account
 2021-04-28 19:29:33 +05:30
pukkandan 2291dbce2a [niconico] Fix HLS formats 
Closes #171

* The structure of the API JSON was changed
* Smile Video seems to be no longer available. So remove the warning
* Move ping to downloader
* Change heartbeat interval to 40sec
* Remove unnecessary API headers

Authored-by: CXwudi, tsukumijima, nao20010128nao, pukkandan
Tested by: tsukumijima
 2021-04-28 19:18:29 +05:30
pukkandan 58f197b76c Revert "[core] be able to hand over id and title using url_result" 
This reverts commit 0704d2224b.

This is a commit from `youtube-dlc`. It is not clear what the original purpose of this was. It seems to be a way for extractors to pass `title` and `id` through when the entry is processed by another extractor

* But `title` can already be passed through using `url_transparent`
* `id` is never supposed to be passed through since it could cause issues with archiving
 2021-04-28 19:18:06 +05:30
pukkandan 895b0931e5 [youtube:tab] Detect playlists inside community posts 2021-04-28 19:18:06 +05:30
pukkandan 1ad047d0f7 [nebula] Move to nebula.app 
Closes #272
Tested by: Lamieur
 2021-04-28 19:18:06 +05:30
pukkandanandGitHub be6202f12b Subtitle extraction from streaming media manifests #247 
Authored by fstirlitz
Modified from: https://github.com/ytdl-org/youtube-dl/pull/6144

Closes: #73
Fixes:
https://github.com/ytdl-org/youtube-dl/issues/6106
https://github.com/ytdl-org/youtube-dl/issues/14977
https://github.com/ytdl-org/youtube-dl/issues/21438
https://github.com/ytdl-org/youtube-dl/issues/23609
https://github.com/ytdl-org/youtube-dl/issues/28132

Might also fix (untested):
https://github.com/ytdl-org/youtube-dl/issues/15424
https://github.com/ytdl-org/youtube-dl/issues/18267
https://github.com/ytdl-org/youtube-dl/issues/23899
https://github.com/ytdl-org/youtube-dl/issues/24375
https://github.com/ytdl-org/youtube-dl/issues/24595
https://github.com/ytdl-org/youtube-dl/issues/27899

Related:
https://github.com/ytdl-org/youtube-dl/issues/22379
https://github.com/ytdl-org/youtube-dl/pull/24517
https://github.com/ytdl-org/youtube-dl/pull/24886
https://github.com/ytdl-org/youtube-dl/pull/27215

Notes:
* The functions `extractor.common._extract_..._formats` are still kept for compatibility
* Only some extractors have currently been moved to using `_extract_..._formats_and_subtitles`
* Direct subtitle manifests (without a master) are not supported and are wrongly identified as containing video formats
* AES support is untested
* The fragmented TTML subtitles extracted from DASH/ISM are valid, but are unsupported by `ffmpeg` and most video players
    * Their XML fragments can be dumped using `ffmpeg -i in.mp4 -f data -map 0 -c copy out.ttml`.
        Once the unnecessary headers are stripped out of this, it becomes a valid self-contained ttml file
    * The ttml subs downloaded from DASH manifests can also be directly opened with <https://github.com/SubtitleEdit>
* Fragmented WebVTT files extracted from DASH/ISM are also unsupported by most tools
    * Unlike the ttml files, the XML fragments of these cannot be dumped using `ffmpeg`
    * The webtt subs extracted from DASH can be parsed by <https://github.com/gpac/gpac>
    * But validity of the those extracted from ISM are untested
 2021-04-28 19:02:43 +05:30
pukkandan 598d185db1 Fix case sensitivity of format selector 
Bug introduced in f8d4ad9ab0
 2021-04-26 10:56:56 +05:30
pukkandan b982cbdd0e [limelight] Obey allow_unplayable_formats 2021-04-26 10:56:55 +05:30
pukkandan 6a04a74e8b [FormatSort] Fix for when some formats have quality and others don't 2021-04-26 10:56:54 +05:30
pukkandan 88728713c8 Py2 compatibility for FileNotFoundError 2021-04-26 10:56:53 +05:30
pukkandan 915f911e36 [utils] Encode URLs in YoutubeDLCookieProcessor 
Closes #263
 2021-04-24 19:20:07 +05:30
pukkandan cf9d6cfb0c [tubi] Raise "no video formats" error when video url is empty 
Related: #266
 2021-04-24 17:52:33 +05:30
pukkandan bbed5763f1 [francetvinfo] Improve video id extraction 
Closes #261
 2021-04-23 00:01:09 +05:30
pukkandan ca0b91b39e [version] update :ci skip all 2021-04-22 17:30:36 +05:30
pukkandan 0cf0571560 Release 2021.04.22 2021-04-22 16:58:28 +05:30
pukkandan e58c22a0f6 [documentation] Fix typos 2021-04-22 16:54:44 +05:30
pukkandan e4bdd3377d [ci] Disable fail-fast 2021-04-22 16:54:41 +05:30
pukkandan 0b2e9d2c30 [lazy_extractor] Do not load plugins 2021-04-22 16:54:08 +05:30
pukkandan 1bdae7d312 Update to ytdl-commit-7e8b3f9 
[youtube] Remove unused code
https://github.com/ytdl-org/youtube-dl/commit/7e8b3f9439ebefb3a3a4e5da9c0bd2b595976438
 2021-04-22 16:54:07 +05:30
pukkandan 6efb071135 [BilibiliChannel] Fix pagination 
Closes #222

https://github.com/nao20010128nao/ytdl-patched/commit/ccca21d7f57f1330a205f07d369e31883ba006c2
Coauthored by: nao20010128nao, pukkandan
 2021-04-22 04:19:33 +05:30
pukkandan f4536226c1 [documentation] Clarify which deprecated options still work 2021-04-22 04:19:33 +05:30
pukkandan a439a3a45c Improve output template (see desc) 
* Objects can be traversed like `%(field.key1.key2)s`
* A number can be added to the field as `%(field+n)s`
* Deprecates `--autonumber-start`
 2021-04-22 04:19:33 +05:30
pukkandan 26e2805c3f Add option --skip-playlist-after-errors 
Allows to skip the rest of a playlist after a given number of errors are encountered
 2021-04-22 02:16:31 +05:30
pukkandan 3b4775e021 [go] Fix _VALID_URL 
Closes #255
 2021-04-21 15:43:53 +05:30
pukkandan ab406a1c0e [mildom] Warn user of proxy 2021-04-21 15:43:22 +05:30
pukkandan a3faeb7de4 [MetadataFromField] Improve regex and add tests 2021-04-21 11:12:04 +05:30
pukkandan 8c54a3051d [youtube] Bugfix in _extract_ytcfg 2021-04-21 10:37:24 +05:30
pukkandan c32b0aab8a Improve --sub-langs (see desc) 
* Treat `--sub-langs` entries as regex
* `all` can be used to refer to all the subtitles
* the language code can be prefixed with `-` to exclude it
* Deprecates `--all-subs`
Closes #253
 2021-04-20 02:58:03 +05:30
pukkandan 3097d9e512 [mildom:user:vod] Download only necessary amount of pages 2021-04-19 11:41:49 +05:30
pukkandan c1df120eda [mildom:vod] Remove proxy 
* Proxy is needed only for live videos
 2021-04-19 11:41:40 +05:30
pukkandan 2cff495997 [mildom] Change proxy 
Related: #251
Closes #252
 2021-04-19 11:41:33 +05:30
pukkandan d0491a1ebe [twitcasting] Fix extractor 
* `Origin: https://twitcasting.tv` must be sent when requesting the webpage. Otherwise the extracted `m3u8` will always give a `502`
* Fix regex for when `data-movie-playlist` is a dict containing the needed list
* media initialization is fully supported; so change downloader to native

Closes #220
 2021-04-18 17:57:46 +05:30
pukkandan 201c145953 Update to ytdl-commit-9f6c03 
[cbsnews] Fix extraction for python <3.6
https://github.com/ytdl-org/youtube-dl/commit/9f6c03a00602eb1119e43a522cf50682f6d6a6dd
 2021-04-17 08:40:31 +05:30
pukkandan 5d34200268 [youtube:tab] Reload with unavailable videos for all playlists 
If the unavailable video is in a later page, the warning and button are not shown in the initial webpage
So we force all playlists' initial page to reload with the correct params
 2021-04-17 08:40:30 +05:30
pukkandan b7da73eb19 Add option --ignore-no-formats-error 
* Ignores the "no video format" and similar errors
* Experimental - Some extractors may still throw these errors
 2021-04-17 08:40:30 +05:30
pukkandan 6a39ee13f7 Fix inconsistent use of report_warning 2021-04-17 04:16:41 +05:30
pukkandan 33245766ab [downloader] Fix ffmpeg selection for m3u8_native 2021-04-17 04:15:56 +05:30
pukkandan a7191c6f57 Fix some linter and typos 2021-04-16 05:31:47 +05:30
pukkandan c6ce815461 [Exec] Ensure backward compatibility when the command contains % 2021-04-16 05:19:44 +05:30
pukkandan 46fff7105e [youtube] Ignore invalid stretch ratio 
Closes #244
 2021-04-14 15:22:17 +05:30
pukkandan 72e1fe969f [downloader] Fix downloader selection for m3u8 
Bug introduced by: 52a8a1e1b9 and a31953b0e6
 2021-04-14 12:25:42 +05:30
pukkandan 921b76cab8 Ensure mergeall selects best format when multistreams are disabled 2021-04-13 10:53:25 +05:30
pukkandan a31953b0e6 [downloader] Fix external downloader selection for m3u8 
Closes #239
 2021-04-12 22:34:11 +05:30
pukkandan 54670cf084 [version] update 
:ci skip all
 2021-04-12 03:30:55 +05:30
pukkandan a0f30f194a Release 2021.04.11 2021-04-12 03:20:07 +05:30
pukkandan b31fdeedfd [documentation] Improvements 2021-04-12 02:36:06 +05:30
pukkandan 8fa43c73d8 Add option --convert-thumbnails 
Closes: https://github.com/yt-dlp/yt-dlp/issues/99 https://github.com/yt-dlp/yt-dlp/issues/102
 2021-04-12 02:32:29 +05:30
pukkandan 56d868dbb7 Allow running some postprocessors before actual download 2021-04-12 02:12:46 +05:30
pukkandan 1988fab7e3 [youtube] Fix thumbnail URL 
Closes: https://github.com/yt-dlp/yt-dlp/issues/233 https://github.com/ytdl-org/youtube-dl/issues/28023
 2021-04-11 06:06:13 +05:30
pukkandan 9de3ea3126 Pass any field to --exec using similar syntax to output template 
Related: https://github.com/ytdl-org/youtube-dl/issues/28642
 2021-04-11 06:06:12 +05:30
pukkandan e01d6aa435 Fix mergeall when requested formats are unavailable 2021-04-10 22:29:58 +05:30
pukkandan f7ad71607d Update to ytdl-commit-4fb25ff 
[maoritv] Add new extractor
https://github.com/ytdl-org/youtube-dl/commit/4fb25ff5a3be5206bb72e5c4046715b1529fb2c7

Except:
[vimeo] improve extraction https://github.com/ytdl-org/youtube-dl/commit/3ae9c0f410b1d4f63e8bada67dd62a8d2852be32
[youtube:tab] Pass innertube context... https://github.com/ytdl-org/youtube-dl/commit/1b0a13f33cfb3644cc718d35951ea85bb1905459
 2021-04-10 22:19:54 +05:30
pukkandan 68379de561 [downloaders] Fix API access 
Bug introduced by: 52a8a1e1b9
 2021-04-10 21:15:32 +05:30
pukkandan d9aa233295 Deprecate more options 
* `--all-formats` = `-f all`
* `--include-ads` is not implemented
 2021-04-10 20:58:36 +05:30
pukkandan f37468c41f Fix default of dynamic_mpd 2021-04-10 20:57:53 +05:30
pukkandan 52a8a1e1b9 Option to choose different downloader for different protocols 
* Renamed `--external-downloader-args` to `--downloader-args`
* Added `native` as an option for the downloader
* Use similar syntax to `--downloader-args` etc. Eg: `--downloader dash:native --downloader aria2c`
* Deprecated `--hls-prefer-native` and `--hls-prefer-ffmpeg` since the same can now be done with `--downloader "m3u8:native"` and `m3u8:ffmpeg` respectively
* Split `frag_urls` protocol into `m3u8_frag_urls` and `dash_frag_urls`
* Standardize shortening of protocol names with `downloader.shorten_protocol_name`
 2021-04-10 20:57:52 +05:30
pukkandan d818eb7473 Improve argument parsing for -P, -o, -S 
* `-P "subtitle,thumbnail:PATH"` is now possible. Similarly for `-o`
* `-S "fps,br" -S "res,codec"` is now interpreted as `-S res,codec,fps,br`. Previously, `-S fps,br` was ignored in this case.
 2021-04-10 20:57:27 +05:30
pukkandan f8d4ad9ab0 Format selector mergeall to download and merge all formats 2021-04-10 20:57:27 +05:30
pukkandan 3ffc7c89b0 [youtube] Fix _extract_alerts 
* Sometimes one warning is split between multiple runs
* Also simplified code
 2021-04-10 20:57:27 +05:30
pukkandan 7e60c06925 [bilibili] Fix uploader 
Related: https://github.com/yt-dlp/yt-dlp/issues/222
 2021-04-08 13:22:04 +05:30
pukkandan 73d4343e39 Fix some m3u8 not obeying --allow-unplayable-formats 2021-04-04 17:53:26 +05:30
pukkandan 57d104424f [version] update 
:ci skip all
 2021-04-04 03:57:29 +05:30
pukkandan 02aabd45d0 Release 2021.04.03 2021-04-04 03:55:41 +05:30
pukkandan 39ed931e53 Update to ytdl-commit-654b4f4 
[youtube] prioritize information from YoutubeIE for playlist entries
https://github.com/ytdl-org/youtube-dl/commit/654b4f4ff2718f38b3182c1188c5d569c14cc70a
 2021-04-04 03:49:04 +05:30
pukkandan 73cd218f5a [documentation] Improve --parse-metadata documentation 2021-04-03 14:07:29 +05:30
pukkandan 84601bb72b Ability to set a specific field in the file's metadata 
Eg: `--parse-metadata "description:(?s)(?P<meta_comment>.+)"`
sets the "comment" field using `description`
 2021-04-03 14:07:28 +05:30
pukkandan 54df8fc5b2 [ViewSource] Add extractor to handle view-source: 2021-04-03 14:07:27 +05:30
pukkandanandGitHub 0481374e1d [DiscoveryPlus] Add discoveryplus.in (#203) 
Closes #201
 2021-04-03 13:18:40 +05:30
pukkandan eff635394a Ability to select nth best format 
Eg: -f `bv*.2`

* Also cleaned up the related format selection code
 2021-04-02 22:16:52 +05:30
pukkandan df0c81513e [generic] Detect Invidious' link element (Closes #195) 2021-04-01 17:13:35 +05:30
pukkandan 3f6a90eb63 [ard:mediathek] Fix video id extraction (Closes #202) 2021-04-01 16:17:15 +05:30
pukkandan b050d210df Fix some typos and linter 2021-04-01 14:16:10 +05:30
pukkandan f4e4be19f0 [sponskrub] Run before embedding thumbnail 
Workaround for https://github.com/faissaloo/SponSkrub/issues/29
Closes https://github.com/yt-dlp/yt-dlp/issues/204
 2021-04-01 14:13:24 +05:30
pukkandan cce889b900 Update to ytdl v2021-04-01 
https://github.com/ytdl-org/youtube-dl/commit/14f29f087e6097feb46bdb84878924bc410a57eb

Closes #205
 2021-04-01 13:59:22 +05:30
pukkandan b23b9eefd9 [version] update 2021-03-25 04:44:22 +05:30