67adeb7bab
[cleanup] Misc ( #11216 )
...
- Add Python 3.13 to CI, finalize 3.13 support
- Remove Python 3.8 from CI in preparation for removing 3.8 support
- Document that PyPy3.8 and PyPy3.9 are no longer supported
- Usual documentation fixes and code cleanup
Closes #8248 , Closes #11146 , Closes #11149 , Closes #11211
Authored by: Grub4K, grqz, DTrombett, KarboniteKream, bashonly, mikkovedru, seproDev
Co-authored-by: N/Ame <173015200+grqz@users.noreply.github.com >
Co-authored-by: DTrombett <d@trombett.org >
Co-authored-by: =?UTF-8?q?Klemen=20Ko=C5=A1ir?= <klemen.kosir@kream.io >
Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com >
Co-authored-by: Mikko Vedru <mikko.vedru@gmail.com >
Co-authored-by: sepro <sepro@sepr0.com >
2024-10-22 04:50:35 +00:00
Simon Sawicki and GitHub
d710a6ca7c
Add extractor helpers ( #10653 )
...
Authored by: Grub4K
2024-10-13 05:14:32 +02:00
Simon Sawicki and GitHub
85b87c991a
[utils] sanitize_path: Reimplement function ( #11198 )
...
Authored by: Grub4K
2024-10-13 04:10:12 +02:00
Simon Sawicki and GitHub
16eb28026a
[test] Allow running tests explicitly ( #11203 )
...
Authored by: Grub4K
2024-10-13 04:01:26 +02:00
Simon Sawicki and GitHub
1a830394a2
[build] make_lazy_extractors: Force running without plugins ( #11205 )
...
Authored by: Grub4K
2024-10-13 03:50:31 +02:00
Simon Sawicki and GitHub
edfd095b19
[ie/generic] Impersonate browser by default ( #11206 )
...
Also adds `impersonate` extractor arg
Authored by: Grub4K
2024-10-13 03:42:43 +02:00
Simon Sawicki and GitHub
c5f0f58efd
[cookies] Fix compatibility for Python <=3.9 in traceback
...
Authored by: Grub4K
2024-10-13 03:38:09 +02:00
Simon Sawicki and GitHub
e59c82a74c
[cookies] Fix cookie load error handling ( #11140 )
...
Authored by: Grub4K
2024-10-01 02:13:48 +02:00
Simon Sawicki and GitHub
b31b81d85f
[ci] Rerun failed tests ( #11143 )
2024-10-01 00:33:17 +02:00
Simon Sawicki and GitHub
b6200bdcf3
[ci] Add comment sanitization workflow ( #10915 )
...
Co-authored-by: bashonly <bashonly@protonmail.com >
Authored by: bashonly, Grub4K
2024-09-05 20:06:15 +02:00
Simon Sawicki and GitHub
d9cbced493
[core] Support auto-tty and no_color-tty for --color ( #10453 )
...
Authored by: Grub4K
2024-07-16 21:51:56 +02:00
Simon Sawicki and GitHub
66ce3d76d8
[core] Fix noprogress if test=True with --quiet and --verbose ( #10454 )
...
Authored by: Grub4K
2024-07-16 21:48:45 +02:00
Simon Sawicki and GitHub
6c056ea7ae
[jsinterp] Implement Function.prototype resolving for call and apply ( #10392 )
...
Authored by: Grub4K
2024-07-08 23:46:26 +02:00
Simon Sawicki and GitHub
0d174e8bed
[ie/yle_areena] Fix subtitle extraction ( #10379 )
...
Authored by: Grub4K
2024-07-07 21:21:00 +02:00
Simon Sawicki
5ce582448e
[core] Disallow unsafe extensions (CVE-2024-38519)
...
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-79w7-vh3h-8g4j
Authored by: Grub4K
2024-07-02 00:58:40 +02:00
Simon Sawicki and GitHub
f2a4ea1794
[pp/embedthumbnail] Fix postprocessor ( #10248 )
...
* [compat] Improve `imghdr.what` detection
* [pp/embedthumbnail] Improve imghdr fail message
* [pp/embedthumbnail] Fix AtomicParsley error handling
Authored by: Grub4K
2024-06-27 16:12:19 +02:00
5c019f6328
[misc] Cleanup ( #9765 )
...
Closes #9763
Authored by: bashonly, seproDev, Grub4K
Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com >
Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com >
2024-05-26 21:37:49 +00:00
Simon Sawicki and GitHub
a4da9db87b
Update to ytdl-commit-a08f2b7 ( #10012 )
...
[ie] Rework JWPlayer extraction
- https://github.com/ytdl-org/youtube-dl/commit/f66372403fd9e1661199fea100ba2600fa9697b2
[ie/gbnews] Add extractor
- https://github.com/ytdl-org/youtube-dl/commit/70f230f9cf28e948662599b6257cb7d1262870e3
[ie/caffeinetv] Add extractor
- https://github.com/ytdl-org/youtube-dl/commit/40bd5c18153afe765caa6726302ee1dd8a9a2ce6
[ie/youporn] Improve extraction
- https://github.com/ytdl-org/youtube-dl/commit/0b2ce3685e02ea1a3ccee1026572e081b8f6ac83
[ie/youporn] Add playlist extractors
- https://github.com/ytdl-org/youtube-dl/commit/668332b9733023ca2e927eeb2208725022248af8
Closes #9188 , Closes #9523
Authored by: Grub4K, bashonly
2024-05-26 21:09:53 +00:00
e897bd8292
[misc] Add hatch, ruff, pre-commit and improve dev docs ( #7409 )
...
Authored by: bashonly, seproDev, Grub4K
Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com >
Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com >
2024-05-26 21:27:21 +02:00
Simon Sawicki and GitHub
3f7999533e
[rh:requests] Patch support for requests 2.32.2+ ( #9992 )
...
Authored by: Grub4K
2024-05-22 16:22:25 +02:00
ac817bc83e
[build] Migrate linux_exe to static musl builds ( #9811 )
...
Authored by: Grub4K, bashonly
Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com >
2024-04-28 22:19:25 +00:00
Simon Sawicki
7e26bd53f9
[core/windows] Fix tests for sys.executable with spaces (Fix for 64766459e3)
...
Authored by: Grub4K
2024-04-28 15:47:55 +02:00
Simon Sawicki and GitHub
64766459e3
[core/windows] Improve shell quoting and tests ( #9802 )
...
Authored by: Grub4K
2024-04-27 10:37:26 +02:00
Simon Sawicki and GitHub
3ee1194288
[ie] Make _search_nextjs_data non fatal ( #8937 )
...
Authored by: Grub4K
2024-04-21 13:40:38 +02:00
Simon Sawicki
ff07792676
[core] Prevent RCE when using --exec with %q (CVE-2024-22423)
...
The shell escape function now properly escapes `%`, `\\` and `\n`. `utils.Popen` as well as `%q` output template expansion have been patched accordingly.
Prior to this fix using `--exec` together with `%q` when on Windows could cause remote code to execute. See https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-hjq6-52gw-2g7p for more details.
Authored by: Grub4K
2024-04-09 18:36:13 +02:00
Simon Sawicki and GitHub
9590cc6b47
Add new option --progress-delta ( #9082 )
...
Authored by: Grub4K
2024-04-08 22:47:38 +02:00
Simon Sawicki and GitHub
32abfb00bd
[utils] traverse_obj: Convenience improvements ( #9577 )
...
Add support for:
- `http.cookies.Morsel`
- Multi type filters (`{type, type}`)
Authored by: Grub4K
2024-04-01 02:12:03 +02:00
Simon Sawicki and GitHub
3699eeb67c
[utils] traverse_obj: Allow unbranching using all and any ( #9571 )
...
Authored by: Grub4K
2024-03-30 19:54:43 +01:00
Simon Sawicki and GitHub
979ce2e786
[test] traversal: Separate traversal tests ( #9574 )
...
Authored by: Grub4K
2024-03-30 19:32:07 +01:00
Simon Sawicki and GitHub
dbd8b1bff9
Improve 069b2aedae
...
Authored by: Grub4k
2024-03-10 20:44:53 +05:30
Simon Sawicki and GitHub
0fcefb92f3
[ie/newgrounds] Fix login and clean up extraction ( #9356 )
...
Authored by: mrmedieval, Grub4K
2024-03-07 21:37:13 +01:00
5eedc208ec
[ie/youtube] Better error when all player responses are skipped ( #9083 )
...
Authored by: Grub4K, pukkandan
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com >
2024-02-24 23:20:22 +00:00
Simon Sawicki
fd647775e2
[devscripts] tomlparse: Add makeshift toml parser
...
Authored by: Grub4K
2024-02-11 19:09:02 +01:00
Simon Sawicki and GitHub
2792092afd
[cookies] Improve error message for Windows --cookies-from-browser chrome issue ( #9080 )
...
Authored by: Grub4K
2024-01-31 09:56:14 +01:00
Simon Sawicki and GitHub
cbed249aaa
[cookies] Fix --cookies-from-browser for snap Firefox ( #9016 )
...
Authored by: Grub4K
2024-01-31 09:43:52 +01:00
Simon Sawicki and GitHub
3725b4f0c9
[core] Add --compat-options 2023 ( #9084 )
...
Authored by: Grub4K
2024-01-31 09:35:35 +01:00
Simon Sawicki and GitHub
5f25f348f9
[ie/pr0gramm] Enable POL filter and provide tags without login ( #9051 )
...
Authored by: Grub4K
2024-01-23 23:20:13 +01:00
Simon Sawicki and GitHub
b6951271ac
[ie/ard:mediathek] Revert to using old id ( #8916 )
...
Authored by: Grub4K
2024-01-05 21:34:38 +01:00
Simon Sawicki and GitHub
ffbd4f2a02
[utils] traverse_obj: Support xml.etree.ElementTree.Element ( #8911 )
...
Authored by: Grub4K
2024-01-05 21:26:17 +01:00
f9fb3ce86e
[cleanup] Misc ( #8598 )
...
Authored by: bashonly, pukkandan, seproDev, Grub4K
Co-authored-by: bashonly <bashonly@protonmail.com >
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com >
Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com >
2023-12-30 22:27:36 +01:00
Simon Sawicki
225cf2b830
Fix 2d1d683a54
...
Authored by: Grub4K
2023-12-26 20:07:09 +01:00
Simon Sawicki and GitHub
2d1d683a54
[devscripts] run_tests: Create Python script ( #8720 )
...
Authored by: Grub4K
2023-12-26 18:30:04 +01:00
65de7d204c
Update to ytdl-commit-be008e6 ( #8836 )
...
- [utils] Make restricted filenames ignore some Unicode categories (by dirkf)
- [ie/telewebion] Fix extraction (by Grub4K)
- [ie/imgur] Overhaul extractor (by bashonly, Grub4K)
- [ie/EpidemicSound] Add extractor (by Grub4K)
Authored by: bashonly, dirkf, Grub4K
Co-authored-by: bashonly <bashonly@protonmail.com >
2023-12-26 01:40:24 +01:00
Simon Sawicki and GitHub
00cdda4f6f
[core] Fix format selection parse error for CPython 3.12 ( #8797 )
...
Authored by: Grub4K
2023-12-24 22:09:01 +01:00
Simon Sawicki and GitHub
13b3cb3c2b
[ci] Run core tests only for core changes ( #8841 )
...
Authored by: Grub4K
2023-12-24 00:11:10 +01:00
Simon Sawicki and GitHub
00a3e47bf5
[ie/bundestag] Add extractor ( #8783 )
...
Authored by: Grub4K
2023-12-18 21:32:08 +01:00
Simon Sawicki and GitHub
0b6f829b1d
[utils] traverse_obj: Move is_user_input into output template ( #8673 )
...
Authored by: Grub4K
2023-12-06 21:46:45 +01:00
Simon Sawicki and GitHub
f98a3305eb
[ie/pr0gramm] Support variant formats and subtitles ( #8674 )
...
Authored by: Grub4K
2023-12-06 21:44:54 +01:00
Simon Sawicki and GitHub
f124fa4588
[ci] Concurrency optimizations ( #8614 )
...
Authored by: Grub4K
2023-11-19 16:05:13 +01:00
Simon Sawicki and GitHub
1d24da6c89
[ie/nintendo] Fix Nintendo Direct extraction ( #8609 )
...
Authored by: Grub4K
2023-11-18 21:04:42 +01:00
Simon Sawicki and GitHub
b012271d01
[cleanup] Misc ( #8510 )
...
Authored by: bashonly, coletdjnz, dirkf, gamer191, seproDev, Grub4K
2023-11-14 22:40:38 +01:00
Simon Sawicki and GitHub
4e38e2ae9d
[rh:requests] Handle both bytes and int for IncompleteRead.partial (Fix 8a8b54523a) ( #8348 )
...
Authored by: bashonly, coletdjnz, Grub4K
2023-10-15 10:54:38 +02:00
Simon Sawicki and GitHub
feebf6d02f
[ie/youtube] Fix bug with --extractor-retries inf ( #8328 )
...
Authored by: Grub4K
2023-10-12 12:20:52 +02:00
Simon Sawicki and GitHub
1c51c520f7
[fd/fragment] Improve progress calculation ( #8241 )
...
This uses the download speed from all threads and also adds smoothing to speed and eta
Authored by: Grub4K
2023-10-08 02:01:01 +02:00
Simon Sawicki and GitHub
377e85a179
[cleanup] Misc ( #8300 )
...
* Simplify nuxt regex
* Fix tmz quotes and tests
* Update test python versions
Authored by: dirkf, gamer191, Grub4K
2023-10-07 03:02:45 +02:00
Simon Sawicki and GitHub
cc8d844152
[ie/xhamster:user] Support creator urls ( #8232 )
...
Authored by: Grub4K
2023-10-03 11:33:40 +02:00
Simon Sawicki
088add9567
[cleanup] Misc
...
Authored by: Grub4K
2023-09-24 02:35:23 +02:00
Simon Sawicki
de015e9307
[core] Prevent RCE when using --exec with %q (CVE-2023-40581)
...
The shell escape function is now using `""` instead of `\"`. `utils.Popen` has been patched to properly quote commands.
Prior to this fix using `--exec` together with `%q` when on Windows could cause remote code to execute. See https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-42h4-v29r-42qg for reference.
Authored by: Grub4K
2023-09-24 02:29:01 +02:00
Simon Sawicki and GitHub
61bdf15fc7
[core] Raise minimum recommended Python version to 3.8 ( #8183 )
...
Authored by: Grub4K
2023-09-24 02:24:47 +02:00
Simon Sawicki and GitHub
b532556d0a
[ie/pr0gramm] Rewrite extractor ( #8151 )
...
Authored by: Grub4K
2023-09-19 21:52:44 +02:00
Simon Sawicki and GitHub
30ba233d4c
[devscripts] make_changelog: Fix changelog grouping and add networking group ( #8124 )
...
Authored by: Grub4K
2023-09-17 13:22:04 +02:00
Simon Sawicki and GitHub
836e06d246
[core] Fix support for upcoming Python 3.12 ( #8130 )
...
This also adds the following test runners:
- `3.12-dev` on `ubuntu-latest`
- `3.12-dev` on `windows-latest`
- `pypy-3.10` on `ubuntu-latest`
Authored by: Grub4K
2023-09-17 12:56:50 +02:00
Simon Sawicki and GitHub
f659e64394
[ie/bpb] Overhaul extractor ( #8119 )
...
Authored by: Grub4K
2023-09-16 17:50:06 +02:00
Simon Sawicki
77bff23ee9
Bugfix for 59e92b1f18
...
Closes #8012
Authored by: Grub4K
2023-09-02 15:18:04 +02:00
Simon Sawicki and GitHub
59e92b1f18
[rh/urllib] Simplify gzip decoding ( #7611 )
...
Authored by: Grub4K
2023-08-27 00:13:30 +02:00
Simon Sawicki
1be0a96a4d
[docs] Update collaborators
...
Authored by: Grub4K
2023-08-26 22:29:56 +02:00
Simon Sawicki and GitHub
9b16762f48
[ie/crunchyroll] Remove initial state extraction ( #7632 )
...
Authored by: Grub4K
2023-07-20 22:09:52 +02:00
Simon Sawicki and pukkandan
3121512228
[core] Change how Cookie headers are handled
...
Cookies are now saved and loaded under `cookies` key in the info dict
instead of `http_headers.Cookie`. Cookies passed in headers are
auto-scoped to the input URLs with a warning.
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj
Authored by: Grub4K
2023-07-06 23:14:39 +05:30
Simon Sawicki
edbe5b589d
Bugfixes for 4823ec9f46
...
Hotfix for fragmented downloads
Authored by: bashonly
2023-05-25 22:52:44 +02:00
Simon Sawicki and GitHub
032de83ea9
[extractor/crunchyroll] Rework with support for movies, music and artists ( #6237 )
...
This adds `CrunchyrollMusicIE` and `CrunchyrollArtistIE` extractors using the new, reworked base class and expands the `CrunchyrollBetaIE` with support for movies and movie listings and more complete metadata extraction
Authored by: Grub4K
2023-05-24 20:45:15 +02:00
Simon Sawicki and GitHub
8417f26b8a
[core] Implement --color flag ( #6904 )
...
Authored by: Grub4K
2023-05-24 20:35:07 +02:00
Simon Sawicki
23c39a4bea
[devscripts] make_changelog: Various improvements
...
- Make single items collapse into one line
- Don't hide "Important changes" in `<details>`
- Move upstream merge into priority
- Properly support comma separated prefixes
Authored by: Grub4K
2023-05-20 21:30:02 +02:00
Simon Sawicki
44a79958f0
[build] Fix macOS target
...
Authored by: Grub4K
2023-05-20 21:24:27 +02:00
Simon Sawicki
665472a7de
[update] Implement --update-to repo
...
Authored by: Grub4K, pukkandan
2023-05-20 21:21:32 +02:00
Simon Sawicki
d2e84d5eb0
[update] Better error handling
...
Authored by: pukkandan
2023-05-20 21:19:37 +02:00
Simon Sawicki and GitHub
b079c26f0a
[utils] traverse_obj: More fixes ( #6959 )
...
- Fix result when branching with `traverse_string`
- Fix `slice` path on `dict`s
- Fix tests and docstrings from 21b5ec86c2
- Add `is_iterable_like` helper function
Authored by: Grub4K
2023-04-30 19:50:22 +02:00
Simon Sawicki and GitHub
21b5ec86c2
[utils] traverse_obj: Allow iterables in traversal ( #6902 )
...
Authored by: Grub4K
2023-04-24 19:56:35 +02:00
Simon Sawicki and GitHub
0898c5c8cc
[utils] js_to_json: Implement template strings ( #6623 )
...
Authored by: Grub4K
2023-03-25 19:41:28 +01:00
Simon Sawicki and GitHub
9b7a48abd1
[cookies] Defer extraction of v11 key from keyring
...
Closes #6082
Authored by: Grub4K
2023-03-08 21:49:24 +01:00
Simon Sawicki and GitHub
3b479100df
[utils] write_string: Fix noconsole behavior
...
Ref: https://github.com/pyinstaller/pyinstaller/pull/7217
Authored by: Grub4K
2023-03-07 22:34:07 +01:00
Simon Sawicki and GitHub
08ff6d59f9
[build] Only archive if vars.ARCHIVE_REPO is set
...
Authored by: Grub4K
2023-03-04 14:18:24 +01:00
Simon Sawicki and GitHub
9344964281
Fix d400e261cf
...
Authored by: Grub4K
2023-03-03 22:39:09 +01:00
Simon Sawicki and pukkandan
12647e03d4
[build] Sign SHA files and release public key
...
Closes #6344
Authored by: Grub4K
2023-03-03 22:55:10 +05:30
77df20f14c
[update] Add option --update-to, including to nightly ( #6220 )
...
* By default, stable will only update to stable, and nightly to nightly
Authored by: Grub4K, bashonly, pukkandan
Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com >
2023-03-03 22:55:09 +05:30
29cb20bd56
[build] Automated builds and nightly releases ( #6220 )
...
Closes #1839
Authored by: Grub4K, bashonly
Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com >
2023-03-03 22:54:23 +05:30
Simon Sawicki and pukkandan
d400e261cf
[devscripts] Script to generate changelog ( #6220 )
...
Authored by: Grub4K
2023-03-03 22:54:23 +05:30
Simon Sawicki and GitHub
da8e2912b1
[utils] Popen: Shim undocumented text_mode property
...
Fixes #6317
Authored by: Grub4K
2023-02-23 04:18:45 +01:00
Simon Sawicki and GitHub
c9d14bd22a
[extractor/crunchyroll] Fix incorrect premium-only error
...
Closes #6234
Authored by: Grub4K
2023-02-16 15:54:11 +01:00
Simon Sawicki and GitHub
b6795fd310
[extractor/twitter] Fix --no-playlist and add media view_count when using GraphQL ( #6211 )
...
Authored by: Grub4K
2023-02-12 14:43:26 +01:00
Simon Sawicki and pukkandan
6839ae1f6d
[utils] traverse_obj: Fix more bugs
...
and cleanup uses of `default=[]`
Continued from b1bde57bef
2023-02-10 19:36:55 +05:30
Simon Sawicki and GitHub
b1bde57bef
[utils] traverse_obj: Fix several behavioral problems
...
See #6180 for further info
Authored by: Grub4K
2023-02-08 04:11:08 +01:00
Simon Sawicki
acacb57c7e
[extractor/rumble] Fix format sorting
...
Closes #6119
Authored by: pukkandan
2023-02-02 07:12:36 +01:00
Simon Sawicki and GitHub
776995bc10
[utils] traverse_obj: Various improvements
...
- Add `set` key for transformations/filters
- Add `re.Match` group names
- Fix behavior for `expected_type` with `dict` key
- Raise for filter function signature mismatch in debug
Authored by: Grub4K
2023-02-02 06:40:19 +01:00
Simon Sawicki
37e325b92f
[utils] Use local kernel32 for file locking on Windows
...
Ref: https://github.com/ytdl-org/youtube-dl/issues/21545
Authored by: Grub4K
2023-01-25 22:32:07 +01:00
Simon Sawicki and GitHub
773c272d66
Fix config locations ( #5933 )
...
Bug in 8e40b9d1ec
Closes #5953
Authored by: Grub4k, coletdjnz, pukkandan
2023-01-07 00:31:00 +05:30
Simon Sawicki and GitHub
5be214abed
[update] Fix updater file removal on windows ( #5970 )
...
Reverts 2fb0f85868
Closes #5632
Authored by: Grub4K
2023-01-06 22:31:18 +05:30
Simon Sawicki and GitHub
32a84bcf4e
Update to ytdl-commit-195f22f6
...
[generic] Improve KVS (etc) extraction
https://github.com/ytdl-org/youtube-dl/commit/195f22f679330549882a8234e7234942893a4902
Closes #3716
Authored by: Grub4k, pukkandan
2023-01-02 19:15:36 +05:30