jirayu_sri/yt-dlp
1
0
Fork 0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2026-07-22 09:27:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
23,927 Commits 1 Branch 139 Tags
8c1f07d813175cbcf84651f27a827bad84fd8184
Commit Graph
76 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Felix SandGitHub 051d6b450c [extractor/arte] Move to v2 API (#3302) 
Closes #3622, #3502, #3086

Authored by: fstirlitz, pukkandan
 2022-07-28 00:05:39 +05:30
Felix SandGitHub 65493f64e1 [extractor/Audiodraft] Add extractors (#4288) 
Based on https://github.com/yt-dlp/yt-dlp/pull/4259
Closes https://github.com/yt-dlp/yt-dlp/issues/4028

Authored by: fstirlitz, Ashish0804
 2022-07-09 13:16:57 +05:30
Felix SandGitHub 92922fe7f9 [rumble] Extract subtitles (#3823) 
Closes #3132
Authored by: fstirlitz
 2022-05-21 05:00:32 -07:00
felixandpukkandan e4fa34a13e [hls] Fix unapplied byte_range for EXT-X-MAP fragment 
Cherry-picked from #3302
Authored by: fstirlitz
 2022-05-02 07:20:08 +05:30
felixandpukkandan 77f9033095 [compat] Split into sub-modules (#2173) 
Authored by: fstirlitz, pukkandan
 2022-04-18 04:26:43 +05:30
Felix SandGitHub a49e777d59 [spotify] Detect iframe embeds (#3430) 
Authored by: fstirlitz
 2022-04-14 06:22:47 -07:00
felixandpukkandan cfb0511d82 [cleanup] Remove unused code paths (#2173) 
Notes:

* `_windows_write_string`: Fixed in 3.6
  * https://bugs.python.org/issue1602
  * PEP: https://www.python.org/dev/peps/pep-0528

* Windows UTF-8 fix: Fixed in 3.3
  * https://bugs.python.org/issue13216

* `__loader__`: is always present in 3.3+
  * https://bugs.python.org/issue14646

* `workaround_optparse_bug9161`: Fixed in 2.7
  * https://bugs.python.org/issue9161

Authored by: fstirlitz
 2022-04-12 05:32:50 +05:30
felixandpukkandan ab96d1ad1b [cleanup] Remove unused scripts/tests (#2173) 
Authored by fstirlitz, pukkandan
 2022-04-12 01:15:21 +05:30
Felix SandGitHub 180c81509f [docs] Add an .editorconfig file (#3220) 
Authored by: fstirlitz
 2022-03-30 04:31:25 -07:00
Felix SandGitHub 47b8bf207b [go,viu] Extract subtitles from the m3u8 manifest (#3219) 
Authored by: fstirlitz
 2022-03-27 02:35:14 -07:00
Felix SandGitHub 3f047fc406 [extractor] Extract subtitles from manifests for more sites (#2686) 
vimeo, globo, kaltura, svt

Authored by: fstirlitz
 2022-02-11 11:03:33 -08:00
Felix SandGitHub ad9158d5f4 [ard] Extract subtitles (#2409) 
Fixes https://github.com/ytdl-org/youtube-dl/issues/30543, related: https://github.com/ytdl-org/youtube-dl/pull/17766
Authored by: fstirlitz
 2022-01-21 12:28:22 +05:30
Felix SandGitHub 4afa3ec4b6 [extractor] Detect more subtitle codecs in MPD manifests (#2174) 
Authored by: fstirlitz
 2022-01-01 01:36:45 +05:30
Felix SandGitHub d76d15a669 [utils] Update std_headers (#2023) 
* Update our chrome versions used for `User-Agent`s
* Drop the `Accept-Charset` header that no browser emits any more

Authored by: kikuyan, fstirlitz
 2021-12-18 05:34:24 +05:30
Felix SandGitHub 28fe35b4e3 [francetv] Update extractor (#1096) 
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29996
Closes: https://github.com/yt-dlp/yt-dlp/issues/970, https://github.com/ytdl-org/youtube-dl/issues/29956, https://github.com/ytdl-org/youtube-dl/issues/29957, https://github.com/ytdl-org/youtube-dl/issues/29969, https://github.com/ytdl-org/youtube-dl/issues/29990, https://github.com/ytdl-org/youtube-dl/issues/30010

Authored by: fstirlitz, sarnoud
 2021-10-10 03:20:17 +05:30
Felix SandGitHub 9359f3d4f0 [extractor] Extract storyboards from SMIL manifests (#1128) 
Authored by: fstirlitz
 2021-10-03 00:13:42 +05:30
Felix SandGitHub 1c5ce74c04 [zype] Extract subtitles from the m3u8 manifest (#948) 
Closes #929
Authored by: fstirlitz
 2021-09-11 15:46:03 +05:30
Felix SandGitHub 7a6742b5f9 [webvtt] Fix timestamp overflow adjustment (#698) 
In some streams, empty segments may appear with a bogus, non-monotone MPEG timestamp.
This should not be considered as an overflow

Authored by: fstirlitz
 2021-08-15 21:03:06 +05:30
Felix SandGitHub 0715f7e19b Revert erroneous use of the Content-Length header (#637) 
This reverts commit 6c907eb33f

The use of the Content-Length value here is erroneous and may lead
to truncated downloads if a compression scheme is specified in the
Content-Encoding header, as the Content-Length header refers to the
size of encoded data, not of the raw bytestream. This has been noticed
in the wild with WebVTT subtitle segments.

Authored by: fstirlitz
 2021-08-11 21:09:17 +05:30
Felix SandGitHub 25a3f4f5d6 [webvtt] Merge daisy-chained duplicate cues (#638) 
Fixes: https://github.com/yt-dlp/yt-dlp/issues/631#issuecomment-893338552

Previous deduplication algorithm only removed duplicate cues with
identical text, styles and timestamps.  This change also merges
cues that come in ‘daisy chains’, where sequences of cues with
identical text and styles appear in which the ending timestamp of
one equals the starting timestamp of the next.

This deduplication algorithm has the somewhat unfortunate side effect
that NOTE blocks between cues, if found, will be emitted in a different
order relative to their original cues.  This may be unwanted if perfect
fidelity is desired, but then so is daisy-chain deduplication itself.
NOTE blocks ought to be ignored by WebVTT players in any case.

Authored by: fstirlitz
 2021-08-10 01:52:30 +05:30
Felix SandGitHub da1c94ee45 [generic] Extract previously missed subtitles (#515) 
* [generic] Extract subtitles in cases missed previously
* [common] Detect discarded subtitles in SMIL manifests
* [generic] Extract everything in the SMIL manifest

Authored by: fstirlitz
 2021-07-16 19:52:56 +05:30
Felix SandGitHub 182b6ae8a6 [RTP] Fix extraction and add subtitles (#497) 
Authored by: fstirlitz
 2021-07-14 05:06:18 +05:30
felixandpukkandan c843e68588 [utils] Improve js_to_json comment regex 
Capture the newline character as part of a single-line comment

From #497, Authored by: fstirlitz
 2021-07-14 05:02:43 +05:30
felixandpukkandan 198f7ea89e [extractor] Allow extracting multiple groups in _search_regex 
From #497, Authored by: fstirlitz
 2021-07-14 05:02:42 +05:30
felixandpukkandan 3fd4c2a543 [mediasite] Extract slides (#343) 
Fixes:
https://github.com/ytdl-org/youtube-dl/issues/4974#issue-58006762
https://github.com/ytdl-org/youtube-dl/issues/4540#issuecomment-69574231
https://github.com/ytdl-org/youtube-dl/pull/11185#issuecomment-335554239

Authored by: fstirlitz
 2021-06-13 20:36:40 +05:30
felixandpukkandan cdb19aa4c2 [downloader/mhtml] Add new downloader (#343) 
This downloader is intended to be used for streams that consist of a
timed sequence of stand-alone images, such as slideshows or thumbnail
streams

This can be used for implementing:

https://github.com/ytdl-org/youtube-dl/issues/4974#issue-58006762
https://github.com/ytdl-org/youtube-dl/issues/4540#issuecomment-69574231
https://github.com/ytdl-org/youtube-dl/pull/11185#issuecomment-335554239

https://github.com/ytdl-org/youtube-dl/issues/9868
https://github.com/ytdl-org/youtube-dl/pull/14951


Authored by: fstirlitz
 2021-06-13 20:36:40 +05:30
felixandpukkandan cc52de4356 [cleanup] Point all shebang to python3 (#372) 
Authored by: fstirlitz
 2021-06-06 00:59:04 +05:30
felixandpukkandan 2ec1759f9d [downloader/ffmpeg] Hide FFmpeg banner unless in verbose mode (#372) 
Authored by: fstirlitz
 2021-06-06 00:59:04 +05:30
felixandpukkandan e2efe599aa [common] Fix FourCC fallback when parsing ISM (#372) 
In some DASH manifests, the FourCC attribute is actually present,
but empty.  We thus apply the same fallback to 'AACL' that we do
when the attribute is entirely absent.

Authored by: fstirlitz
 2021-06-06 00:59:04 +05:30
Felix S e8f834cd8d [threeqsdn] Extract subtitles from streaming manifests 2021-04-28 17:24:50 +05:30
Felix S e0e624ca7f [canvas] Extract subtitles from streaming manifests 2021-04-28 17:24:19 +05:30
Felix S ec4f374c05 [wat] Extract subtitles from streaming manifests 2021-04-28 17:24:08 +05:30
Felix S c811e8d8bd [atresplayer] Extract subtitles from streaming manifests 2021-04-28 17:23:56 +05:30
Felix S b2cd5da460 [francetv] Extract subtitles from the HLS manifest 2021-04-28 17:23:47 +05:30
Felix S 2de3b21e05 [uplynk] Extract subtitles from HLS manifests 2021-04-28 17:23:37 +05:30
Felix S 4bed436371 [twitter] Extract subtitles from HLS manifests 2021-04-28 17:23:27 +05:30
Felix S efe9dba595 [srgssr] Extract subtitles from HLS manifests 2021-04-28 17:23:16 +05:30
Felix S 47f4203dd3 [nytimes] Extract subtitles from HLS manifests 2021-04-28 17:23:05 +05:30
Felix S 015c10aeec [roosterteeth] Use common code for subtitle extraction 2021-04-28 17:22:56 +05:30
Felix S a00d781b73 [elonet] Use common code for subtitle extraction 2021-04-28 17:22:45 +05:30
Felix S 0c541b563f [tv4] Extract subtitles from streaming manifests 2021-04-28 17:22:36 +05:30
Felix S 64a5cf7929 [byutv] Extract subtitles from streaming manifests 2021-04-28 17:22:27 +05:30
Felix S 7a450a3b1c [generic] Extract subtitles from direct SSTR manifest links 2021-04-28 17:22:18 +05:30
Felix S 7de27caf16 [generic] Extract subtitles from direct DASH manifest links 2021-04-28 17:22:07 +05:30
Felix S c26326c1be [generic] Extract subtitles from direct HLS manifest links 2021-04-28 17:21:55 +05:30
Felix S 66a1b8643a [downloader/ism] Support muxing TTML subtitles 2021-04-28 17:21:45 +05:30
Felix S 15828bcf25 [downloader/hls] Handle MPEG-2 PES timestamp overflow 2021-04-28 17:21:35 +05:30
Felix S 333217f43e [downloader/hls] Remove duplicate cues using a sliding window of candidates 2021-04-28 17:21:26 +05:30
Felix S 4a2f19abbd [downloader/hls] Assemble single-file WebVTT subtitles from HLS segments 2021-04-28 17:21:14 +05:30
Felix S 5fbcebed8c [test] Test SSTR manifest parsing 2021-04-28 17:21:01 +05:30
Felix S becdc7f82c [test] Test subtitle extraction from DASH manifests 2021-04-28 17:20:49 +05:30
Felix S 73b9088a1c [test] Test subtitle extraction from HLS manifests 2021-04-28 17:20:39 +05:30
Felix S f6a1d69a87 [extractor/common] Extend _extract_akamai_formats to also extract subtitle tracks 2021-04-28 17:20:29 +05:30
Felix S fd76a14259 [extractor/common, downloader/ism] Extract SSTR subtitle tracks 
_parse_ism_formats was extended into _parse_ism_formats_and_subtitles;
all direct users were updated, though _extract_ism_formats was left
as a compatibility wrapper.

The SSTR downloader was also modified in order to prepare for muxing
subtitle streams, although no support for any subtitle codecs was
added in this commit.
 2021-04-28 17:20:20 +05:30
Felix S 171e59edd4 [extractor/common] Extract DASH subtitle tracks 
_extract_mpd_formats and _parse_mpd_formats were extended into
_…_formats_and_subtitles; wrappers with old names are provided
for compatibility.
 2021-04-28 17:20:11 +05:30
Felix S a0c3b2d5cf [extractor/common] Extract HLS subtitle tracks 
_extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles
and extended to handle subtitle tracks instead of skipping them;
a wrapper with the old name is provided for compatibility.

_parse_m3u8_formats is likewise renamed and extended, but without adding
the compatibility wrapper; the test suite is adjusted to test the enhanced
method instead.
 2021-04-28 17:19:57 +05:30
Felix S 19bb39202d [extractor/common] Generalise _merge_subtitles 
This allows modifying a subtitles dictionary in-place.
 2021-04-28 17:19:46 +05:30
Felix S d4553567d2 [downloader/ism] Prevent writing the header again when resuming an interrupted download 2021-04-28 17:19:37 +05:30
Felix S 4d49884c58 [downloader/fragment] Allow persisting extra state when a download is interrupted 2021-04-28 17:19:31 +05:30
Felix S 5873d4ccdd [utils] Improve bug_report_message 
Add an optional argument specifying the text that should go before
the message.
 2021-04-28 17:19:23 +05:30
Felix SandGitHub c72967d5de [mediasite] Generalize URL pattern (#275) 
Authored by: fstirlitz
 2021-04-26 17:23:20 +05:30
Felix SandGitHub a471f21da6 [mildom] Remove proxy (#260) 
Closes #251
Makes 2cff495997, ab406a1c0e, #252 obsolete

Authored by: fstirlitz
 2021-04-22 16:52:22 +05:30
Felix SandGitHub 155510fe81 Improve the yt-dlp.sh script (#248) 
* Quote the `$0` variable to correctly handle spaces
* Change the shebang line to `/bin/sh` to avoid unnecessarily depending on bash
* Use the `exec` command to avoid having the shell process linger unnecessarily
* Change the mode to make the script directly executable

Authored by: fstirlitz

:ci skip all
 2021-04-17 19:21:25 +05:30
felix d03cfdce1b Support arbitrary stream merges 
With this change, the merge operator may join any number of media streams,
video or audio. The streams are downloaded in the order specified.

Also, fix the metadata post-processor so that it doesn't leave out
any streams.
 2020-09-14 12:53:09 +02:00
felix de7c27cd25 [dispeak] mark the "slides" stream as video-only 2020-09-12 13:41:23 +02:00
felixandSergey M․ 8056c8542d [mediasite] Add extractor, subsume sandia and collegerama extractors 2017-12-30 07:23:41 +07:00
felixandSergey M․ 2501d41ef4 [common] use AACL as the default fourcc when AudioTag is 255 2017-12-30 07:22:07 +07:00
felixandSergey M 8953319916 [screenwavemedia] Remove extractor 
Rewrite TeamFourStar and Normalboots extractors in terms of JWPlatform
 2016-11-28 23:17:56 +07:00
felix a0758dfa1a [filmon] new extractor 2016-11-13 17:28:17 +01:00
felixandSergey M․ 640eea0a0c [ora] minimise fragile regex shenanigans; recognise unsafespeech.com URLs 2016-05-14 20:13:06 +06:00
felixandSergey M․ bd1e484448 [utils] js_to_json: various improvements 
now JS object literals like { /* " */ 0: ",]\xaa<\/p>", } will be correctly converted to JSON.
 2016-05-14 20:12:39 +06:00
felixandSergey M․ 12439dd5ec [generic] Capture <audio> tags in addition to <video> tags 2015-09-05 21:53:10 +06:00
felixandSergey M․ e276fd2cb3 [screenwavemedia] warn when falling back to a hardcoded list of streams 2015-08-29 18:38:41 +06:00
felixandSergey M․ 9b22cb10c4 [screenwavemedia] use the true JS value instead of a comment 2015-08-29 18:38:34 +06:00
felixandSergey M․ 8ca31a0e05 [generic] Look for ScreenwaveMedia embeds 2015-08-29 18:38:23 +06:00
felix ac8f97f2b3 [rdsca] New extractor 2015-07-11 19:05:17 +02:00