Commit Graph

5827 Commits

Author SHA1 Message Date
Mike Fährmann
af8cba089e [zzup] support 'up.zzup.com' galleries (#6181) 2024-09-15 11:01:27 +02:00
Mike Fährmann
7abf6e445c [cohost] add 'tag' extractor (#4483) 2024-09-13 11:11:53 +02:00
Mike Fährmann
0d67d54162 [cohost] support 'attachment-row' blocks (#4483) 2024-09-13 10:33:05 +02:00
Mike Fährmann
29279f07d4 [cohost] warn about inaccessible posts (#4483) 2024-09-13 10:31:28 +02:00
Mike Fährmann
319116c923 [pp:ugoira] update mtime of zipped files (#6147)
in zip archives generated by '"mode": "archive"'
2024-09-12 21:51:55 +02:00
Mike Fährmann
df0d7d4a12 [cohost] add 'user' and 'post' extractors (#4483) 2024-09-11 18:03:33 +02:00
Mike Fährmann
ff07aef776 [pp:ugoira] implement storing "original" frames in archives (#6147)
… by using '"mode": "archive"'

- rename 'ffmpeg-demuxer' option to 'mode'
- add 'metadata' option
- add 'zip' as a possible `--ugoira` format

TODO: adjust file mtimes inside archives when 'mtime' is enabled
2024-09-09 21:41:37 +02:00
Mike Fährmann
4601aa9794 [util] add 'NullContext'
an even more minimal 'contextlib.nullcontext'
that also works on older Python versions
2024-09-09 20:28:18 +02:00
Mike Fährmann
4da3347d18 allow filtering '--list-extractors' results
with blacklist/whitelist syntax, e.g.

--list-extractors pixiv
--list-extractors pixiv:user pixiv:work
--list-extractors :search
2024-09-08 09:27:32 +02:00
Mike Fährmann
0db3c11ab0 [common] use 'cf-mitigated' header to detect challenges 2024-09-07 20:16:06 +02:00
Mike Fährmann
4b04ccb3a1 [wikimedia] probe possible API endpoints when none is defined
instead of hardcoding it to '/api.php'
2024-09-07 20:11:44 +02:00
Mike Fährmann
061cc12fdd [pp:ugoira] fix "KeyError: '_ugoira_frame_index'" (#6154)
fixes regression introduced in 07bd967f

Files with a non-ugoira related 'frames' metadata field would cause an
exception when an ugoira post processor was active.
2024-09-06 21:29:12 +02:00
Mike Fährmann
11a508f470 [docker] fix Docker image build
make commands meant to remove unnecessary caches non-fatal
(pip no longer installs setuptools and wheel directly anymore)
2024-09-06 21:27:45 +02:00
Mike Fährmann
dd62768e10 release version 1.27.4 2024-09-06 13:34:55 +02:00
Mike Fährmann
7260e236d8 [furaffinity] fix 'favorite' pagination (#6151) 2024-09-06 08:52:05 +02:00
Mike Fährmann
7fe0f35998 [sexcom] add 'likes' extractor (#6149) 2024-09-06 07:44:06 +02:00
Mike Fährmann
513fd26616 [bcbnsfw] use '*' as query when retrieving all posts (#6135) 2024-09-05 20:43:23 +02:00
Mike Fährmann
0b3d7280dc do not override '"ugoira": "original"' when using '--ugoira' (#6056) 2024-09-05 20:26:57 +02:00
Mike Fährmann
07bd967f59 [pp:ugoira] update (#6056)
- introduce '_ugoira_frame_index' metadata field
- store Ugoira file exts separately
- add 'skip' option
2024-09-05 20:25:20 +02:00
Mike Fährmann
32d2e686c2 [batoto] return 'chapter_url' as string (#5562)
don't try to parse it as integer
2024-09-05 17:47:38 +02:00
Mike Fährmann
8072dcf717 [pp:rename] recheck if file exists only when necessary 2024-09-05 17:42:29 +02:00
Mike Fährmann
359572162b [pp:rename] improve renaming files 'to' a format (#5846, #6044) 2024-09-03 21:17:31 +02:00
Mike Fährmann
6f611de889 [ytdl] simplify '_process_entries()' 2024-09-03 21:17:31 +02:00
Mike Fährmann
4a3a255ddc [ytdl] fix processing playlists of playlists (#6127) 2024-09-03 08:39:04 +02:00
Mike Fährmann
655145853a [toyhouse] fix extraction for image URLs 2024-09-02 17:15:02 +02:00
Mike Fährmann
864484e4c6 [instagram] add 'info' as a possible 'include' value 2024-09-02 15:43:55 +02:00
Mike Fährmann
0b53f3d0e9 [deviantart] fix '"original": "images"' (#6124) 2024-09-02 15:15:37 +02:00
Mike Fährmann
57da9ebfb5 [pp:ugoira] initial support for "original" frames (#6056) 2024-09-01 21:32:00 +02:00
Mike Fährmann
9d1e5f3c9b [pixiv] allow downloading "original" ugoira frames (#6056) 2024-09-01 13:37:32 +02:00
Mike Fährmann
ae9b0da755 [pp:hash] add 'hash' post processor (#6099) 2024-08-31 17:04:44 +02:00
Mike Fährmann
f52cf54e16 [docs] update 'wikimedia' capabilities in supportedsites.md 2024-08-31 17:04:22 +02:00
Mike Fährmann
bd932b6860 [twitter] add 'info' as a possible 'include' value (#6114) 2024-08-31 17:04:22 +02:00
Mike Fährmann
ef8b1bc56e [twitter] extract 'type' metadata (#6111) 2024-08-31 13:16:51 +02:00
Mike Fährmann
8eaae29bf9 [exhentai] fix 'limits' (#6090) 2024-08-31 10:23:07 +02:00
Mike Fährmann
510ca36b35 [tests] fix bug when running tests in a certain order
test_ytdl -> test_downloader -> test_extractor
would cause a test failure in Python <3.6 related to youtube_dl imports
2024-08-31 09:42:30 +02:00
Mike Fährmann
60b655429f add '--rename' and '--rename-to' command-line options (#5846, #6044) 2024-08-30 18:22:46 +02:00
Mike Fährmann
17f5ba43a8 [pp:rename] add 'rename' post processor (#5846, #6044)
renames previously downloaded files to a different filename format
2024-08-30 18:21:36 +02:00
Mike Fährmann
e464c955b3 merge #6104: [generic] better directory names 2024-08-30 11:47:09 +02:00
Mike Fährmann
58113b73d1 [flickr] make album metadata extraction non-fatal (#3441)
https://github.com/mikf/gallery-dl/issues/3441#issuecomment-2313679156
2024-08-30 10:24:03 +02:00
Allen
a552fb5bcd [generic] better directory formatting/md 2024-08-29 22:30:48 +02:00
Mike Fährmann
127aa45834 [ytdl] ignore SyntaxErrors when trying to import a module 2024-08-29 19:28:08 +02:00
Mike Fährmann
cf8e04d999 [koharu] improve format selection (#6088)
- allow specifying more than one possible format
- ignore not available formats
2024-08-29 09:33:24 +02:00
Mike Fährmann
c51938b82b [twitter] fix pinned Tweet extraction (#6102) 2024-08-29 08:53:48 +02:00
Mike Fährmann
b46169cfd2 add 'input-files' config option (#6059) 2024-08-27 17:21:49 +02:00
Mike Fährmann
eef5beb841 [pp:metadata] fix using '..' in directories on Windows (#5942, #6094) 2024-08-27 14:38:40 +02:00
Mike Fährmann
f669b3f046 [instagram] fix "KeyError - 'post_date'" (#6081, #6091)
fixes regression introduced in a3642638
2024-08-27 12:39:20 +02:00
Mike Fährmann
4b286e80fd merge #6050: [wikimedia] add 'wiki' extractor 2024-08-25 09:38:24 +02:00
Mike Fährmann
65cae11b54 merge #6077: [flickr] fix bug introduced in e92a9ae3 2024-08-25 09:30:07 +02:00
Mike Fährmann
47e7be31a5 [flickr] add 'contexts' and 'exif' test 2024-08-25 09:28:22 +02:00
Mike Fährmann
46c3971c88 [bunkr] add 'tlds' option to allow URLs with all TLDs (#5875, #6017) 2024-08-24 20:45:44 +02:00