Commit Graph

6688 Commits

Author SHA1 Message Date
Mike Fährmann
827eeca0bc [paheal] fix '404 Not Found' for tags with URL encoded characters (#7642) 2025-06-08 16:23:11 +02:00
Mike Fährmann
17d39c06e3 [exhentai] implement '"source": "metadata"' (#4902) 2025-06-08 12:57:23 +02:00
Mike Fährmann
967af5eede [exhentai] add 'limits-action' option (#6504)
https://github.com/mikf/gallery-dl/issues/6504#issuecomment-2949551532
2025-06-08 12:56:56 +02:00
Mike Fährmann
f0f118d350 merge #7641: [docs] update 'output.mode' description
Update auto output mode documentation to reflect implementation
2025-06-08 08:20:50 +02:00
Rodrigo Damazio Bovendorp
aed35c6d7b [docs] Update auto output mode documentation to reflect implementation 2025-06-07 21:19:21 -07:00
Mike Fährmann
3b75b195c1 [exhentai] detect HTML downloads (#4798) 2025-06-07 22:06:53 +02:00
Mike Fährmann
483e30d846 [dl:http] allow '_http_signature' to return a custom error message
… and fail the download immediately like '_http_validate'
2025-06-07 22:06:00 +02:00
Mike Fährmann
27c48ad317 [exhentai] ensure file signature bytes aren't all zero (#4902) 2025-06-07 20:34:05 +02:00
Mike Fährmann
839a43fe5c [dl:http] implement '_http_signature' (#4902)
allows passing a function to validate a file's signature bytes,
similar to '_http_validate'
2025-06-07 20:27:59 +02:00
Mike Fährmann
f51511155e [dl:http] include traceback in exception debug log 2025-06-07 20:24:08 +02:00
Mike Fährmann
8227e21257 [deviantart:tiptap] fix TypeError when 'textAlign' is null (#7639) 2025-06-07 19:06:43 +02:00
Mike Fährmann
b95b71f63f [tests:results] implement general tests for list items 2025-06-07 10:36:43 +02:00
Mike Fährmann
fc01d85823 [tests:results] split '_test_kwdict()' 2025-06-07 10:16:47 +02:00
Mike Fährmann
6e120f2551 [danbooru] fix Ugoira for instances without 'Ugoira:FrameMimeType'
(#7630)

fixes regression introduced in 1866f8b97b
2025-06-07 07:47:03 +02:00
Mike Fährmann
3e423937d2 [misskey] implement 'include' option (#5347) 2025-06-06 20:52:03 +02:00
Mike Fährmann
5cd3f3977e [misskey] add 'info' extractor (#5347) 2025-06-06 20:21:52 +02:00
Mike Fährmann
ac09cac978 [misskey] add 'avatar' and 'background' extractors (#5347) 2025-06-06 20:14:05 +02:00
Mike Fährmann
9c4cef822e [komikcast] update domain to 'komikcast02.com' 2025-06-06 20:14:02 +02:00
Mike Fährmann
15f5e567ec [mangaread] fix 'manga_alt' metadata 2025-06-06 13:25:29 +02:00
Mike Fährmann
b5c88b3d3e replace standard library 're' uses with 'util.re()' 2025-06-06 13:24:52 +02:00
Mike Fährmann
e1f03a5a93 [util] allow 'noop()' to accept one optional argument
fixes 'NullResponse.close()'
2025-06-05 20:08:24 +02:00
Mike Fährmann
8dace96af3 [twitter] simplify 'expand' & 'unique' init code 2025-06-05 15:33:47 +02:00
Mike Fährmann
72a01bc4d4 [common] use util.re_compile() in _dump_response 2025-06-05 15:24:22 +02:00
Mike Fährmann
d7d99d5606 [behance] fix '403 Forbidden' errors 2025-06-05 14:25:07 +02:00
Mike Fährmann
efd49aef73 allow using predefined Firefox/Chrome 'headers' & 'ciphers' 2025-06-05 14:24:38 +02:00
Mike Fährmann
1866f8b97b [danbooru] fix Ugoira conversions for posts without 'ZIP:ZipFileName'
get frame extension from 'Ugoira:FrameMimeType' instead

(#7630)
5919696271
2025-06-05 09:13:25 +02:00
Mike Fährmann
85124fe251 [common] add 'request_json()' convenience function 2025-06-05 09:13:25 +02:00
Mike Fährmann
a7bbccbd7b [common] add 'request_xml()' convenience function 2025-06-04 23:10:16 +02:00
Mike Fährmann
38116ce04c [docs] add 'discord' options to gallery-dl.conf 2025-06-04 21:29:15 +02:00
Mike Fährmann
685836f6fd [dynastyscans] add 'anthology' extractor (#7627) 2025-06-04 21:23:49 +02:00
Mike Fährmann
b5334f5837 [everia] prevent redirect when fetching a post page 2025-06-04 11:09:40 +02:00
missionfloyd
72e1a4a0cb [everia] unquote URLs (#7620)
* [everia.club] unescape URLs

* add test
2025-06-04 09:38:06 +02:00
Mike Fährmann
6df80fe595 [cookies] add support for LibreWolf (#4101 #7625) 2025-06-04 08:26:09 +02:00
Mike Fährmann
3c6c40d4ed [nijie] fix file extraction (#7624)
ignore empty URLs / URLs with no 'src="'
2025-06-04 07:57:27 +02:00
Mike Fährmann
75b6c8f3d8 re-implement 'category-map' (#7612) 2025-06-04 07:57:27 +02:00
Mike Fährmann
99bf92364a rename 'category-map' to 'config-map' (#7612) 2025-06-04 07:57:27 +02:00
Mike Fährmann
4fc719bb10 [util] add 're' helper 2025-06-04 07:56:43 +02:00
Mike Fährmann
8eb707e9b7 [civitai] use tuples instead of lists for API parameter constants 2025-06-04 07:45:21 +02:00
Mike Fährmann
df4845bf60 [sexcom] update
- fix 'title' and 'type' of pictures
- remove '#' from the beginning of each tag
- add 'gifs' option
2025-06-04 07:44:43 +02:00
thatDudo
0b0152b347 [rawkuma] add support (#4571)
* Add rawkuma extractor

* Fix flake8 warnings

* Remove fstring

* Fix regex call

* update domain to rawkuma.net

* fix 'manga' extractor

* fix 'chapter' extractor

* add tests

* update docs/supportedsites

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-06-02 19:15:53 +02:00
wankio
47c7c85f46 [sexcom] support '/pics/' URLs (#7611)
* Update sexcom.py

For Pics url
https://www.sex.com/en/pics/1459016

* reorder 'pattern'

* strip '?width=…' query parameter

* add test

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-06-01 11:13:17 +02:00
Mike Fährmann
09eed2a515 [docs:supportedsites] update 'civitai' entries (#7608 #7609) 2025-06-01 10:33:31 +02:00
Mike Fährmann
9ed31cf992 [civitai] fix & update 'search' extractor (#7609)
- rename to 'search-models'
- use SearchAPI
2025-06-01 10:30:09 +02:00
Mike Fährmann
dc467c7790 [civitai] add 'search-images' extractor (#7609) 2025-06-01 10:06:18 +02:00
Mike Fährmann
55f26a558a [civitai] implement 'CivitaiSearchAPI' class (#7609) 2025-06-01 09:56:10 +02:00
Mike Fährmann
02b34e6680 [civitai] support "My Reactions" results for videos (#7608) 2025-05-31 21:30:39 +02:00
Mike Fährmann
0389a622e2 [pixiv] remove '/jump.php' from AJAX caption links (#4327)
https://github.com/mikf/gallery-dl/issues/4327#issuecomment-2924753613
2025-05-31 19:20:39 +02:00
Mike Fährmann
f6f31af660 [civitai] add 'posts' extractor (#7609) 2025-05-31 19:20:39 +02:00
Mike Fährmann
33f3ed9f57 [job] refactor parent-child config paths (#7527)
- fixes TypeError when enabling 'category-transfer'
- fixes 'category-transfer' not applying to early config lookups
2025-05-31 17:41:54 +02:00
Mike Fährmann
9c3e458ced [tests:extractor] check initial '_cfgpath' 2025-05-31 11:00:11 +02:00