github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,666 Commits 1 Branch 0 Tags
72a01bc4d407af21a236cadddfe094e49d8ee848
Commit Graph

6666 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
72a01bc4d4 [common] use util.re_compile() in _dump_response 2025-06-05 15:24:22 +02:00
Mike Fährmann
d7d99d5606 [behance] fix '403 Forbidden' errors 2025-06-05 14:25:07 +02:00
Mike Fährmann
efd49aef73 allow using predefined Firefox/Chrome 'headers' & 'ciphers' 2025-06-05 14:24:38 +02:00
Mike Fährmann
1866f8b97b [danbooru] fix Ugoira conversions for posts without 'ZIP:ZipFileName' 
get frame extension from 'Ugoira:FrameMimeType' instead

(#7630)
5919696271
 2025-06-05 09:13:25 +02:00
Mike Fährmann
85124fe251 [common] add 'request_json()' convenience function 2025-06-05 09:13:25 +02:00
Mike Fährmann
a7bbccbd7b [common] add 'request_xml()' convenience function 2025-06-04 23:10:16 +02:00
Mike Fährmann
38116ce04c [docs] add 'discord' options to gallery-dl.conf 2025-06-04 21:29:15 +02:00
Mike Fährmann
685836f6fd [dynastyscans] add 'anthology' extractor (#7627) 2025-06-04 21:23:49 +02:00
Mike Fährmann
b5334f5837 [everia] prevent redirect when fetching a post page 2025-06-04 11:09:40 +02:00
missionfloyd
72e1a4a0cb [everia] unquote URLs (#7620) 
* [everia.club] unescape URLs

* add test
 2025-06-04 09:38:06 +02:00
Mike Fährmann
6df80fe595 [cookies] add support for LibreWolf (#4101 #7625) 2025-06-04 08:26:09 +02:00
Mike Fährmann
3c6c40d4ed [nijie] fix file extraction (#7624) 
ignore empty URLs / URLs with no 'src="'
 2025-06-04 07:57:27 +02:00
Mike Fährmann
75b6c8f3d8 re-implement 'category-map' (#7612) 2025-06-04 07:57:27 +02:00
Mike Fährmann
99bf92364a rename 'category-map' to 'config-map' (#7612) 2025-06-04 07:57:27 +02:00
Mike Fährmann
4fc719bb10 [util] add 're' helper 2025-06-04 07:56:43 +02:00
Mike Fährmann
8eb707e9b7 [civitai] use tuples instead of lists for API parameter constants 2025-06-04 07:45:21 +02:00
Mike Fährmann
df4845bf60 [sexcom] update 
- fix 'title' and 'type' of pictures
- remove '#' from the beginning of each tag
- add 'gifs' option
 2025-06-04 07:44:43 +02:00
thatDudo
0b0152b347 [rawkuma] add support (#4571) 
* Add rawkuma extractor

* Fix flake8 warnings

* Remove fstring

* Fix regex call

* update domain to rawkuma.net

* fix 'manga' extractor

* fix 'chapter' extractor

* add tests

* update docs/supportedsites

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-06-02 19:15:53 +02:00
wankio
47c7c85f46 [sexcom] support '/pics/' URLs (#7611) 
* Update sexcom.py

For Pics url
https://www.sex.com/en/pics/1459016

* reorder 'pattern'

* strip '?width=…' query parameter

* add test

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-06-01 11:13:17 +02:00
Mike Fährmann
09eed2a515 [docs:supportedsites] update 'civitai' entries (#7608 #7609) 2025-06-01 10:33:31 +02:00
Mike Fährmann
9ed31cf992 [civitai] fix & update 'search' extractor (#7609) 
- rename to 'search-models'
- use SearchAPI
 2025-06-01 10:30:09 +02:00
Mike Fährmann
dc467c7790 [civitai] add 'search-images' extractor (#7609) 2025-06-01 10:06:18 +02:00
Mike Fährmann
55f26a558a [civitai] implement 'CivitaiSearchAPI' class (#7609) 2025-06-01 09:56:10 +02:00
Mike Fährmann
02b34e6680 [civitai] support "My Reactions" results for videos (#7608) 2025-05-31 21:30:39 +02:00
Mike Fährmann
0389a622e2 [pixiv] remove '/jump.php' from AJAX caption links (#4327) 
https://github.com/mikf/gallery-dl/issues/4327#issuecomment-2924753613
 2025-05-31 19:20:39 +02:00
Mike Fährmann
f6f31af660 [civitai] add 'posts' extractor (#7609) 2025-05-31 19:20:39 +02:00
Mike Fährmann
33f3ed9f57 [job] refactor parent-child config paths (#7527) 
- fixes TypeError when enabling 'category-transfer'
- fixes 'category-transfer' not applying to early config lookups
 2025-05-31 17:41:54 +02:00
Mike Fährmann
9c3e458ced [tests:extractor] check initial '_cfgpath' 2025-05-31 11:00:11 +02:00
Mike Fährmann
8ca9cc99b0 [mangadex:list] fix config lookups for 'list-feed' subcategory 2025-05-31 09:19:36 +02:00
Mike Fährmann
5b6bccd4c3 [directlink] fix config lookups by subcategory (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-2924143161
 2025-05-31 09:12:05 +02:00
Mike Fährmann
8adf48316f [ytdl] detect yt-dlp independent of module name (#7599) 2025-05-30 23:52:32 +02:00
Mike Fährmann
931c2949ed [kemono] fix tagged creator posts 
fixes regression introduced in 16b5d41ce5
 2025-05-30 21:53:00 +02:00
Mike Fährmann
f9dd8318f1 [newgrounds] ignore '<script>' content in 'tags' (#7604) 2025-05-30 21:52:48 +02:00
Mike Fährmann
ec523c2c2c [mangasee] remove module 2025-05-30 18:04:55 +02:00
Mike Fährmann
783f1c1b11 add 'category-map' option 
primarily to achieve some form of backwards compatibility for
922c296482
 2025-05-30 17:55:49 +02:00
Mike Fährmann
922c296482 [kemono][coomer][schalenetwork] rename modules & extractors 
category changes:

- kemonoparty -> kemono
- coomerparty -> coomer
- koharu      -> schalenetwork

also wanted to rename '2chan' -> 'sturdychan',
but the site's main page is still titled '2chen'
 2025-05-30 17:51:49 +02:00
Mike Fährmann
2a5eec953e move cache/config/update handling before loading extractors 2025-05-30 10:15:58 +02:00
Mike Fährmann
8dc5794972 [common] return NullResponse for non-fatal requests (#7598) 
Make Extractor.request(…, fatal=False) actually non-fatal
by returning an empty response instead of raising an exception
when a request fails due to connection issues.
 2025-05-29 20:31:41 +02:00
Mike Fährmann
002c25d417 [util] add 'NullResponse' class 2025-05-29 20:27:40 +02:00
Mike Fährmann
539ed8fef4 [formatter] add 'D' conversion 2025-05-29 20:09:26 +02:00
Mike Fährmann
17b2910938 [util] implement 'to_datetime()' 2025-05-28 20:10:18 +02:00
Mike Fährmann
129fc00962 [pyinstaller] exclude 'pkg_resources' module (#7592) 2025-05-28 09:30:11 +02:00
Mike Fährmann
6e87ad2ccc [fanbox] extract 'archives' metadata (#7454) 2025-05-27 18:04:35 +02:00
Mike Fährmann
47af8459c2 [util] add collections of image/video/archive filename extensions 2025-05-26 23:08:27 +02:00
Mike Fährmann
45cd81639e [fanbox] return 'fileMap' files in order (#2718) 2025-05-26 22:05:51 +02:00
Mike Fährmann
204c94ccb4 [deviantart:tag] fix 'username' (#7587) 2025-05-26 21:34:06 +02:00
Mike Fährmann
a798b8971e [dl:ytdl] fix postprocessing/merge errors (#7581) 
don't use a hardcoded '.part' filename extension

fixes regression introduced in 29d315e495
 2025-05-26 18:56:40 +02:00
Mike Fährmann
5ebea85bd1 [patreon] send 'Referer' when downloading m3u8 videos (#7571) 2025-05-26 17:35:49 +02:00
Mike Fährmann
e05b82253a [dl:ytdl] support custom headers when fetching HLS/DASH manifests 2025-05-26 17:17:37 +02:00
Mike Fährmann
456e93d489 [tests:results] enable 'extension' and ':?' in format tests 2025-05-26 13:50:42 +02:00