Commit Graph

1705 Commits

Author SHA1 Message Date
Mike Fährmann
5ab0c6051b [imgbox] match direct links (#8474) 2025-10-28 17:43:43 +01:00
Mike Fährmann
8fabf7c114 [shimmie2] support 'soybooru.com' (#8467) 2025-10-28 17:43:43 +01:00
Mike Fährmann
92be3fb911 [cyberfile:folder] support subfolders (#8323)
https://github.com/mikf/gallery-dl/issues/8323#issuecomment-3366857916

add 'recursive' option
2025-10-28 17:43:42 +01:00
Mike Fährmann
c0e665e3db [cyberfile] add 'shared' extractor (#8323)
https://github.com/mikf/gallery-dl/issues/8323#issuecomment-3366857916
2025-10-28 17:43:42 +01:00
PrivateAccount85642650
481bf1e393 [realbooru] fix 'tags' for video posts (#8455)
* fix realbooru tags for video posts
* fix lines too long
* combine 'tags' and 'tags_<category>' extraction
    - extract tag categories independent of 'tags' option
* add 'video' & 'animated GIF' tests

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-10-24 11:33:29 +02:00
Mike Fährmann
5e1862871e [wikimedia] provide 'lang' metadata (#7283) 2025-10-23 20:42:45 +02:00
Mike Fährmann
98d3354575 [wikimedia] implement config lookup for fandom/wikigg sites (#7283)
{
    "extractor": {
        "fandom": {
            "filename": "..."
        }
    }
}
2025-10-23 20:14:56 +02:00
Mike Fährmann
eefd8f9c00 [wikimedia] add 'format=original' to file URLs (#5512)
add 'format' option
2025-10-22 20:16:21 +02:00
Mike Fährmann
df1b6204c6 [e621] add 'artist' & 'artist-search' extractors (#8448) 2025-10-22 10:33:52 +02:00
featherbutt
06e3126bba [pp:metadata] add 'newline' option (#8439)
* Add configuration setting to control newline characters in metadata.
* update docs/configuration
* introduce 'open()' method
* add 'newline' test
2025-10-21 18:47:39 +02:00
Mike Fährmann
c8fc790028 merge branch 'dt': move datetime utils into separate module
- use 'datetime.fromisoformat()' when possible (#7671)
- return a datetime-compatible object for invalid datetimes
  (instead of a 'str' value)
2025-10-20 09:30:05 +02:00
Mike Fährmann
ed8fe07f92 [tests/formatter] update results 2025-10-20 09:19:47 +02:00
Mike Fährmann
5802107cdf [dt] update representation of invalid datetime objects 2025-10-19 18:51:42 +02:00
Mike Fährmann
989136bc59 [dt] replace 'parse_compat' with compat workaround 2025-10-19 18:26:32 +02:00
Mike Fährmann
f9a8598f35 [weibo] add 'text' option (#8422) 2025-10-19 12:05:27 +02:00
enduser420
e2fb2c009c [reddit] support comment share link (#8434) 2025-10-18 18:41:23 +02:00
Mike Fährmann
d57dc48dcd [tests/results] replace 'datetime' usage
test for 'dt:…' to catch NullDatetime instances,
which inherit from 'datetime.datetime' but are not exactly this class
2025-10-17 17:06:39 +02:00
Mike Fährmann
69f7cfdd0c [dt] replace 'datetime' imports 2025-10-16 11:42:42 +02:00
Mike Fährmann
21350c5084 [dt] introduce 'NullDatetime' to represent invalid datetimes 2025-10-16 09:46:13 +02:00
Mike Fährmann
0eb3c8a994 [dt] replace 'util' datetime functions 2025-10-15 21:30:38 +02:00
Mike Fährmann
b336049fac [bellazon] add 'num_internal' & 'num_external' metadata fields (#8415) 2025-10-15 17:25:10 +02:00
Mike Fährmann
3252ead7c7 [kemono] improve 'filename' 2025-10-15 13:13:46 +02:00
Mike Fährmann
36a3fe45e4 [subscribestar] improve 'filename' (#8416) 2025-10-15 11:52:39 +02:00
Mike Fährmann
17156ab7a2 [text] implement 'nameext_from_name()' 2025-10-15 11:14:49 +02:00
Mike Fährmann
d44a0f8094 [imagetwist] detect removed images (#8415) 2025-10-15 10:27:43 +02:00
Mike Fährmann
d0f5d4e0d3 [tests/dt] add tests 2025-10-15 09:45:30 +02:00
Mike Fährmann
55821346f5 [bunkr] extract 'album_...' metadata for '/f/' URLs (#8405) 2025-10-13 19:16:37 +02:00
Mike Fährmann
be46fac6ce [bellazon] fix errors when handling guest users (#8397) 2025-10-13 11:37:09 +02:00
Mike Fährmann
41a0d785ca [bellazon] ignore links to other threads or posts (#8392) 2025-10-12 09:37:16 +02:00
Mike Fährmann
f89f55b215 [bellazon] improve video URL regex (#8392)
match <source> elements with attributes before 'src="..."'
2025-10-12 09:37:15 +02:00
Mike Fährmann
214acc39e6 [mangadex] fix 'RuntimeError' for titles without a 'description' (#8389)
fixes regression introduced in 0a76cbc8c7
2025-10-12 09:37:15 +02:00
Mike Fährmann
3a35a4aee4 [civitai] prevent downloading random posts from deleted users (#8299) 2025-10-11 09:09:48 +02:00
Mike Fährmann
c269339dbc [naver-blog] fix 'video' extraction (#8385)
- do not include 'data-module-v2' after regular 'data-module'
- move module load into try-except block
2025-10-10 17:21:23 +02:00
Mike Fährmann
2c0facde72 [kemono] prevent fatal exception when retrieving profile data (#8382) 2025-10-10 17:21:01 +02:00
Mike Fährmann
3f8423aaaf [dandadan] add support (#8381) 2025-10-10 00:41:01 +02:00
Mike Fährmann
ca4e061386 [pp:exec] support '{_temppath}' replacement field (#8329) 2025-10-09 20:59:06 +02:00
Mike Fährmann
724ae3661b [text] add 'empty' argument to 'parse_query()' (#8377)
enables including query parameters without value
2025-10-09 12:10:23 +02:00
Mike Fährmann
f482e66417 [poipiku] improve extraction logic (#8356)
- do not automatically discard posts requiring 'retweet' etc (#8374)
- provide 'warning', 'password', & 'requires'  metadata fields
2025-10-09 08:56:58 +02:00
Mike Fährmann
5545a0e8e6 [fansly] update format selection (#4401)
https://github.com/mikf/gallery-dl/issues/4401#issuecomment-3383021221

sort by
- width
- HTTP (formats 0,1,2,3,4)
- DASH (format 303)
- HLS  (format 302)
2025-10-08 23:17:16 +02:00
Mike Fährmann
ff0728dcd3 [bluesky] handle exceptions during file extraction 2025-10-08 10:39:51 +02:00
Mike Fährmann
a4e0091b25 [bluesky] add 'bookmark' extractor (#8370) 2025-10-08 10:00:12 +02:00
Mike Fährmann
d49b819886 [poipiku] improve error detection (#8356) 2025-10-07 18:18:13 +02:00
Mike Fährmann
0aac99673d [poipiku] fix original file downloads (#8356)
now requires 'POIPIKU_LK' cookie
2025-10-06 15:33:11 +02:00
Mike Fährmann
c58f66ab06 merge #8344: [wikimedia] fix name & extension of files without an extension 2025-10-05 19:22:07 +02:00
ClosedPort22
5e33f9981f [wikimedia] fix name of files without extension 2025-10-04 15:41:55 +08:00
Mike Fährmann
c609a3181b [instagram] support '/share/SHORTCODE' URLs (#8340)
i.e. "bare" /share/ links
2025-10-03 22:26:45 +02:00
Mike Fährmann
7b338edf63 [weibo] resolve 'wblive-out.api.weibo.com' URLs (#8339) 2025-10-03 17:21:31 +02:00
Mike Fährmann
45f364e09e [dl:http] add MIME type and signature for m3u8 & mpd files (#8339) 2025-10-03 16:48:10 +02:00
Mike Fährmann
faeec7e67f [weibo] try 'replay_hd' URLs as video fallback (#8339) 2025-10-03 11:19:14 +02:00
Mike Fährmann
008a871ccb [weibo] download 'm3u8' manifests with ytdl (#8339) 2025-10-03 11:18:52 +02:00