Commit Graph

5484 Commits

Author SHA1 Message Date
PrivateAccount85642650
481bf1e393 [realbooru] fix 'tags' for video posts (#8455)
* fix realbooru tags for video posts
* fix lines too long
* combine 'tags' and 'tags_<category>' extraction
    - extract tag categories independent of 'tags' option
* add 'video' & 'animated GIF' tests

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-10-24 11:33:29 +02:00
Mike Fährmann
68909724e7 [wikimedia] restrict default 'format' to fandom/wikigg (#5512)
eefd8f9c00 (commitcomment-168635597)
2025-10-23 20:56:34 +02:00
Mike Fährmann
5e1862871e [wikimedia] provide 'lang' metadata (#7283) 2025-10-23 20:42:45 +02:00
Mike Fährmann
da4b8c1e83 [wikimedia] fix 'limit' config lookup
rework config handling in general
2025-10-23 20:16:46 +02:00
Mike Fährmann
98d3354575 [wikimedia] implement config lookup for fandom/wikigg sites (#7283)
{
    "extractor": {
        "fandom": {
            "filename": "..."
        }
    }
}
2025-10-23 20:14:56 +02:00
Mike Fährmann
eefd8f9c00 [wikimedia] add 'format=original' to file URLs (#5512)
add 'format' option
2025-10-22 20:16:21 +02:00
Mike Fährmann
df1b6204c6 [e621] add 'artist' & 'artist-search' extractors (#8448) 2025-10-22 10:33:52 +02:00
Mike Fährmann
3deb5a413d improve arguments for relative '__import__()'
using None for 'fromlist' is slightly faster than an empty tuple
2025-10-21 12:06:50 +02:00
Mike Fährmann
d7c97d5a97 use f-strings when building 'pattern' 2025-10-20 21:23:11 +02:00
Mike Fährmann
9bf76c1352 replace 'util.re()' with 'text.re()'
remove unnecessary 'util' imports
2025-10-20 17:44:58 +02:00
Mike Fährmann
c8fc790028 merge branch 'dt': move datetime utils into separate module
- use 'datetime.fromisoformat()' when possible (#7671)
- return a datetime-compatible object for invalid datetimes
  (instead of a 'str' value)
2025-10-20 09:30:05 +02:00
Mike Fährmann
c38856bd3f [dt] use 'parse_datetime_iso()' for ISO formats 2025-10-19 21:52:05 +02:00
Mike Fährmann
989136bc59 [dt] replace 'parse_compat' with compat workaround 2025-10-19 18:26:32 +02:00
Mike Fährmann
f9a8598f35 [weibo] add 'text' option (#8422) 2025-10-19 12:05:27 +02:00
Mike Fährmann
11ccadfd8c [schalenetwork][hdoujin] re-implement 'cbz' option (#8431) 2025-10-18 21:22:49 +02:00
Mike Fährmann
9ad937a982 [kemono] use f-strings 2025-10-18 20:33:44 +02:00
Mike Fährmann
238d0973f7 [twitter] fix "KeyError - 'source_id'" with disabled 'transform' (#8429) 2025-10-18 19:39:24 +02:00
enduser420
e2fb2c009c [reddit] support comment share link (#8434) 2025-10-18 18:41:23 +02:00
Mike Fährmann
6c71b279b6 [dt] update 'parse_datetime' calls with one argument 2025-10-17 22:49:41 +02:00
Mike Fährmann
555ac2dcfa [civitai] add 'sort' & 'period' options (#8426) 2025-10-17 20:29:10 +02:00
Mike Fährmann
4072687b0b [pixhost] force '.to' TLD (#8428) 2025-10-17 18:12:45 +02:00
Mike Fährmann
085616e0a8 [dt] replace 'text.parse_datetime()' & 'text.parse_timestamp()' 2025-10-17 17:43:06 +02:00
Mike Fährmann
e42030a3a6 [twitter] fix 'KeyError' for "temporarily unavailable" users (#8423) 2025-10-16 15:50:48 +02:00
Mike Fährmann
69f7cfdd0c [dt] replace 'datetime' imports 2025-10-16 11:42:42 +02:00
Mike Fährmann
0eb3c8a994 [dt] replace 'util' datetime functions 2025-10-15 21:30:38 +02:00
Mike Fährmann
d708181e5f [simpcity] implement login with username & password (#8418) 2025-10-15 18:35:43 +02:00
Mike Fährmann
b336049fac [bellazon] add 'num_internal' & 'num_external' metadata fields (#8415) 2025-10-15 17:25:10 +02:00
Mike Fährmann
3252ead7c7 [kemono] improve 'filename' 2025-10-15 13:13:46 +02:00
Mike Fährmann
36a3fe45e4 [subscribestar] improve 'filename' (#8416) 2025-10-15 11:52:39 +02:00
Mike Fährmann
d44a0f8094 [imagetwist] detect removed images (#8415) 2025-10-15 10:27:43 +02:00
Mike Fährmann
43448f7089 [webtoons] fix 'thumbnail' extraction (#8413) 2025-10-15 10:06:10 +02:00
Mike Fährmann
8c62be343e [output] add 'Logger.traceback()' helper 2025-10-14 18:44:29 +02:00
Mike Fährmann
ab3e34e9c3 [instagram] extract correct 'width' & 'height' for videos (#8399)
provide 'width_original' & 'height_original' metadata
2025-10-13 20:05:26 +02:00
Mike Fährmann
55821346f5 [bunkr] extract 'album_...' metadata for '/f/' URLs (#8405) 2025-10-13 19:16:37 +02:00
Mike Fährmann
6e4f9e2ce3 [pixiv] fix "KeyError: 'is_bookmarked'" (#8398) 2025-10-13 12:21:11 +02:00
Mike Fährmann
be46fac6ce [bellazon] fix errors when handling guest users (#8397) 2025-10-13 11:37:09 +02:00
Mike Fährmann
41a0d785ca [bellazon] ignore links to other threads or posts (#8392) 2025-10-12 09:37:16 +02:00
Mike Fährmann
f89f55b215 [bellazon] improve video URL regex (#8392)
match <source> elements with attributes before 'src="..."'
2025-10-12 09:37:15 +02:00
Mike Fährmann
65feed5b64 [wikimedia] ignore missing files (#8388)
Co-authored-by: ClosedPort22 <44864697+ClosedPort22@users.noreply.github.com>
2025-10-12 09:37:15 +02:00
Mike Fährmann
214acc39e6 [mangadex] fix 'RuntimeError' for titles without a 'description' (#8389)
fixes regression introduced in 0a76cbc8c7
2025-10-12 09:37:15 +02:00
Mike Fährmann
3a35a4aee4 [civitai] prevent downloading random posts from deleted users (#8299) 2025-10-11 09:09:48 +02:00
Mike Fährmann
c269339dbc [naver-blog] fix 'video' extraction (#8385)
- do not include 'data-module-v2' after regular 'data-module'
- move module load into try-except block
2025-10-10 17:21:23 +02:00
Mike Fährmann
2c0facde72 [kemono] prevent fatal exception when retrieving profile data (#8382) 2025-10-10 17:21:01 +02:00
Mike Fährmann
3f8423aaaf [dandadan] add support (#8381) 2025-10-10 00:41:01 +02:00
Mike Fährmann
b137d8e5d3 [webtoons] fix 'episode' metadata extraction (#2591)
https://github.com/mikf/gallery-dl/issues/2591#issuecomment-3386463898
2025-10-09 18:34:59 +02:00
Mike Fährmann
877ea44059 [fansly] download user posts from all account walls (#4401)
when no specific wallId is specified
2025-10-09 17:27:47 +02:00
Mike Fährmann
c700cef055 [zerochan] forward URL parameters to API requests (#8377) 2025-10-09 14:33:40 +02:00
Mike Fährmann
af0b68d533 [weibo:feed] send 'page' parameter only when passing cookies (#8357) 2025-10-09 11:22:04 +02:00
Mike Fährmann
de5fe0eea3 [weibo] overhaul cookie initialization (#8357)
detect user-provided 'SUB' & 'SUBP' cookies
2025-10-09 11:18:44 +02:00
Mike Fährmann
99d5c521d1 use 'encoding="utf-8"' when opening files in text mode (#8376) 2025-10-09 09:54:18 +02:00