github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,720 Commits 1 Branch 0 Tags
811b665e33d807469b60b7984f3532201b2a2d4d
Commit Graph

6156 Commits

Author SHA1 Message Date
Mike Fährmann
811b665e33 remove @staticmethod decorators 
There might have been a time when calling a static method was faster
than a regular method, but that is no longer the case. According to
micro-benchmarks, it is 70% slower in CPython 3.13 and it also makes
executing the code of a class definition slower.
 2025-06-12 22:50:52 +02:00
Mike Fährmann
8b6bc54e95 [dl:http] add MIME type and signature for .html files 2025-06-12 21:16:34 +02:00
Mike Fährmann
e41c317039 [fantia] prevent '.html' file downloads 2025-06-12 20:41:47 +02:00
Mike Fährmann
e2d104a110 [twitter] extract 'source_id' and 'source_user' metadata (#7470 #7640) 2025-06-12 18:59:22 +02:00
Mike Fährmann
06e2f2cd91 [twitter] restructure media data extraction 2025-06-12 18:53:15 +02:00
Mike Fährmann
56ea27c474 [blogger] move original/s0 URL code into a separate function 2025-06-12 17:07:56 +02:00
Mike Fährmann
e0a961047c [dl:http] fix potential FileExistsError when '.part' file moved (#5385) 
when the downloader detects a '.part' file and attempts to resume its
download, a FileExistsError was raised while trying to create an assumed
missing directory path when said '.part' file was (re)moved during the
time it was detected and the downloader attempted to open it in 'a+b' mode.
 2025-06-12 16:44:41 +02:00
Mike Fährmann
5b60c66e0f [path] support multiple characters in path-restrict objects (#1707) 2025-06-12 15:29:13 +02:00
Mike Fährmann
16fc5e0d68 [batoto] fix downloading manga with alerts/notices (#7657) 
and improve alert message extraction
 2025-06-12 08:26:26 +02:00
Mike Fährmann
a14671992c [sexcom] prevent '.css' file downloads (#7632) 
by detecting homepage redirects
and improve redirect handling in general
 2025-06-11 22:32:08 +02:00
Mike Fährmann
0df083b208 [vk] prevent '404 Not Found' errors for file downloads 
only strip query parameters when regex substitution applies
 2025-06-11 22:32:08 +02:00
Mike Fährmann
d065452ba3 merge #7653: [archivedmoe] fix redirection issue (#7652) 2025-06-11 20:04:42 +02:00
Mike Fährmann
80599fa610 [vk] fix 'user' metadata extraction 
add boolean 'group' field
 2025-06-11 20:01:27 +02:00
NecRaul
e3df99dbb9 Apply mikf's diff regarding Archived.moe 
Moved (and refactored) code into remote()
Added a check for fixup_timestamp
 2025-06-11 21:51:03 +04:00
Mike Fährmann
85931185a6 [vk] add continuation message (#7650) 2025-06-11 18:07:39 +02:00
Mike Fährmann
8287a1b372 [vk] detect redirects to 'challenge' pages (#7650) 2025-06-11 18:02:14 +02:00
NecRaul
4370654532 Simplify remote_media_link assignment 2025-06-11 04:49:21 +04:00
NecRaul
cb74d0f2f3 Lint with flake8 2025-06-11 04:46:18 +04:00
NecRaul
96bb2b1630 Fix Archived.moe redirection issue 
Unless the board is /b/ (in which case redirection works fine),
remove the characters of the filename portion of the url until
filename portion of the url is 13 characters long (epoch millis).
 2025-06-11 04:42:03 +04:00
Mike Fährmann
b4aed5e2c9 [common] allow overriding 'user-agent' when 'browser' is used (#7647) 2025-06-10 22:05:28 +02:00
Mike Fährmann
8e698d1a64 [ytdl] set domain as subcategory when using Generic extractor (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-2959879730
 2025-06-10 21:35:15 +02:00
Mike Fährmann
4cfddc144a [common] import 'datetime' class directly 2025-06-10 21:35:15 +02:00
Mike Fährmann
e68555defa [common] improve cookie-related logging messages 2025-06-10 21:34:27 +02:00
Mike Fährmann
511cf2363c [common] update expired cookie messages (#7644) 
- prefix with 'cookies:'
- include domain
- include exact time when it expired
 2025-06-09 18:48:04 +02:00
Mike Fährmann
7a48b696a6 [dl] improve maximum 'rate' detection (#7638) 2025-06-09 12:15:39 +02:00
Mike Fährmann
5f41ac4257 [4archive] fix 'thread' extractor 2025-06-08 21:52:54 +02:00
Mike Fährmann
a25e14e776 [dl:http] implement dynamic download 'rate' limits (#7638) 2025-06-08 20:04:31 +02:00
Mike Fährmann
e84df260c0 [util] generalize 'build_duration_func' 2025-06-08 20:01:16 +02:00
Mike Fährmann
827eeca0bc [paheal] fix '404 Not Found' for tags with URL encoded characters (#7642) 2025-06-08 16:23:11 +02:00
Mike Fährmann
17d39c06e3 [exhentai] implement '"source": "metadata"' (#4902) 2025-06-08 12:57:23 +02:00
Mike Fährmann
967af5eede [exhentai] add 'limits-action' option (#6504) 
https://github.com/mikf/gallery-dl/issues/6504#issuecomment-2949551532
 2025-06-08 12:56:56 +02:00
Mike Fährmann
3b75b195c1 [exhentai] detect HTML downloads (#4798) 2025-06-07 22:06:53 +02:00
Mike Fährmann
483e30d846 [dl:http] allow '_http_signature' to return a custom error message 
… and fail the download immediately like '_http_validate'
 2025-06-07 22:06:00 +02:00
Mike Fährmann
27c48ad317 [exhentai] ensure file signature bytes aren't all zero (#4902) 2025-06-07 20:34:05 +02:00
Mike Fährmann
839a43fe5c [dl:http] implement '_http_signature' (#4902) 
allows passing a function to validate a file's signature bytes,
similar to '_http_validate'
 2025-06-07 20:27:59 +02:00
Mike Fährmann
f51511155e [dl:http] include traceback in exception debug log 2025-06-07 20:24:08 +02:00
Mike Fährmann
8227e21257 [deviantart:tiptap] fix TypeError when 'textAlign' is null (#7639) 2025-06-07 19:06:43 +02:00
Mike Fährmann
6e120f2551 [danbooru] fix Ugoira for instances without 'Ugoira:FrameMimeType' 
(#7630)

fixes regression introduced in 1866f8b97b
 2025-06-07 07:47:03 +02:00
Mike Fährmann
3e423937d2 [misskey] implement 'include' option (#5347) 2025-06-06 20:52:03 +02:00
Mike Fährmann
5cd3f3977e [misskey] add 'info' extractor (#5347) 2025-06-06 20:21:52 +02:00
Mike Fährmann
ac09cac978 [misskey] add 'avatar' and 'background' extractors (#5347) 2025-06-06 20:14:05 +02:00
Mike Fährmann
9c4cef822e [komikcast] update domain to 'komikcast02.com' 2025-06-06 20:14:02 +02:00
Mike Fährmann
15f5e567ec [mangaread] fix 'manga_alt' metadata 2025-06-06 13:25:29 +02:00
Mike Fährmann
b5c88b3d3e replace standard library 're' uses with 'util.re()' 2025-06-06 13:24:52 +02:00
Mike Fährmann
e1f03a5a93 [util] allow 'noop()' to accept one optional argument 
fixes 'NullResponse.close()'
 2025-06-05 20:08:24 +02:00
Mike Fährmann
8dace96af3 [twitter] simplify 'expand' & 'unique' init code 2025-06-05 15:33:47 +02:00
Mike Fährmann
72a01bc4d4 [common] use util.re_compile() in _dump_response 2025-06-05 15:24:22 +02:00
Mike Fährmann
d7d99d5606 [behance] fix '403 Forbidden' errors 2025-06-05 14:25:07 +02:00
Mike Fährmann
efd49aef73 allow using predefined Firefox/Chrome 'headers' & 'ciphers' 2025-06-05 14:24:38 +02:00
Mike Fährmann
1866f8b97b [danbooru] fix Ugoira conversions for posts without 'ZIP:ZipFileName' 
get frame extension from 'Ugoira:FrameMimeType' instead

(#7630)
5919696271
 2025-06-05 09:13:25 +02:00