Mike Fährmann
0df083b208
[vk] prevent '404 Not Found' errors for file downloads
...
only strip query parameters when regex substitution applies
2025-06-11 22:32:08 +02:00
Mike Fährmann
d065452ba3
merge #7653 : [archivedmoe] fix redirection issue ( #7652 )
2025-06-11 20:04:42 +02:00
Mike Fährmann
80599fa610
[vk] fix 'user' metadata extraction
...
add boolean 'group' field
2025-06-11 20:01:27 +02:00
NecRaul
e3df99dbb9
Apply mikf's diff regarding Archived.moe
...
Moved (and refactored) code into remote()
Added a check for fixup_timestamp
2025-06-11 21:51:03 +04:00
Mike Fährmann
85931185a6
[vk] add continuation message ( #7650 )
2025-06-11 18:07:39 +02:00
Mike Fährmann
8287a1b372
[vk] detect redirects to 'challenge' pages ( #7650 )
2025-06-11 18:02:14 +02:00
Mike Fährmann
8645be8244
[archivedmoe] add redirect URL fixup test
2025-06-11 12:10:18 +02:00
NecRaul
4370654532
Simplify remote_media_link assignment
2025-06-11 04:49:21 +04:00
NecRaul
cb74d0f2f3
Lint with flake8
2025-06-11 04:46:18 +04:00
NecRaul
96bb2b1630
Fix Archived.moe redirection issue
...
Unless the board is /b/ (in which case redirection works fine),
remove the characters of the filename portion of the url until
filename portion of the url is 13 characters long (epoch millis).
2025-06-11 04:42:03 +04:00
Mike Fährmann
9348c9ce25
[workflows:executables] update to 'windows-2022'
...
'windows-2019' will no longer be supported by 2025-06-30
https://github.com/actions/runner-images/issues/12045
2025-06-10 22:59:18 +02:00
Mike Fährmann
b4aed5e2c9
[common] allow overriding 'user-agent' when 'browser' is used ( #7647 )
2025-06-10 22:05:28 +02:00
Mike Fährmann
8e698d1a64
[ytdl] set domain as subcategory when using Generic extractor ( #6582 )
...
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-2959879730
2025-06-10 21:35:15 +02:00
Mike Fährmann
4cfddc144a
[common] import 'datetime' class directly
2025-06-10 21:35:15 +02:00
Mike Fährmann
e68555defa
[common] improve cookie-related logging messages
2025-06-10 21:34:27 +02:00
Mike Fährmann
511cf2363c
[common] update expired cookie messages ( #7644 )
...
- prefix with 'cookies:'
- include domain
- include exact time when it expired
2025-06-09 18:48:04 +02:00
Mike Fährmann
7a48b696a6
[dl] improve maximum 'rate' detection ( #7638 )
2025-06-09 12:15:39 +02:00
Mike Fährmann
5f41ac4257
[4archive] fix 'thread' extractor
2025-06-08 21:52:54 +02:00
Mike Fährmann
a25e14e776
[dl:http] implement dynamic download 'rate' limits ( #7638 )
2025-06-08 20:04:31 +02:00
Mike Fährmann
e84df260c0
[util] generalize 'build_duration_func'
2025-06-08 20:01:16 +02:00
Mike Fährmann
cc48cddf68
use pip for 'make install' ( #7628 )
2025-06-08 19:22:32 +02:00
Mike Fährmann
827eeca0bc
[paheal] fix '404 Not Found' for tags with URL encoded characters ( #7642 )
2025-06-08 16:23:11 +02:00
Mike Fährmann
17d39c06e3
[exhentai] implement '"source": "metadata"' ( #4902 )
2025-06-08 12:57:23 +02:00
Mike Fährmann
967af5eede
[exhentai] add 'limits-action' option ( #6504 )
...
https://github.com/mikf/gallery-dl/issues/6504#issuecomment-2949551532
2025-06-08 12:56:56 +02:00
Mike Fährmann
f0f118d350
merge #7641 : [docs] update 'output.mode' description
...
Update auto output mode documentation to reflect implementation
2025-06-08 08:20:50 +02:00
Rodrigo Damazio Bovendorp
aed35c6d7b
[docs] Update auto output mode documentation to reflect implementation
2025-06-07 21:19:21 -07:00
Mike Fährmann
3b75b195c1
[exhentai] detect HTML downloads ( #4798 )
2025-06-07 22:06:53 +02:00
Mike Fährmann
483e30d846
[dl:http] allow '_http_signature' to return a custom error message
...
… and fail the download immediately like '_http_validate'
2025-06-07 22:06:00 +02:00
Mike Fährmann
27c48ad317
[exhentai] ensure file signature bytes aren't all zero ( #4902 )
2025-06-07 20:34:05 +02:00
Mike Fährmann
839a43fe5c
[dl:http] implement '_http_signature' ( #4902 )
...
allows passing a function to validate a file's signature bytes,
similar to '_http_validate'
2025-06-07 20:27:59 +02:00
Mike Fährmann
f51511155e
[dl:http] include traceback in exception debug log
2025-06-07 20:24:08 +02:00
Mike Fährmann
8227e21257
[deviantart:tiptap] fix TypeError when 'textAlign' is null ( #7639 )
2025-06-07 19:06:43 +02:00
Mike Fährmann
b95b71f63f
[tests:results] implement general tests for list items
2025-06-07 10:36:43 +02:00
Mike Fährmann
fc01d85823
[tests:results] split '_test_kwdict()'
2025-06-07 10:16:47 +02:00
Mike Fährmann
6e120f2551
[danbooru] fix Ugoira for instances without 'Ugoira:FrameMimeType'
...
(#7630 )
fixes regression introduced in 1866f8b97b
2025-06-07 07:47:03 +02:00
Mike Fährmann
3e423937d2
[misskey] implement 'include' option ( #5347 )
2025-06-06 20:52:03 +02:00
Mike Fährmann
5cd3f3977e
[misskey] add 'info' extractor ( #5347 )
2025-06-06 20:21:52 +02:00
Mike Fährmann
ac09cac978
[misskey] add 'avatar' and 'background' extractors ( #5347 )
2025-06-06 20:14:05 +02:00
Mike Fährmann
9c4cef822e
[komikcast] update domain to 'komikcast02.com'
2025-06-06 20:14:02 +02:00
Mike Fährmann
15f5e567ec
[mangaread] fix 'manga_alt' metadata
2025-06-06 13:25:29 +02:00
Mike Fährmann
b5c88b3d3e
replace standard library 're' uses with 'util.re()'
2025-06-06 13:24:52 +02:00
Mike Fährmann
e1f03a5a93
[util] allow 'noop()' to accept one optional argument
...
fixes 'NullResponse.close()'
2025-06-05 20:08:24 +02:00
Mike Fährmann
8dace96af3
[twitter] simplify 'expand' & 'unique' init code
2025-06-05 15:33:47 +02:00
Mike Fährmann
72a01bc4d4
[common] use util.re_compile() in _dump_response
2025-06-05 15:24:22 +02:00
Mike Fährmann
d7d99d5606
[behance] fix '403 Forbidden' errors
2025-06-05 14:25:07 +02:00
Mike Fährmann
efd49aef73
allow using predefined Firefox/Chrome 'headers' & 'ciphers'
2025-06-05 14:24:38 +02:00
Mike Fährmann
1866f8b97b
[danbooru] fix Ugoira conversions for posts without 'ZIP:ZipFileName'
...
get frame extension from 'Ugoira:FrameMimeType' instead
(#7630 )
5919696271
2025-06-05 09:13:25 +02:00
Mike Fährmann
85124fe251
[common] add 'request_json()' convenience function
2025-06-05 09:13:25 +02:00
Mike Fährmann
a7bbccbd7b
[common] add 'request_xml()' convenience function
2025-06-04 23:10:16 +02:00
Mike Fährmann
38116ce04c
[docs] add 'discord' options to gallery-dl.conf
2025-06-04 21:29:15 +02:00