github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,737 Commits 1 Branch 0 Tags
3bc6bc7c7778bdbdd93c09a8464d3934188f9d50
Commit Graph

4997 Commits

Author SHA1 Message Date
NecRaul
3bc6bc7c77 [warosu] Single quotes when string has a quotation mark 2025-06-16 12:50:20 +04:00
NecRaul
f56e810f42 [warosu] Attribute fix 2025-06-16 12:33:16 +04:00
Mike Fährmann
0a3fac2dfe merge #7664: [archivedmoe] redirect URL fixes (#7652) 2025-06-15 10:03:34 +02:00
Mike Fährmann
b245218c1d [archivedmoe] reword some comments and variable names 2025-06-15 10:00:45 +02:00
hunter-gatherer8
96f5cfb305 [girlswithmuscle] add support (#4493 #6016) 
* [girlswithmuscle] init
* [girlswithmuscle]: fix metadata extraction (site layout change)
* [girlswithmuscle]: fix tags extraction (site layout change)
* update login code
* update 'post' extractor
* update 'gallery' extractor, rename to 'search' extractor
* update docs
* add test cases

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-06-14 23:05:49 +02:00
Mike Fährmann
b583891df6 [pixiv] remove '/jump.php' from *all* AJAX caption links (#4327) 
https://github.com/mikf/gallery-dl/issues/4327#issuecomment-2969765775
 2025-06-13 21:10:51 +02:00
NecRaul
6668acf91e [archivedmoe] Sort boards alphabetically 2025-06-13 19:29:47 +04:00
NecRaul
3a4e19d284 [archivedmoe] Simplify board extraction from url 2025-06-13 18:44:02 +04:00
NecRaul
a7aa18a8c1 [archivedmoe] remove unnecessary logging 2025-06-13 18:28:21 +04:00
NecRaul
8b2adeb41e [archivedmoe] simplify board URL redirection logic 2025-06-13 18:26:39 +04:00
NecRaul
05081dea2e Lint with flake8 2025-06-13 17:56:43 +04:00
NecRaul
223fe960a0 [archivedmoe] redirect URL changes (again) 
Redirects to warosu.org instead of 4chan's cdn for certain boards
Redirects to archive.4plebs.org instead of 4chan's cdn for /tg/
Slices the filename only if it's redirecting to certain archives
 2025-06-13 17:43:16 +04:00
Mike Fährmann
9d3cf67f3e [pinterest] remove excess whitespace from 'description' fields (#4335) 
and 'closeup_unified_description' & 'closeup_description'
 2025-06-13 13:11:18 +02:00
Mike Fährmann
e08ec7e083 update copyright notices 2025-06-13 00:03:41 +02:00
Mike Fährmann
811b665e33 remove @staticmethod decorators 
There might have been a time when calling a static method was faster
than a regular method, but that is no longer the case. According to
micro-benchmarks, it is 70% slower in CPython 3.13 and it also makes
executing the code of a class definition slower.
 2025-06-12 22:50:52 +02:00
Mike Fährmann
e41c317039 [fantia] prevent '.html' file downloads 2025-06-12 20:41:47 +02:00
Mike Fährmann
e2d104a110 [twitter] extract 'source_id' and 'source_user' metadata (#7470 #7640) 2025-06-12 18:59:22 +02:00
Mike Fährmann
06e2f2cd91 [twitter] restructure media data extraction 2025-06-12 18:53:15 +02:00
Mike Fährmann
56ea27c474 [blogger] move original/s0 URL code into a separate function 2025-06-12 17:07:56 +02:00
Mike Fährmann
16fc5e0d68 [batoto] fix downloading manga with alerts/notices (#7657) 
and improve alert message extraction
 2025-06-12 08:26:26 +02:00
Mike Fährmann
a14671992c [sexcom] prevent '.css' file downloads (#7632) 
by detecting homepage redirects
and improve redirect handling in general
 2025-06-11 22:32:08 +02:00
Mike Fährmann
0df083b208 [vk] prevent '404 Not Found' errors for file downloads 
only strip query parameters when regex substitution applies
 2025-06-11 22:32:08 +02:00
Mike Fährmann
d065452ba3 merge #7653: [archivedmoe] fix redirection issue (#7652) 2025-06-11 20:04:42 +02:00
Mike Fährmann
80599fa610 [vk] fix 'user' metadata extraction 
add boolean 'group' field
 2025-06-11 20:01:27 +02:00
NecRaul
e3df99dbb9 Apply mikf's diff regarding Archived.moe 
Moved (and refactored) code into remote()
Added a check for fixup_timestamp
 2025-06-11 21:51:03 +04:00
Mike Fährmann
85931185a6 [vk] add continuation message (#7650) 2025-06-11 18:07:39 +02:00
Mike Fährmann
8287a1b372 [vk] detect redirects to 'challenge' pages (#7650) 2025-06-11 18:02:14 +02:00
NecRaul
4370654532 Simplify remote_media_link assignment 2025-06-11 04:49:21 +04:00
NecRaul
cb74d0f2f3 Lint with flake8 2025-06-11 04:46:18 +04:00
NecRaul
96bb2b1630 Fix Archived.moe redirection issue 
Unless the board is /b/ (in which case redirection works fine),
remove the characters of the filename portion of the url until
filename portion of the url is 13 characters long (epoch millis).
 2025-06-11 04:42:03 +04:00
Mike Fährmann
b4aed5e2c9 [common] allow overriding 'user-agent' when 'browser' is used (#7647) 2025-06-10 22:05:28 +02:00
Mike Fährmann
8e698d1a64 [ytdl] set domain as subcategory when using Generic extractor (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-2959879730
 2025-06-10 21:35:15 +02:00
Mike Fährmann
4cfddc144a [common] import 'datetime' class directly 2025-06-10 21:35:15 +02:00
Mike Fährmann
e68555defa [common] improve cookie-related logging messages 2025-06-10 21:34:27 +02:00
Mike Fährmann
511cf2363c [common] update expired cookie messages (#7644) 
- prefix with 'cookies:'
- include domain
- include exact time when it expired
 2025-06-09 18:48:04 +02:00
Mike Fährmann
5f41ac4257 [4archive] fix 'thread' extractor 2025-06-08 21:52:54 +02:00
Mike Fährmann
827eeca0bc [paheal] fix '404 Not Found' for tags with URL encoded characters (#7642) 2025-06-08 16:23:11 +02:00
Mike Fährmann
17d39c06e3 [exhentai] implement '"source": "metadata"' (#4902) 2025-06-08 12:57:23 +02:00
Mike Fährmann
967af5eede [exhentai] add 'limits-action' option (#6504) 
https://github.com/mikf/gallery-dl/issues/6504#issuecomment-2949551532
 2025-06-08 12:56:56 +02:00
Mike Fährmann
3b75b195c1 [exhentai] detect HTML downloads (#4798) 2025-06-07 22:06:53 +02:00
Mike Fährmann
27c48ad317 [exhentai] ensure file signature bytes aren't all zero (#4902) 2025-06-07 20:34:05 +02:00
Mike Fährmann
8227e21257 [deviantart:tiptap] fix TypeError when 'textAlign' is null (#7639) 2025-06-07 19:06:43 +02:00
Mike Fährmann
6e120f2551 [danbooru] fix Ugoira for instances without 'Ugoira:FrameMimeType' 
(#7630)

fixes regression introduced in 1866f8b97b
 2025-06-07 07:47:03 +02:00
Mike Fährmann
3e423937d2 [misskey] implement 'include' option (#5347) 2025-06-06 20:52:03 +02:00
Mike Fährmann
5cd3f3977e [misskey] add 'info' extractor (#5347) 2025-06-06 20:21:52 +02:00
Mike Fährmann
ac09cac978 [misskey] add 'avatar' and 'background' extractors (#5347) 2025-06-06 20:14:05 +02:00
Mike Fährmann
9c4cef822e [komikcast] update domain to 'komikcast02.com' 2025-06-06 20:14:02 +02:00
Mike Fährmann
15f5e567ec [mangaread] fix 'manga_alt' metadata 2025-06-06 13:25:29 +02:00
Mike Fährmann
b5c88b3d3e replace standard library 're' uses with 'util.re()' 2025-06-06 13:24:52 +02:00
Mike Fährmann
8dace96af3 [twitter] simplify 'expand' & 'unique' init code 2025-06-05 15:33:47 +02:00