Commit Graph

5688 Commits

Author SHA1 Message Date
Mike Fährmann
304bb4bbb8 merge #5887: [imagefap] add '{num}' to default filenames (#1746) 2024-07-27 09:26:48 +02:00
ShruggZoltan
20f670c3b6 Reduce default numbering to 4 digits of zero-padding. 2024-07-27 01:11:50 +00:00
Mike Fährmann
0fcd603498 [warosu] fix extraction 2024-07-26 21:09:07 +02:00
Mike Fährmann
d7a2c73274 [util] let a CustomNone instance be equal to itself 2024-07-26 20:56:01 +02:00
Mike Fährmann
8ecd408f53 add '-J/--resolve-json' command-line option (#5864) 2024-07-26 20:41:35 +02:00
Mike Fährmann
70f18b7a78 [zerochan] fix tag redirections (#5891) 2024-07-26 20:41:34 +02:00
Mike Fährmann
b5e141ed6e [sankakucomplex] update domain to 'news.sankakucomplex.com' 2024-07-26 20:39:55 +02:00
ShruggZoltan
db2a61ba08 Numbers images obtained from imagefap by default. 2024-07-26 06:04:10 +00:00
Mike Fährmann
f321272b7c [ytdl] fix --cookies-from-browser option parsing 2024-07-25 17:45:25 +02:00
Mike Fährmann
540eaa5add [tumblr] implement 'pagination' option (#5880)
restore pagination behavior from before
de670bd7de
2024-07-23 20:31:04 +02:00
Mike Fährmann
7b445ec255 [readcomiconline] update (#5866) 2024-07-23 18:56:49 +02:00
Mike Fährmann
5207a0c2e0 [zerochan] implement 'tags' option (#5874)
allow splitting tags into separate lists by category
2024-07-23 10:21:33 +02:00
Mike Fährmann
1aadc29c5b [zerochan] fix 'source' extraction 2024-07-23 09:34:44 +02:00
Mike Fährmann
ae40c61c21 [zerochan] fix tag category extraction (#5874) 2024-07-23 09:16:32 +02:00
Mike Fährmann
5f6d20c595 [tests] remove internal extractor check
revert 60a2fefedd.
2024-07-22 18:40:02 +02:00
Mike Fährmann
3eba1f7c29 [tests] load results from ${GDL_TEST_RESULTS} (#5262) 2024-07-22 18:35:50 +02:00
Mike Fährmann
3b26748264 [inkbunny:following] fix infinite loop
happens when number of watched users is a multiple of 20
2024-07-22 17:59:58 +02:00
Mike Fährmann
db9833c28a merge #5870: [aryion] add 'favorite' extractor (#4511) 2024-07-21 12:37:47 +02:00
Mike Fährmann
156a70bec0 [aryion] update favorite extractor
- add test case
- add docs/supportedsites entry
- add custom directory_fmt and archive_fmt
- remove constructor
- appease flake8
2024-07-21 12:34:06 +02:00
Mike Fährmann
36a64a3aa7 [behance] fix image extraction (#5873) 2024-07-21 10:54:12 +02:00
Mike Fährmann
727e53f513 [bunkr] support 'bunkr.fi' URLs (#5872) 2024-07-21 06:41:50 +02:00
walkenjoyer
19e98ef8e9 [aryion] Add favorite extractor (#4511) 2024-07-20 18:49:59 +02:00
Mike Fährmann
a595949840 [8chan] update 'TOS' cookie name (#5868) 2024-07-20 02:15:29 +02:00
Mike Fährmann
fef80a2f55 [zerochan] fetch metadata for each post separately (#5869)
instead of processing all posts at once before returning any of them
2024-07-20 02:11:27 +02:00
Mike Fährmann
84a634fc14 [job] add 'resolve' argument to DataJob (#5864) 2024-07-19 14:32:42 +02:00
Mike Fährmann
287a7d13cf [sankaku] implement 'notes' extraction (#5865) 2024-07-18 20:44:49 +02:00
Mike Fährmann
7d5415c201 [workflow:executables] restrict 'setuptools' to <71
setuptools 71 together with secretstorage dependencies
causees an ImportErrorWhenRunningHook exception in PyInstaller
for whatever reason
2024-07-18 02:24:52 +02:00
Mike Fährmann
026e0b97db merge #5824: [furaffinity] add 'folders' and 'thumbnail' (#1284) 2024-07-18 01:41:15 +02:00
Mike Fährmann
9a8ec95398 [furaffinity] improve 2024-07-18 01:39:58 +02:00
Mike Fährmann
60a2fefedd [tests] restrict 'test_unique_pattern_matches' to internal extractors
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2231649983
2024-07-17 23:35:41 +02:00
Mike Fährmann
3fa74ca4d7 [tests] enable test results for external extractors (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2231649983
2024-07-17 22:29:09 +02:00
Mike Fährmann
6940ad0e72 [booru] allow multiple 'url' keys (#5859) 2024-07-17 20:49:52 +02:00
Mike Fährmann
bf44add132 [booru] prevent crash when file URL is empty (#5859)
- catch all exceptions, including IndexError,  and not just a select few
- change logging message level to  warning
2024-07-17 20:20:17 +02:00
Mike Fährmann
39b9c8d4b0 [workflows:pages] add repo check to 'deploy' job as well
of course I forgot one
a434fc7cb1
2024-07-15 18:26:49 +02:00
Mike Fährmann
51fd14f87d [gelbooru_v02] use total number of posts as end marker (#5830)
… and potentially retry on empty responses
2024-07-12 22:51:46 +02:00
Mike Fährmann
6110e3f940 [common] fix Logger names of BaseCategory extractors
update of d11ec009
fixes regressions introduced in 0c178846
2024-07-12 22:51:46 +02:00
Mike Fährmann
668219b36e [exhentai] improve error message when temporarily banned (#5845) 2024-07-12 22:51:46 +02:00
Mike Fährmann
f7383a56f8 wrap filters/conditionals in a try-except block
allows accessing undefined fields without exception or locals().get(…)
but hides mistakes/typos/etc by evaluating to False without feedback

performance loss compared to the previous version without try-except
is negligible (~20ns for me)
2024-07-12 22:51:11 +02:00
Mike Fährmann
c83c812a1e [instagram][twitter] rename 'profile' to 'info' (#5262, #3623) 2024-07-11 00:22:39 +02:00
Mike Fährmann
21831eba1e [tests] completely ignore '#auth' for 'only_matching' tests 2024-07-11 00:20:10 +02:00
Mike Fährmann
16e276fca4 [nijie] fix image URLs for single image posts (#5842)
fixes regression introduced in 2e11b6e7
2024-07-10 15:06:25 +02:00
Mike Fährmann
eb3ef13d28 include 'zstd' in Accept-Encoding header when supported
… and slightly update optional dependency list
2024-07-10 00:33:35 +02:00
Mike Fährmann
8aca0e6970 update default User-Agent header to Firefox 128 ESR 2024-07-09 20:42:06 +02:00
Mike Fährmann
8e747b6dee [twitter] send initial 'cursor' only when given via option 2024-07-09 20:42:06 +02:00
Mike Fährmann
ff39d28ef4 [twitter] fix 'user' when providing 'cursor' (#5833) 2024-07-08 23:16:47 +02:00
Mike Fährmann
65385e09cb [twitter] remove break (#5831) 2024-07-07 01:08:30 +02:00
Mike Fährmann
1656c9287d [pp:metadata] fix 'directory' when file directory has conditions (#5728) 2024-07-06 22:07:17 +02:00
Mike Fährmann
1527ad79e2 [tests] fix syntax for Python < 3.6
no f-strings
2024-07-06 18:39:59 +02:00
Mike Fährmann
da9916c01f [pp:metadata] implement format strings for 'directory' (#5728) 2024-07-06 03:08:59 +02:00
Mike Fährmann
8f3f061daf [hentainexus] fix error for spread pages (#5827) 2024-07-05 21:36:29 +02:00