Commit Graph

5653 Commits

Author SHA1 Message Date
Mike Fährmann
39b9c8d4b0 [workflows:pages] add repo check to 'deploy' job as well
of course I forgot one
a434fc7cb1
2024-07-15 18:26:49 +02:00
Mike Fährmann
51fd14f87d [gelbooru_v02] use total number of posts as end marker (#5830)
… and potentially retry on empty responses
2024-07-12 22:51:46 +02:00
Mike Fährmann
6110e3f940 [common] fix Logger names of BaseCategory extractors
update of d11ec009
fixes regressions introduced in 0c178846
2024-07-12 22:51:46 +02:00
Mike Fährmann
668219b36e [exhentai] improve error message when temporarily banned (#5845) 2024-07-12 22:51:46 +02:00
Mike Fährmann
f7383a56f8 wrap filters/conditionals in a try-except block
allows accessing undefined fields without exception or locals().get(…)
but hides mistakes/typos/etc by evaluating to False without feedback

performance loss compared to the previous version without try-except
is negligible (~20ns for me)
2024-07-12 22:51:11 +02:00
Mike Fährmann
c83c812a1e [instagram][twitter] rename 'profile' to 'info' (#5262, #3623) 2024-07-11 00:22:39 +02:00
Mike Fährmann
21831eba1e [tests] completely ignore '#auth' for 'only_matching' tests 2024-07-11 00:20:10 +02:00
Mike Fährmann
16e276fca4 [nijie] fix image URLs for single image posts (#5842)
fixes regression introduced in 2e11b6e7
2024-07-10 15:06:25 +02:00
Mike Fährmann
eb3ef13d28 include 'zstd' in Accept-Encoding header when supported
… and slightly update optional dependency list
2024-07-10 00:33:35 +02:00
Mike Fährmann
8aca0e6970 update default User-Agent header to Firefox 128 ESR 2024-07-09 20:42:06 +02:00
Mike Fährmann
8e747b6dee [twitter] send initial 'cursor' only when given via option 2024-07-09 20:42:06 +02:00
Mike Fährmann
ff39d28ef4 [twitter] fix 'user' when providing 'cursor' (#5833) 2024-07-08 23:16:47 +02:00
Mike Fährmann
65385e09cb [twitter] remove break (#5831) 2024-07-07 01:08:30 +02:00
Mike Fährmann
1656c9287d [pp:metadata] fix 'directory' when file directory has conditions (#5728) 2024-07-06 22:07:17 +02:00
Mike Fährmann
1527ad79e2 [tests] fix syntax for Python < 3.6
no f-strings
2024-07-06 18:39:59 +02:00
Mike Fährmann
da9916c01f [pp:metadata] implement format strings for 'directory' (#5728) 2024-07-06 03:08:59 +02:00
Mike Fährmann
8f3f061daf [hentainexus] fix error for spread pages (#5827) 2024-07-05 21:36:29 +02:00
Mike Fährmann
b3aded1939 add '--print-traffic' 2024-07-05 21:34:33 +02:00
Mike Fährmann
b376fa814e [zerochan] handle "KeyError - 'items'" (#5826)
Zerochan sometimes sends an empty response when there are no more
accessible posts to be had.
2024-07-05 21:34:33 +02:00
Mike Fährmann
a434fc7cb1 [workflows] only run in 'mikf/gallery-dl' repo
The actual code was included in the previous
97a50a23d2 by accident …

This commit only wraps the slightly more complex docker.yml condition
in GitHub's special ${{ … }} braces.
2024-07-05 21:33:39 +02:00
Mike Fährmann
97a50a23d2 [twitter] implement 'cursor' support (#5753) 2024-07-05 00:03:02 +02:00
Mike Fährmann
162756b684 [toyhouse] fix Content Warning bypass (#5820) 2024-07-04 22:42:36 +02:00
Mike Fährmann
e03b99ba0e [actions] emit logging messages before waiting/exiting/etc
distinguish between actions that should run before or after
a logging message gets emitted
2024-07-01 01:19:25 +02:00
Mike Fährmann
f7a6401031 [actions] move LoggerAdapter from 'output' to 'actions' 2024-06-30 20:41:51 +02:00
Mike Fährmann
f41a5065b2 [actions] support multiple actions per pattern 2024-06-30 02:36:33 +02:00
Mike Fährmann
8219a78b8d [actions] extend 'wait'
allow specifying a duration like for --sleep
2024-06-29 23:58:38 +02:00
Mike Fährmann
84b3da54aa [actions] add 'exec' action (#5619) 2024-06-29 23:02:48 +02:00
Mike Fährmann
c9860002ba [actions] add 'abort' and 'terminate' actions (#5778) 2024-06-29 19:20:17 +02:00
Mike Fährmann
d80f4fbc10 [actions] optimize empty patterns 2024-06-29 18:57:48 +02:00
Mike Fährmann
d10bfa9065 [vipergirls] improve 'thread' URL pattern
allow for query parameters and fragments at tne end of URLs
2024-06-29 17:38:57 +02:00
Mike Fährmann
ba51c1a8e4 [path] fix 1ca2cf51 2024-06-29 02:41:56 +02:00
Mike Fährmann
1ca2cf51a2 merge #5807: [path] fix moving files across drives on Windows 2024-06-29 02:37:42 +02:00
AyluinReymaer
de61b3b546 Update path.py 2024-06-29 00:58:03 +01:00
AyluinReymaer
91a989a172 path.py - fix system cannot move file to different drive
This fixes the below error message:

OSError(18, 'The system cannot move the file to a different disk drive')
2024-06-29 00:08:53 +01:00
Mike Fährmann
29eb535e18 merge #5802: [twitter] extract 'bookmark_count' and 'view_count' 2024-06-28 23:21:57 +02:00
rameerez
ee93dfeb8d Add bookmark_count and view_count to the X / Twitter extractor
- Parse `view_count` as integer in Twitter extractor
- Style fix
- optimize 'view_count' extraction
2024-06-28 23:17:11 +02:00
Mike Fährmann
c2bf4ff99c [twitter] add 'profile' extractor (#3623) 2024-06-28 22:55:48 +02:00
Mike Fährmann
44896b0296 [instagram] add 'profile' extractor (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
2024-06-28 22:54:07 +02:00
Mike Fährmann
ea81fa985f [archive] implement 'archive-event' option (#5784)
With this, IDs of skipped files will no longer be written to an archive
by default. Use "archive-event": "file,skip" to restore the previous
behavior.
2024-06-27 22:00:59 +02:00
Mike Fährmann
51fdfbe6fc [erome] extract 'date' metadata (#5796) 2024-06-27 21:07:23 +02:00
Mike Fährmann
9329c30b41 merge #5783: [subscribestar] fix 'date' parsing in updated posts 2024-06-27 18:12:05 +02:00
Mike Fährmann
ea7ccb55a1 merge #5781: [cookies] add 'thorium' support 2024-06-27 17:58:39 +02:00
joskezelensky
b2a40a5b93 add thorium cookies support
- Update cookies.py
- preserve lexicographical order
2024-06-27 17:56:53 +02:00
Arased
03486599af Fix subscribestar date parsing in udated posts 2024-06-24 16:40:59 +02:00
Mike Fährmann
0bb8831853 [twitter] fix 'username-alt' option name (#5715) 2024-06-22 17:49:58 +02:00
Mike Fährmann
8bb793e21b release version 1.27.1 2024-06-22 17:11:44 +02:00
Mike Fährmann
e1dbb4cbe1 [workflows:tests] restrict Python 3.12 to '3.12.3'
The changes from .3 to .4 seem to cause errors when running flake8
2024-06-22 16:18:58 +02:00
Mike Fährmann
606202fb04 [fanbox] remove debug code (#5759) 2024-06-21 21:05:01 +02:00
Mike Fährmann
8f50c04af2 [formatter] implement 'X' format specifier (#5770) 2024-06-21 20:56:19 +02:00
Mike Fährmann
b707b31264 merge #5774: [tcbscans] support other domains 2024-06-21 19:06:11 +02:00