Commit Graph

4176 Commits

Author SHA1 Message Date
Mike Fährmann
aa6d00613f [cien] initial support (#2885, #4103, #5240) 2024-07-28 19:27:12 +02:00
Mike Fährmann
65d7cccaf9 merge #5899: [redgifs] support URLs with numeric IDs (#5898) 2024-07-28 12:35:57 +02:00
Mike Fährmann
c9aeedeafd [koharu] add 'gallery' and 'search' extractors (#5893, #4707) 2024-07-28 12:22:18 +02:00
reasonabledoubt
f8a7a61f67 Update redgifs.py to include 0-9 regex 2024-07-28 02:34:17 -04:00
Mike Fährmann
226ead728e [agnph] add 'tag' and 'post' extractors (#5284, #5890) 2024-07-27 12:17:47 +02:00
Mike Fährmann
304bb4bbb8 merge #5887: [imagefap] add '{num}' to default filenames (#1746) 2024-07-27 09:26:48 +02:00
ShruggZoltan
20f670c3b6 Reduce default numbering to 4 digits of zero-padding. 2024-07-27 01:11:50 +00:00
Mike Fährmann
0fcd603498 [warosu] fix extraction 2024-07-26 21:09:07 +02:00
Mike Fährmann
70f18b7a78 [zerochan] fix tag redirections (#5891) 2024-07-26 20:41:34 +02:00
Mike Fährmann
b5e141ed6e [sankakucomplex] update domain to 'news.sankakucomplex.com' 2024-07-26 20:39:55 +02:00
ShruggZoltan
db2a61ba08 Numbers images obtained from imagefap by default. 2024-07-26 06:04:10 +00:00
Mike Fährmann
540eaa5add [tumblr] implement 'pagination' option (#5880)
restore pagination behavior from before
de670bd7de
2024-07-23 20:31:04 +02:00
Mike Fährmann
7b445ec255 [readcomiconline] update (#5866) 2024-07-23 18:56:49 +02:00
Mike Fährmann
5207a0c2e0 [zerochan] implement 'tags' option (#5874)
allow splitting tags into separate lists by category
2024-07-23 10:21:33 +02:00
Mike Fährmann
1aadc29c5b [zerochan] fix 'source' extraction 2024-07-23 09:34:44 +02:00
Mike Fährmann
ae40c61c21 [zerochan] fix tag category extraction (#5874) 2024-07-23 09:16:32 +02:00
Mike Fährmann
3b26748264 [inkbunny:following] fix infinite loop
happens when number of watched users is a multiple of 20
2024-07-22 17:59:58 +02:00
Mike Fährmann
db9833c28a merge #5870: [aryion] add 'favorite' extractor (#4511) 2024-07-21 12:37:47 +02:00
Mike Fährmann
156a70bec0 [aryion] update favorite extractor
- add test case
- add docs/supportedsites entry
- add custom directory_fmt and archive_fmt
- remove constructor
- appease flake8
2024-07-21 12:34:06 +02:00
Mike Fährmann
36a64a3aa7 [behance] fix image extraction (#5873) 2024-07-21 10:54:12 +02:00
Mike Fährmann
727e53f513 [bunkr] support 'bunkr.fi' URLs (#5872) 2024-07-21 06:41:50 +02:00
walkenjoyer
19e98ef8e9 [aryion] Add favorite extractor (#4511) 2024-07-20 18:49:59 +02:00
Mike Fährmann
a595949840 [8chan] update 'TOS' cookie name (#5868) 2024-07-20 02:15:29 +02:00
Mike Fährmann
fef80a2f55 [zerochan] fetch metadata for each post separately (#5869)
instead of processing all posts at once before returning any of them
2024-07-20 02:11:27 +02:00
Mike Fährmann
287a7d13cf [sankaku] implement 'notes' extraction (#5865) 2024-07-18 20:44:49 +02:00
Mike Fährmann
026e0b97db merge #5824: [furaffinity] add 'folders' and 'thumbnail' (#1284) 2024-07-18 01:41:15 +02:00
Mike Fährmann
9a8ec95398 [furaffinity] improve 2024-07-18 01:39:58 +02:00
Mike Fährmann
6940ad0e72 [booru] allow multiple 'url' keys (#5859) 2024-07-17 20:49:52 +02:00
Mike Fährmann
bf44add132 [booru] prevent crash when file URL is empty (#5859)
- catch all exceptions, including IndexError,  and not just a select few
- change logging message level to  warning
2024-07-17 20:20:17 +02:00
Mike Fährmann
51fd14f87d [gelbooru_v02] use total number of posts as end marker (#5830)
… and potentially retry on empty responses
2024-07-12 22:51:46 +02:00
Mike Fährmann
6110e3f940 [common] fix Logger names of BaseCategory extractors
update of d11ec009
fixes regressions introduced in 0c178846
2024-07-12 22:51:46 +02:00
Mike Fährmann
668219b36e [exhentai] improve error message when temporarily banned (#5845) 2024-07-12 22:51:46 +02:00
Mike Fährmann
c83c812a1e [instagram][twitter] rename 'profile' to 'info' (#5262, #3623) 2024-07-11 00:22:39 +02:00
Mike Fährmann
16e276fca4 [nijie] fix image URLs for single image posts (#5842)
fixes regression introduced in 2e11b6e7
2024-07-10 15:06:25 +02:00
Mike Fährmann
eb3ef13d28 include 'zstd' in Accept-Encoding header when supported
… and slightly update optional dependency list
2024-07-10 00:33:35 +02:00
Mike Fährmann
8aca0e6970 update default User-Agent header to Firefox 128 ESR 2024-07-09 20:42:06 +02:00
Mike Fährmann
8e747b6dee [twitter] send initial 'cursor' only when given via option 2024-07-09 20:42:06 +02:00
Mike Fährmann
ff39d28ef4 [twitter] fix 'user' when providing 'cursor' (#5833) 2024-07-08 23:16:47 +02:00
Mike Fährmann
65385e09cb [twitter] remove break (#5831) 2024-07-07 01:08:30 +02:00
Mike Fährmann
8f3f061daf [hentainexus] fix error for spread pages (#5827) 2024-07-05 21:36:29 +02:00
Mike Fährmann
b376fa814e [zerochan] handle "KeyError - 'items'" (#5826)
Zerochan sometimes sends an empty response when there are no more
accessible posts to be had.
2024-07-05 21:34:33 +02:00
Mike Fährmann
97a50a23d2 [twitter] implement 'cursor' support (#5753) 2024-07-05 00:03:02 +02:00
Nicholas Bishop
4f3be2f571 Remove leftover split() statement
Forgot to remove this from a previous implementation attempt
2024-07-04 16:50:49 -04:00
Mike Fährmann
162756b684 [toyhouse] fix Content Warning bypass (#5820) 2024-07-04 22:42:36 +02:00
Nicholas Bishop
f43bccb5be [furaffinity] Add 'thumbnail' (#1284) and 'folders' properties
Retrieve 'thumbnail' and 'folders' properties for each post.
'thumbnail' (#1284):
 - Preview image used for search results, writing posts, music, etc.
 - Filename format: <post_id>@600-<directory_containing_full_image>.jpg
'Folders' (related to #1817):
 - A list of all gallery folders containing this post
 - Folder name format: [<folder_category> - ]<folder_name>
 - Only works on new layout; old layout does not show folders, so list will be empty

A test is included for each property.
2024-07-04 15:41:14 -04:00
Mike Fährmann
d10bfa9065 [vipergirls] improve 'thread' URL pattern
allow for query parameters and fragments at tne end of URLs
2024-06-29 17:38:57 +02:00
Mike Fährmann
29eb535e18 merge #5802: [twitter] extract 'bookmark_count' and 'view_count' 2024-06-28 23:21:57 +02:00
rameerez
ee93dfeb8d Add bookmark_count and view_count to the X / Twitter extractor
- Parse `view_count` as integer in Twitter extractor
- Style fix
- optimize 'view_count' extraction
2024-06-28 23:17:11 +02:00
Mike Fährmann
c2bf4ff99c [twitter] add 'profile' extractor (#3623) 2024-06-28 22:55:48 +02:00
Mike Fährmann
44896b0296 [instagram] add 'profile' extractor (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
2024-06-28 22:54:07 +02:00