Commit Graph

6518 Commits

Author SHA1 Message Date
Deer-Spangle
6bbedda08b [itaku] Add a new extractor for Itaku stars 2025-04-24 09:59:32 +01:00
Mike Fährmann
c3fb0f53ee [kemonoparty] use '/posts-legacy' endpoint (#6780 #6931 #7404)
instead of the "official", broken, and inconsistent endpoint
for creator posts
2025-04-22 17:26:50 +02:00
Mike Fährmann
ee1ba088b8 [deviantart:stash] extract more metadata (#7397)
- stash_id
- stash_name
- stash_description
- stash_folder
- stash_parent
2025-04-22 13:06:05 +02:00
Mike Fährmann
25c2c3a7da merge #4682: [naver] support videos & fix recent 'date' bug (#7395) 2025-04-22 09:25:22 +02:00
noxibow
4c974debf5 [naver] support video downloads (#7395)
and fix 'date' for posts newer than 24h

- fix naver blogposts directory error for posts created less than 24 hours ago
- add support for videos on naver blogs
- refactor to remove unnecessary imports
- fix video url scraping method
- rework date handling
- rework video extraction
- add 'videos' option
- add test
2025-04-22 09:14:32 +02:00
Mike Fährmann
abf39b60ef merge #7396: [wikifeet] support redesign 2025-04-21 17:36:01 +02:00
Mike Fährmann
b71b5af38a [wikifeet] fix 'bdate' parsing
and update 'shoesize' test results
2025-04-21 17:32:54 +02:00
Parasiteoflife
0579726d80 fix: Wikifeet - support redesign 2025-04-20 21:53:57 -05:00
Mike Fährmann
99afe58a6e [deviantart] fix multi-image URLs (#6653)
https://github.com/mikf/gallery-dl/issues/6653#issuecomment-2816560271
2025-04-20 21:33:45 +02:00
Mike Fährmann
03b1d42dfd [deviantart] simplify 'additionalMedia' extraction 2025-04-20 21:08:21 +02:00
Mike Fährmann
00f3b48eb8 [gelbooru] don't hardcode image server domains (#7392) 2025-04-20 00:09:28 +02:00
Mike Fährmann
f0437a5121 merge #6331: [twitter] add 'followers' extractor 2025-04-19 18:29:11 +02:00
stephanelsmith
f0e7992674 [twitter] added 'followers' extractor
modeled after the 'following' extractor

- cleanup
- add test
2025-04-19 18:24:29 +02:00
Mike Fährmann
4b11c72687 merge #7241: [instagram] handle '/share/' URLs
generated by the mobile app
2025-04-19 18:22:02 +02:00
Etienne Boucher
e6f4dcf90f Handle instagram.com/share/ URLs
- added Sec-Fetch* headers for proper redirect
- fixed formatting
- restore 'guide' test
- integrate in PostExtractor code
2025-04-19 18:19:36 +02:00
Mike Fährmann
2798fb8a80 [twitter] update API endpoint query hashes (#7382 #7386)
and associated 'variables', 'features', and 'fieldToggles' parameters
2025-04-19 16:45:47 +02:00
Mike Fährmann
10f2e08bd1 [fanbox] fix 'comments' extraction 2025-04-19 16:45:47 +02:00
Mike Fährmann
88f1541a83 [common] add 'request_location()' convenience function 2025-04-19 16:45:05 +02:00
Mike Fährmann
d6311bbf75 [moebooru:pool] replace underscores in pool names (#4646)
https://github.com/mikf/gallery-dl/issues/4646#issuecomment-2815698517
2025-04-18 18:33:23 +02:00
Mike Fährmann
de727147e5 [fapello] stop pagination on empty results (#7385) 2025-04-18 15:46:36 +02:00
Mike Fährmann
763bbfae8b [pp:ugoira] support '"keep-files": true' + custom extension (#7304)
for '"mode": "archive"'
2025-04-17 20:03:18 +02:00
Mike Fährmann
fc561c2936 [pp:ugoira] restore 'keep-files' functionality (#7304)
fixes regression introduced in a08c35ad79
2025-04-17 19:25:31 +02:00
Mike Fährmann
f3ababc3be [pp:ugoira] use '_ugoira_frame_index' to detect '.zip' files 2025-04-17 18:37:08 +02:00
Mike Fährmann
31fd613fbb [instagram] add 'followers' extractor (#7374) 2025-04-17 10:23:01 +02:00
Mike Fährmann
9abca62e8b merge #7379: [everia] fix 'title' extraction 2025-04-17 08:25:45 +02:00
Ryan Rockey
ecf6966303 [everia] fix 'title' extraction
Due to a recent site change, post titles where no longer being
downloaded into their own directory.

After reviewing the site code changing  extractor to use the "</h2>"
tag instead of the original </h1> resolves this issue.

-----

Generalizing to "</h" works as well and may account for future changes.
2025-04-17 08:22:14 +02:00
Mike Fährmann
dcaf7293b3 [bluesky] add 'video' extractor (#4438) 2025-04-16 12:00:57 +02:00
Mike Fährmann
7d1321cbda [bluesky:likes] fix infinite loop (#7194 #7287)
at the end of 'feed.getActorLikes'
2025-04-16 08:58:15 +02:00
Mike Fährmann
397a795a17 [bluesky] use self.groups / remove constructors 2025-04-15 22:47:33 +02:00
Mike Fährmann
481ad1c206 [bluesky:likes] use 'repo.listRecords' endpoint (#7194 #7287)
requires one additional API request per post,
but allows accessing likes of all users without login
and avoids the infinite loop at the end of 'getActorLikes'

add 'endpoint' option
2025-04-15 22:47:33 +02:00
Mike Fährmann
48053cf3ec [util] update auto Chrome version 2025-04-15 22:47:33 +02:00
Mike Fährmann
4c8c98a14d use internal, non-caching version of re.compile for extractor patterns
speeds up total compile time of extractor patterns by ~10ms
2025-04-15 22:47:19 +02:00
Mike Fährmann
26747051b0 release version 1.29.4 2025-04-13 10:42:44 +02:00
Mike Fährmann
21160a8b08 [tumblr] support URLs without subdomain (#7358) 2025-04-13 09:33:51 +02:00
Mike Fährmann
feacdd5d87 [hentai2read] fix exception for chapters without artist (#7355) 2025-04-12 20:14:31 +02:00
Mike Fährmann
81ff0219a1 merge #7353: [discord] fix "parent" keyword inconsistency (#7341) 2025-04-12 16:57:49 +02:00
Luca Russo
a27bcf6bbb [discord] fix categories name bug 2025-04-12 16:56:15 +02:00
Mike Fährmann
8eba4e6434 merge #7352: [pixiv] support 'phixiv.net' URLs 2025-04-12 16:53:13 +02:00
Mike Fährmann
2ef7a05e10 [pixiv] update 'work' extractor pattern & add tests 2025-04-12 16:51:17 +02:00
w4tchdoge
1ee057285d [pixiv] match phixiv.net URLs 2025-04-12 19:30:04 +08:00
Mike Fährmann
85808a954f [gelbooru] fix video URLs (#7345)
update subdomain to 'img4'
2025-04-12 08:41:10 +02:00
Mike Fährmann
232d4545f4 [tests] add reddit post with redgifs embed 2025-04-12 08:37:02 +02:00
Mike Fährmann
a08c35ad79 [pp:ugoira] preserve 'extension' when using "mode": "archive" (#7304) 2025-04-11 16:33:11 +02:00
Mike Fährmann
9ce6de6ca0 [formatter] add 'i' and 'f' conversions (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-2792166608
2025-04-11 09:18:24 +02:00
Mike Fährmann
4916b4fd1f [webtoons] download JPEG files in better quality
add 'quality' option
2025-04-10 22:04:43 +02:00
Mike Fährmann
09d42b8e89 [webtoons] use a default delay pf 0.5-1.5s between requests (#7329) 2025-04-09 20:41:22 +02:00
Mike Fährmann
edd90fbf02 [pp:metadata] add 'metadata-path' option (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-2781643835
2025-04-09 20:24:14 +02:00
Mike Fährmann
a1bf71d0bd merge #7327: [zzup] support 'w.zzup.com' URLs 2025-04-08 17:04:54 +02:00
Mike Fährmann
8eb365d4b6 [pp:metadata] fix handling of empty directory paths (#7296) 2025-04-08 17:03:27 +02:00
Mike Fährmann
f02dcb720a [rule34xyz] update to API v2 (#7289) 2025-04-08 17:03:27 +02:00