Commit Graph

6529 Commits

Author SHA1 Message Date
Mike Fährmann
8b7f5eacbb [subscribestar] add warning for missing login cookie
and update expected cookie domains and names
2025-04-25 16:20:02 +02:00
Mike Fährmann
2e8b447262 [kemonoparty] fix 'archives' option (#7416)
use '/vi/file/HASH' API endpoint
since '/v1/posts/archives/HASH' is gone or was renamed
2025-04-25 11:05:02 +02:00
Mike Fährmann
754b704ca1 merge #7411: [itaku] add 'stars' extractor 2025-04-24 19:48:09 +02:00
Mike Fährmann
f01b4adcc9 [itaku:stars] update
- remove type hints
- add test
- update docs/supportedsites
2025-04-24 19:45:48 +02:00
Mike Fährmann
31f85ab678 merge #7412: [weasyl] use 'gallery-dl' User-Agent header 2025-04-24 19:34:27 +02:00
Mike Fährmann
4de7c02322 merge #7409: [pictoa] add support (#6683) 2025-04-24 18:02:34 +02:00
Mike Fährmann
29a4444b21 [pictoa] update
- simplify code
- update URL patterns
- update tests
- update docs/supportedsites
2025-04-24 17:59:47 +02:00
Mike Fährmann
25e8a98547 [scrolller] support album posts (#7339) 2025-04-24 16:36:27 +02:00
Deer-Spangle
db89f4a545 [weasyl] Set gallery-dl user agent to match danbooru user agent, when making weasyl requests.
To fit with their bot ettiquette: https://projects.weasyl.com/bot-etiquette
2025-04-24 10:04:24 +01:00
Deer-Spangle
6bbedda08b [itaku] Add a new extractor for Itaku stars 2025-04-24 09:59:32 +01:00
nunonda
f342108280 Adding in a first pass at a pictoa extractor
Adds support for galleries and individual Images
2025-04-23 17:37:40 -07:00
Mike Fährmann
4b855b1565 [scrolller] retrieve data of single posts via GraphQL 2025-04-22 21:58:29 +02:00
Mike Fährmann
c3fb0f53ee [kemonoparty] use '/posts-legacy' endpoint (#6780 #6931 #7404)
instead of the "official", broken, and inconsistent endpoint
for creator posts
2025-04-22 17:26:50 +02:00
Mike Fährmann
ee1ba088b8 [deviantart:stash] extract more metadata (#7397)
- stash_id
- stash_name
- stash_description
- stash_folder
- stash_parent
2025-04-22 13:06:05 +02:00
Mike Fährmann
25c2c3a7da merge #4682: [naver] support videos & fix recent 'date' bug (#7395) 2025-04-22 09:25:22 +02:00
noxibow
4c974debf5 [naver] support video downloads (#7395)
and fix 'date' for posts newer than 24h

- fix naver blogposts directory error for posts created less than 24 hours ago
- add support for videos on naver blogs
- refactor to remove unnecessary imports
- fix video url scraping method
- rework date handling
- rework video extraction
- add 'videos' option
- add test
2025-04-22 09:14:32 +02:00
Mike Fährmann
abf39b60ef merge #7396: [wikifeet] support redesign 2025-04-21 17:36:01 +02:00
Mike Fährmann
b71b5af38a [wikifeet] fix 'bdate' parsing
and update 'shoesize' test results
2025-04-21 17:32:54 +02:00
Parasiteoflife
0579726d80 fix: Wikifeet - support redesign 2025-04-20 21:53:57 -05:00
Mike Fährmann
99afe58a6e [deviantart] fix multi-image URLs (#6653)
https://github.com/mikf/gallery-dl/issues/6653#issuecomment-2816560271
2025-04-20 21:33:45 +02:00
Mike Fährmann
03b1d42dfd [deviantart] simplify 'additionalMedia' extraction 2025-04-20 21:08:21 +02:00
Mike Fährmann
00f3b48eb8 [gelbooru] don't hardcode image server domains (#7392) 2025-04-20 00:09:28 +02:00
Mike Fährmann
f0437a5121 merge #6331: [twitter] add 'followers' extractor 2025-04-19 18:29:11 +02:00
stephanelsmith
f0e7992674 [twitter] added 'followers' extractor
modeled after the 'following' extractor

- cleanup
- add test
2025-04-19 18:24:29 +02:00
Mike Fährmann
4b11c72687 merge #7241: [instagram] handle '/share/' URLs
generated by the mobile app
2025-04-19 18:22:02 +02:00
Etienne Boucher
e6f4dcf90f Handle instagram.com/share/ URLs
- added Sec-Fetch* headers for proper redirect
- fixed formatting
- restore 'guide' test
- integrate in PostExtractor code
2025-04-19 18:19:36 +02:00
Mike Fährmann
2798fb8a80 [twitter] update API endpoint query hashes (#7382 #7386)
and associated 'variables', 'features', and 'fieldToggles' parameters
2025-04-19 16:45:47 +02:00
Mike Fährmann
10f2e08bd1 [fanbox] fix 'comments' extraction 2025-04-19 16:45:47 +02:00
Mike Fährmann
88f1541a83 [common] add 'request_location()' convenience function 2025-04-19 16:45:05 +02:00
Mike Fährmann
d6311bbf75 [moebooru:pool] replace underscores in pool names (#4646)
https://github.com/mikf/gallery-dl/issues/4646#issuecomment-2815698517
2025-04-18 18:33:23 +02:00
Mike Fährmann
de727147e5 [fapello] stop pagination on empty results (#7385) 2025-04-18 15:46:36 +02:00
Mike Fährmann
763bbfae8b [pp:ugoira] support '"keep-files": true' + custom extension (#7304)
for '"mode": "archive"'
2025-04-17 20:03:18 +02:00
Mike Fährmann
fc561c2936 [pp:ugoira] restore 'keep-files' functionality (#7304)
fixes regression introduced in a08c35ad79
2025-04-17 19:25:31 +02:00
Mike Fährmann
f3ababc3be [pp:ugoira] use '_ugoira_frame_index' to detect '.zip' files 2025-04-17 18:37:08 +02:00
Mike Fährmann
31fd613fbb [instagram] add 'followers' extractor (#7374) 2025-04-17 10:23:01 +02:00
Mike Fährmann
9abca62e8b merge #7379: [everia] fix 'title' extraction 2025-04-17 08:25:45 +02:00
Ryan Rockey
ecf6966303 [everia] fix 'title' extraction
Due to a recent site change, post titles where no longer being
downloaded into their own directory.

After reviewing the site code changing  extractor to use the "</h2>"
tag instead of the original </h1> resolves this issue.

-----

Generalizing to "</h" works as well and may account for future changes.
2025-04-17 08:22:14 +02:00
Mike Fährmann
dcaf7293b3 [bluesky] add 'video' extractor (#4438) 2025-04-16 12:00:57 +02:00
Mike Fährmann
7d1321cbda [bluesky:likes] fix infinite loop (#7194 #7287)
at the end of 'feed.getActorLikes'
2025-04-16 08:58:15 +02:00
Mike Fährmann
397a795a17 [bluesky] use self.groups / remove constructors 2025-04-15 22:47:33 +02:00
Mike Fährmann
481ad1c206 [bluesky:likes] use 'repo.listRecords' endpoint (#7194 #7287)
requires one additional API request per post,
but allows accessing likes of all users without login
and avoids the infinite loop at the end of 'getActorLikes'

add 'endpoint' option
2025-04-15 22:47:33 +02:00
Mike Fährmann
48053cf3ec [util] update auto Chrome version 2025-04-15 22:47:33 +02:00
Mike Fährmann
4c8c98a14d use internal, non-caching version of re.compile for extractor patterns
speeds up total compile time of extractor patterns by ~10ms
2025-04-15 22:47:19 +02:00
Mike Fährmann
26747051b0 release version 1.29.4 2025-04-13 10:42:44 +02:00
Mike Fährmann
21160a8b08 [tumblr] support URLs without subdomain (#7358) 2025-04-13 09:33:51 +02:00
Mike Fährmann
feacdd5d87 [hentai2read] fix exception for chapters without artist (#7355) 2025-04-12 20:14:31 +02:00
Mike Fährmann
81ff0219a1 merge #7353: [discord] fix "parent" keyword inconsistency (#7341) 2025-04-12 16:57:49 +02:00
Luca Russo
a27bcf6bbb [discord] fix categories name bug 2025-04-12 16:56:15 +02:00
Mike Fährmann
8eba4e6434 merge #7352: [pixiv] support 'phixiv.net' URLs 2025-04-12 16:53:13 +02:00
Mike Fährmann
2ef7a05e10 [pixiv] update 'work' extractor pattern & add tests 2025-04-12 16:51:17 +02:00