Commit Graph

6389 Commits

Author SHA1 Message Date
Mike Fährmann
3e64ec4f15 [tiktok] implement audio extraction without ytdl 2025-03-12 22:05:24 +01:00
Mike Fährmann
898a09bf7f [sankaku] fix 'tags' metadata (#7155)
rename 'tag_names' to 'tags'
2025-03-12 17:07:40 +01:00
Mike Fährmann
d40f8a82be [tests] add support for skipping an extractor result test 2025-03-12 16:41:46 +01:00
Mike Fährmann
e1bdcd97e1 [furaffinity] extract 'scraps' metadata (#7015)
boolean value indicating whether a post is part of a user's Scraps
folder or the main gallery
2025-03-12 16:29:16 +01:00
Mike Fährmann
a12ff281e7 merge #7159: [furaffinity] add 'folder' extractor (#1817) 2025-03-12 14:08:32 +01:00
Deer-Spangle
859f1e7d04 [furaffinity] Adding a FuraffinityFolderExtractor, which extracts a single folder
- Ensure FuraffinityGalleryExtractor doesn't detect folder links
- Fix example URL for folder extractor
- Reordering classes a bit
- Another tweak of the regex
- One more go at the regex..
- cleanup
2025-03-12 14:00:50 +01:00
Mike Fährmann
94bbbbb16b [sankaku] fix categorized tags for posts with >100 tags (#7155) 2025-03-11 21:01:46 +01:00
Mike Fährmann
1254c4e3d9 [sankaku] update API URLs (#7154 #7155)
and fix errors due to other changes
2025-03-11 18:45:45 +01:00
Mike Fährmann
518865c7de [civitai] fix/improve query parameter handling (#7138) 2025-03-10 20:18:57 +01:00
Mike Fährmann
ce01835995 [facebook] improve 'date' extraction (#7151)
use 'created_time' as alternative when 'publish_time' isn't available
2025-03-10 17:35:32 +01:00
Mike Fährmann
04464b6cf0 [text] add second argument to 'parse_query_list()' (#7138)
return only values whose name is in 'as_list' as a list
2025-03-10 09:36:50 +01:00
Mike Fährmann
a859abf6a1 [twitter] prevent exception in '_extract_components()' (#7139) 2025-03-09 10:15:18 +01:00
Mike Fährmann
3eba856e13 release version 1.29.1 2025-03-08 17:08:54 +01:00
Mike Fährmann
d6281b5685 [tenor] relax '/view/' URL pattern (#6075) 2025-03-08 15:54:46 +01:00
Mike Fährmann
52aa5bad4f [tenor] rename 'content_description' to just 'description' 2025-03-08 10:05:49 +01:00
Mike Fährmann
486e307ecd [reddit] add 'selftext' option (#7111) 2025-03-08 09:01:50 +01:00
Mike Fährmann
3b81d89fef [bunkr] add 'endpoint' option (#7097) 2025-03-08 08:50:16 +01:00
Mike Fährmann
7afd5bae03 [sankaku] increase wait time on 429 errors (#7129)
to 10 minutes
2025-03-07 20:19:17 +01:00
Mike Fährmann
3ef23cc99b [sankaku] fix search tag limit check 2025-03-07 20:18:34 +01:00
Mike Fährmann
18b9ffe8c3 [redgifs:search] support '/search?query=...' URLs (#7118) 2025-03-07 12:35:35 +01:00
Mike Fährmann
8582af3483 [tenor] support '/official/' user URLs (#6075) 2025-03-07 11:34:33 +01:00
Mike Fährmann
639ddc95e7 [tenor] support URLs with language codes (#6075) 2025-03-07 11:19:18 +01:00
Mike Fährmann
fac4ef5679 [erome:search] recognize all input URL query parameters (#7125) 2025-03-07 08:23:02 +01:00
Mike Fährmann
4a2c8606a5 [dl:http] detect Cloudflare/DDoS-Guard challenges (#7066 #7121) 2025-03-06 14:31:32 +01:00
Mike Fährmann
c9488cee30 [util] move Cloudflare/DDoS-Guard detection into 'detect_challenge()' 2025-03-06 14:21:35 +01:00
Mike Fährmann
984116ada7 [furaffinity] improve 'artist_url' extraction (#7115 #7123) 2025-03-06 14:15:11 +01:00
Mike Fährmann
ecbad03c49 [workflows:tests] run on ubuntu-22.04
> Ubuntu 20.04 LTS runner will be removed on 2025-04-01
2025-03-05 20:38:28 +01:00
Mike Fährmann
f5073605f6 [tenor] add 'user' extractor (#6075) 2025-03-04 21:47:16 +01:00
Mike Fährmann
b7bb40c06b [furaffinity] fix 'artist' metadata (#7115 #6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-2696619061
2025-03-04 16:48:17 +01:00
Mike Fährmann
5486a9c429 [util] implement 'decrypt_xor()' 2025-03-04 16:33:42 +01:00
Mike Fährmann
b5c1bf3f59 [dl] improve invalid 'subcategory' value warning (#7103) 2025-03-04 16:17:53 +01:00
Mike Fährmann
198593bf46 [vsco] fix extracting videos from '/gallery' results (#7113) 2025-03-04 16:10:48 +01:00
Mike Fährmann
3a5adbf644 [vsco] fix 'video' extractor (#7113)
fixes regression introduced in 6420210b0f
2025-03-04 09:43:05 +01:00
Mike Fährmann
2f3265a8ae [tenor] add initial support (#6075) 2025-03-03 19:04:50 +01:00
Mike Fährmann
4d2037f6c6 [dl] warn about invalid 'subcategory' values (#7103)
prevent fatal exception when collecting downloader options
2025-03-03 16:51:13 +01:00
Mike Fährmann
4c601f9b83 [bunkr] update endpoint (#7097) 2025-03-03 16:49:42 +01:00
Mike Fährmann
f232a07faf [danbooru:pool] download posts in pool order (#7091)
- add 'order-posts' option
- add 'num' metadata field for pool position
- update default filenames to order by pool position
2025-03-03 16:46:43 +01:00
Mike Fährmann
c567bf12e6 [danbooru][e621] remove constructors 2025-03-02 20:38:12 +01:00
Mike Fährmann
f15538938e [jpgfish] decrypt file URLs (#7073 #7079) 2025-03-02 15:17:07 +01:00
Mike Fährmann
262e8628fa [tiktok] improve 'tiktok-range' parsing (#7098)
replace values evaluating as False (except 0) with ""
2025-03-02 14:50:49 +01:00
Mike Fährmann
4ecc40ce4b [docs] fix 'tiktok-range' default value (#7098) 2025-03-02 14:34:30 +01:00
Mike Fährmann
db19990a82 [text] allow calling 'extract_iter' with invalid arguments 2025-03-02 10:44:06 +01:00
Mike Fährmann
472ea737d8 [erome] fix AttributeError for albums without tags (#7076)
fixes regression introduced in 07a9dca459
2025-03-01 21:18:57 +01:00
Mike Fährmann
71ebbfa577 release version 1.29.0 2025-03-01 20:08:19 +01:00
Mike Fährmann
1a6fa70e5e [archive] fix exception when specifying path as list (#7088) 2025-02-28 21:24:25 +01:00
Mike Fährmann
6c8c264cf5 [dl:ytdl] log ytdl module and version when importing 2025-02-28 21:18:42 +01:00
Mike Fährmann
7c33b9fbfe merge #7070: [bunkr] decrypt file URLs (#7058 #7085) 2025-02-28 15:33:46 +01:00
okbuddyagi
16c33527fa [bunkr] bypassed URL encryption
- fixed imports
- formatting
- revert unrelated formatting changes
- cleanup / simplify
2025-02-28 15:31:35 +01:00
Mike Fährmann
f86ff15146 merge #7067: [discord] add single message support (#7059) 2025-02-28 10:49:53 +01:00
Mike Fährmann
fa7114ee20 [docs] update supportedsites 2025-02-28 10:48:28 +01:00