github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,555 Commits 1 Branch 0 Tags
7a67348fc2f86e80451a88682ced0047bd1dd18f
Commit Graph

761 Commits

Author SHA1 Message Date
Mike Fährmann
7a67348fc2 [civitai] implement retrieving 'version' metadata (#7432) 2025-05-03 20:39:35 +02:00
Mike Fährmann
e26ae210bd [kemonoparty] restore using default creator posts endpoint 
(#7438 #7450 #7462)

- revert c3fb0f53ee
- add '"endpoint": "legacy+"' option
  to use '/posts-legacy' results and with full metadata
 2025-05-02 21:49:28 +02:00
Mike Fährmann
16b5d41ce5 [kemonoparty] add 'endpoint' option (#7438) 2025-04-28 16:47:48 +02:00
Mike Fährmann
9b43a3677e [pp:directory] add 'directory' post processor (#7432) 2025-04-28 09:08:35 +02:00
Deer-Spangle
db89f4a545 [weasyl] Set gallery-dl user agent to match danbooru user agent, when making weasyl requests. 
To fit with their bot ettiquette: https://projects.weasyl.com/bot-etiquette
 2025-04-24 10:04:24 +01:00
noxibow
4c974debf5 [naver] support video downloads (#7395) 
and fix 'date' for posts newer than 24h

- fix naver blogposts directory error for posts created less than 24 hours ago
- add support for videos on naver blogs
- refactor to remove unnecessary imports
- fix video url scraping method
- rework date handling
- rework video extraction
- add 'videos' option
- add test
 2025-04-22 09:14:32 +02:00
Mike Fährmann
dcaf7293b3 [bluesky] add 'video' extractor (#4438) 2025-04-16 12:00:57 +02:00
Mike Fährmann
481ad1c206 [bluesky:likes] use 'repo.listRecords' endpoint (#7194 #7287) 
requires one additional API request per post,
but allows accessing likes of all users without login
and avoids the infinite loop at the end of 'getActorLikes'

add 'endpoint' option
 2025-04-15 22:47:33 +02:00
Mike Fährmann
48053cf3ec [util] update auto Chrome version 2025-04-15 22:47:33 +02:00
Mike Fährmann
4916b4fd1f [webtoons] download JPEG files in better quality 
add 'quality' option
 2025-04-10 22:04:43 +02:00
Mike Fährmann
09d42b8e89 [webtoons] use a default delay pf 0.5-1.5s between requests (#7329) 2025-04-09 20:41:22 +02:00
Mike Fährmann
edd90fbf02 [pp:metadata] add 'metadata-path' option (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-2781643835
 2025-04-09 20:24:14 +02:00
Mike Fährmann
ee26f3ccd7 [instagram] use Chrome User-Agent by default (#6379) 2025-03-30 22:21:38 +02:00
Mike Fährmann
fcf76bab55 [instagram] download videos from 'video_dash_manifest' data 
(#6379 #7006)

requires yt-dlp / youtube-dl
 2025-03-27 18:27:37 +01:00
Mike Fährmann
6894e0bc70 [arcalive] extend 'gifs' option 
use fallback URLs by default
 2025-03-26 20:59:18 +01:00
Mike Fährmann
24bbcbcfa3 [danbooru] add 'favgroup' extractor 2025-03-26 20:58:49 +01:00
Mike Fährmann
e1aabf01e4 merge #7220: [deviantart] add subfolder support (#4988 #7185) 2025-03-24 18:43:11 +01:00
Mike Fährmann
fd8f652490 [hitomi] fix extractors (#7230) 2025-03-23 20:32:27 +01:00
Mike Fährmann
b52c21186b [deviantart] add 'subfolders' option 2025-03-23 17:58:58 +01:00
Mike Fährmann
4a74bc6e30 [kemonoparty] extract 'archives' metadata (#7195) 
add 'archives' option for additional data
 2025-03-22 18:38:21 +01:00
Mike Fährmann
f8ef9a7b35 [kemonoparty] enable 'username'/'user_profile' metadata by default 2025-03-21 20:01:06 +01:00
Mike Fährmann
dbe8820b9e [arcalife] add 'gifs' option (#5657) 2025-03-14 22:34:45 +01:00
hdk5
d900e868e4 [arcalive] add support (#5657 #7100) 
* [arca.live] Add extractor skeleton

* [arcalive] update names and formatting

* [arcalive] implement initial file extraction code

* [arcalive] improve '_extract_media()' performance

compile and cache regex on demand

* [arcalive] improve image extraction

- extract 'data-originalurl' URLs if available
- replace URL query strings with 'type=orig'
- ignore emoticons by default

* [arcalive] update defaults

- include 'title' in filenames
- use 0.5-1.5s delay between requests

* [arcalive] use ext from 'data-orig' if available

* [arcalive] update docs/supportedsites

* [arcalive] add tests

* [arcalive] update 'board' extractor pattern

so it doesn't also match 'post' URLs

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-03-14 10:52:21 +01:00
Mike Fährmann
22d46f2462 [batoto] add 'domain' option (#7174) 
allow legacy domains by default
 2025-03-14 10:31:49 +01:00
Mike Fährmann
cd1ddb0a67 [wikimedia] add 'subcategories' option (#2340) 
https://github.com/mikf/gallery-dl/pull/2340#issuecomment-2707177295
 2025-03-12 22:05:44 +01:00
Mike Fährmann
3e64ec4f15 [tiktok] implement audio extraction without ytdl 2025-03-12 22:05:24 +01:00
Mike Fährmann
486e307ecd [reddit] add 'selftext' option (#7111) 2025-03-08 09:01:50 +01:00
Mike Fährmann
3b81d89fef [bunkr] add 'endpoint' option (#7097) 2025-03-08 08:50:16 +01:00
Mike Fährmann
2f3265a8ae [tenor] add initial support (#6075) 2025-03-03 19:04:50 +01:00
Mike Fährmann
f232a07faf [danbooru:pool] download posts in pool order (#7091) 
- add 'order-posts' option
- add 'num' metadata field for pool position
- update default filenames to order by pool position
 2025-03-03 16:46:43 +01:00
Mike Fährmann
4ecc40ce4b [docs] fix 'tiktok-range' default value (#7098) 2025-03-02 14:34:30 +01:00
Mike Fährmann
afde4ad343 [tiktok] add 'avatar' option 2025-02-26 21:09:57 +01:00
Mike Fährmann
5e87aee32d [tiktok] add 'audio' option (#7060) 2025-02-26 21:02:33 +01:00
Mike Fährmann
13c3fa45f7 [docs] add 'tiktok' options (#7060) 2025-02-26 20:45:25 +01:00
Mike Fährmann
203c2e3492 [vipergirls] change default 'domain' to 'viper.click' (4166) 
https://github.com/mikf/gallery-dl/issues/4166#issuecomment-2684014628

and update general 'domain' handling
 2025-02-26 10:41:51 +01:00
Mike Fährmann
876169ded5 [furaffinity] use a 1s delay between requests by default (#7054) 2025-02-25 20:12:54 +01:00
Luca Russo
95c446fcd1 [discord] add support (#6836) 
* first commit

* add --

* skip video embeds

* fix typo

* removed ambiguity

* add category support

* code tweaks

* more reliable embed extraction

* handle 403 errors (testing done)

* added "parent_id" keyword

* added "parent", "parent_type" keywords

the extractor should be now ready to merge!

* removed unnecessary dict unpacking

* added empty text messages extraction

* added "channel_topic"

* even more metadata extraction

can now extract all embeds images & text, as well as server banners. also code is much better.

* added user avatar and banner

* better pagination

* fix regression

* minor tweaks

* Made requested changes
 2025-02-18 18:45:39 +01:00
Mike Fährmann
fd4de02e67 [archive] support PostgreSQL archives for post processors (#6152) 2025-02-17 14:58:14 +01:00
Mike Fährmann
8daf496a22 [archive] add 'archive-table' option (#6152) 2025-02-17 11:41:13 +01:00
Mike Fährmann
841bc9f66f [archive] implement support for PostgreSQL databases (#6152) 2025-02-16 17:56:52 +01:00
Mike Fährmann
35307608f2 [dl:http] add 'sleep-429' option (#6996) 2025-02-15 17:42:03 +01:00
Mike Fährmann
182b544217 [ytdl] support specifying filesystem paths as 'module' (#6991) 2025-02-14 19:58:25 +01:00
Mike Fährmann
51f978e027 [weibo] add 'movies' option (#6988) 
disable 'movie' downloads by default
 2025-02-13 18:01:20 +01:00
Mike Fährmann
873cbf6b36 [docs] add more details to 'user-agent' and 'browser' docs (#6917) 2025-02-03 20:54:27 +01:00
Mike Fährmann
4874c8e1d1 [artstation] restore 'browser' and 'tls12' defaults 
partially revert 954796a466
 2025-01-28 11:36:06 +01:00
Mike Fährmann
954796a466 [artstation] prevent CF challenges (#5817, #5658, #5564, #5554) 2025-01-26 16:00:16 +01:00
Mike Fährmann
438c61601b [xfolio] add initial support (#5514, #6351, #6837) 2025-01-18 15:57:56 +01:00
Mike Fährmann
dc7b46be21 [khinsider] add 'covers' option (#6844) 2025-01-18 15:57:56 +01:00
Mike Fährmann
bde99cc6ce [cohost] remove module 
cohost.org  now redirects to archive.org
 2025-01-13 14:38:35 +01:00
Mike Fährmann
91bd3e37f2 [pexels] add support (#2286, #4214, #6769) 2025-01-12 16:50:12 +01:00