github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,563 Commits 1 Branch 0 Tags
eba44b8f78b612aaf476ea01d3985331f4b7cb21
Commit Graph

6563 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Soblow "Opale" Xaselgio
eba44b8f78 [mastodon] Add unit tests for various statuses URL formats on various fediverse software (mastodon/akkoma/pleroma) 
Signed-off-by: Soblow "Opale" Xaselgio <113846014+Soblow@users.noreply.github.com>
 2025-05-09 12:03:57 +02:00
Soblow "Opale" Xaselgio
a94672bede [mastodon] Add support for Akkoma/Pleroma /notice/:status_id urls 
Signed-off-by: Soblow "Opale" Xaselgio <113846014+Soblow@users.noreply.github.com>
 2025-05-09 12:03:57 +02:00
Mike Fährmann
25e293c16f release version 1.29.6 2025-05-04 09:18:03 +02:00
Mike Fährmann
b97dc456b0 [twitter] import 'transaction_id' only when needed 2025-05-04 07:42:44 +02:00
Mike Fährmann
6746e38670 [civitai] fix typo 2025-05-03 21:15:26 +02:00
Mike Fährmann
134c3854ee merge #7469: [weasyl] support '/view/' URLs 2025-05-03 20:45:58 +02:00
Mike Fährmann
bff02bc5f4 [weasyl] add '/view/' test 2025-05-03 20:44:34 +02:00
Mike Fährmann
7a67348fc2 [civitai] implement retrieving 'version' metadata (#7432) 2025-05-03 20:39:35 +02:00
Soblow "Opale" Xaselgio
07ac157acb Accept Weasyl URLs of format /view/12345 
Signed-off-by: Soblow "Opale" Xaselgio <113846014+Soblow@users.noreply.github.com>
 2025-05-03 19:35:37 +02:00
Mike Fährmann
edc67983ed [twitter] update 'x-csrf-token' header after ct init (#7467) 2025-05-03 12:55:31 +02:00
Mike Fährmann
771317b36c [twitter:ctid] cache client transaction keys (#7382) 
and 'ondemand.s.…a.js' responses
 2025-05-03 12:50:00 +02:00
Mike Fährmann
a1fd329783 [tumblr] improve error message for dashboard-only blogs (#7455) 2025-05-03 11:02:38 +02:00
Mike Fährmann
e26ae210bd [kemonoparty] restore using default creator posts endpoint 
(#7438 #7450 #7462)

- revert c3fb0f53ee
- add '"endpoint": "legacy+"' option
  to use '/posts-legacy' results and with full metadata
 2025-05-02 21:49:28 +02:00
Mike Fährmann
a6803afd36 [tests] implement testing for non-existence of a key 2025-05-02 21:10:05 +02:00
Mike Fährmann
e0913c95b2 [twitter] generate 'x-client-transaction-id' header values (#7382) 
TODO: cache ClientTransaction state on disk
 2025-05-02 12:10:05 +02:00
Mike Fährmann
c9123513af [twitter:ctid] integrate 'transaction-id' code (#7382) 2025-05-02 12:08:11 +02:00
Mike Fährmann
bbb1cc719d [chevereto] fix 'date' metadata (#7437) 2025-04-30 11:05:02 +02:00
Mike Fährmann
95ec8c7414 [manganelo:manga] extract more metadata 
- date_updated
- status
- tags
 2025-04-30 09:01:33 +02:00
Mike Fährmann
7b2bcf68a5 [manganelo] support 'nelomanga.net' and mirror domains (#7423) 
- natomanga.com
- nelomanga.net
- manganato.gg
- mangakakalot.gg
 2025-04-29 21:12:37 +02:00
prowlguru
5fa1e13866 [pixiv:novel] fix 'embeds' extraction with AJAX request (#7422 #7435) 
* [pixiv] fix novel embeds with AJAX request

All novel embeds seem to be broken since
`meta-preload-data` is no longer present in the
html of the php response after a site change.

* [pixiv] remove headers used for old novel embed request

* [pixiv] cleanup novel embed fix

* [pixiv] handle novel embed exceptions

* [pixiv] fix PEP formatting for novel embeds fix

* Fix error message

* [pixiv] include exception info in novel error message

---------

Co-authored-by: prowlguru <prowlguru@github.com>
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-04-28 17:14:41 +02:00
Mike Fährmann
16b5d41ce5 [kemonoparty] add 'endpoint' option (#7438) 2025-04-28 16:47:48 +02:00
Mike Fährmann
f6330bf16d [tests] implement explicit type checks for 'len:' 
for example 'len:dict:3' to check for a dict with 3 items
 2025-04-28 16:26:33 +02:00
Mike Fährmann
0725eab34f [deviantart] unescape \' in JSON data (#6653) 
https://github.com/mikf/gallery-dl/issues/6653#issuecomment-2833783238
 2025-04-28 09:42:16 +02:00
Mike Fährmann
9b43a3677e [pp:directory] add 'directory' post processor (#7432) 2025-04-28 09:08:35 +02:00
Mike Fährmann
7386cb78bc [chevereto] extract 'date' metadata (#7437) 2025-04-27 20:54:10 +02:00
Mike Fährmann
19fc4e0ba4 [job] do not reset skip count when 'skip-filter' fails (#7433) 2025-04-27 19:16:02 +02:00
Mike Fährmann
d7c365e08c [scrolller] fix exception for albums with missing media (#7428) 
fixes regression introduced in a44ea6b3d9
 2025-04-27 17:10:52 +02:00
Mike Fährmann
87f02acd9e release version 1.29.5 2025-04-26 17:32:07 +02:00
Mike Fährmann
a44ea6b3d9 [scrolller] support albums for subreddit results (#7339) 
update GraphQL queries
 2025-04-26 16:41:54 +02:00
Mike Fährmann
3ac33dce61 [pixiv:novel] handle exceptions during embeds extraction (#7422) 2025-04-26 15:11:15 +02:00
Mike Fährmann
3a8f98ad03 merge #7414: [pixiv] fix 'user_details' requests not being cached 2025-04-26 14:52:58 +02:00
prowlguru
6306b110fd [pixiv] fix 'user_details' requests not being cached 
Calls to user_detail would sometimes have an
integer user_id and sometimes string. Since this
is used as a key for caching this function, it
would cause an extra request to be made.

All calls to user_detail should be sending user_id
as a string, to avoid having multiple entries in
the cache, causing an extra request to be made.

Authored by: prowlguru
 2025-04-26 14:50:59 +02:00
Mike Fährmann
fd093c2ef8 [architizer] fix 'project' extractor (#7421) 2025-04-26 09:19:43 +02:00
Mike Fährmann
78b34bbdd7 [subscribestar] fix username & password login 2025-04-25 20:15:00 +02:00
Mike Fährmann
8b7f5eacbb [subscribestar] add warning for missing login cookie 
and update expected cookie domains and names
 2025-04-25 16:20:02 +02:00
Mike Fährmann
2e8b447262 [kemonoparty] fix 'archives' option (#7416) 
use '/vi/file/HASH' API endpoint
since '/v1/posts/archives/HASH' is gone or was renamed
 2025-04-25 11:05:02 +02:00
Mike Fährmann
754b704ca1 merge #7411: [itaku] add 'stars' extractor 2025-04-24 19:48:09 +02:00
Mike Fährmann
f01b4adcc9 [itaku:stars] update 
- remove type hints
- add test
- update docs/supportedsites
 2025-04-24 19:45:48 +02:00
Mike Fährmann
31f85ab678 merge #7412: [weasyl] use 'gallery-dl' User-Agent header 2025-04-24 19:34:27 +02:00
Mike Fährmann
4de7c02322 merge #7409: [pictoa] add support (#6683) 2025-04-24 18:02:34 +02:00
Mike Fährmann
29a4444b21 [pictoa] update 
- simplify code
- update URL patterns
- update tests
- update docs/supportedsites
 2025-04-24 17:59:47 +02:00
Mike Fährmann
25e8a98547 [scrolller] support album posts (#7339) 2025-04-24 16:36:27 +02:00
Deer-Spangle
db89f4a545 [weasyl] Set gallery-dl user agent to match danbooru user agent, when making weasyl requests. 
To fit with their bot ettiquette: https://projects.weasyl.com/bot-etiquette
 2025-04-24 10:04:24 +01:00
Deer-Spangle
6bbedda08b [itaku] Add a new extractor for Itaku stars 2025-04-24 09:59:32 +01:00
nunonda
f342108280 Adding in a first pass at a pictoa extractor 
Adds support for galleries and individual Images
 2025-04-23 17:37:40 -07:00
Mike Fährmann
4b855b1565 [scrolller] retrieve data of single posts via GraphQL 2025-04-22 21:58:29 +02:00
Mike Fährmann
c3fb0f53ee [kemonoparty] use '/posts-legacy' endpoint (#6780 #6931 #7404) 
instead of the "official", broken, and inconsistent endpoint
for creator posts
 2025-04-22 17:26:50 +02:00
Mike Fährmann
ee1ba088b8 [deviantart:stash] extract more metadata (#7397) 
- stash_id
- stash_name
- stash_description
- stash_folder
- stash_parent
 2025-04-22 13:06:05 +02:00
Mike Fährmann
25c2c3a7da merge #4682: [naver] support videos & fix recent 'date' bug (#7395) 2025-04-22 09:25:22 +02:00
noxibow
4c974debf5 [naver] support video downloads (#7395) 
and fix 'date' for posts newer than 24h

- fix naver blogposts directory error for posts created less than 24 hours ago
- add support for videos on naver blogs
- refactor to remove unnecessary imports
- fix video url scraping method
- rework date handling
- rework video extraction
- add 'videos' option
- add test
 2025-04-22 09:14:32 +02:00