Commit Graph

4118 Commits

Author SHA1 Message Date
Mike Fährmann
f58b0e6fc7 [twitter] ignore 'Unavailable' media (#5736)
… including geo-restricted content.

add 'unavailable' option to allow re-enabling them again
2024-06-21 00:15:10 +02:00
Mike Fährmann
8452d04a33 [fanbox] handle KeyError for no longer existing plans (#5759)
return the plan of the next higher tier instead
2024-06-21 00:13:25 +02:00
Mike Fährmann
11421cf940 [skeb] fix '429 Too Many Requests' errors (#5766)
Introduce '_handle_429' method to make it easier for Extractors to react
to 429 errors regardless of 'sleep-429' settings.
2024-06-21 00:12:05 +02:00
Mike Fährmann
60b4541199 improve a1bb3279, fix oauth:pixiv (#5757)
Check 'input' option only when required.

This also fixes an exception in oauth:pixiv caused by using the same
'_input' name  as a method defined there.
2024-06-18 16:50:04 +02:00
Mike Fährmann
a1bb32792b do not try to read from stdin when it is non-interactive (#5733)
add '--no-input' command-line option and 'input' config file option
to allow users to manually configure this
2024-06-16 18:31:39 +02:00
Mike Fährmann
ae3706286a [speakerdeck] inherit from GalleryExtractor 2024-06-15 21:56:51 +02:00
Mike Fährmann
a92c0bef96 merge #5730: [speakerdeck] fix extraction 2024-06-13 15:55:57 +02:00
Yuta Hayashibe
f272b5d2ac fix: extractor for speakerdeck.com 2024-06-13 15:54:54 +02:00
Mike Fährmann
c699ce8ebb [twitter] add 'username-alt' option (#5715) 2024-06-13 00:54:43 +02:00
Mike Fährmann
c6fc0281e8 [newgrounds] extend 'format' option (#5709)
- check more extensions for original formats (mp4, webm, m4v, mov, mkv)
- allow specifying which extensions and recoded formats to check
2024-06-12 20:46:45 +02:00
Mike Fährmann
86f0c3baaf [szurubooru] support empty tag searches (#5711) 2024-06-11 20:25:06 +02:00
Mike Fährmann
40c685dc43 merge #5712: [hentainexus] update key 2024-06-10 19:58:03 +02:00
KageNiHisomu
87859ff200 fix: static method defines hostname, update url link 2024-06-10 14:35:03 +10:00
KageNiHisomu
68540aef2a update nexus key 2024-06-10 14:25:51 +10:00
Mike Fährmann
2e11b6e756 [nijie] support downloading videos (#5707, #5617) 2024-06-08 22:55:28 +02:00
Mike Fährmann
e17b1d5073 [deviantart] fix 2c8aa9b2 (#5696) 2024-06-08 02:00:36 +02:00
Mike Fährmann
f160859c5c [hitomi] extract 'title_jpn' metadata (#5706) 2024-06-08 00:05:19 +02:00
Mike Fährmann
722b4b513d merge #5609: [instagram] extract 'liked' metadata 2024-06-07 01:43:13 +02:00
Mike Fährmann
7b0c07ee69 [instagram] rename to 'liked', enable for GraphQL results 2024-06-07 01:41:56 +02:00
Mike Fährmann
aa9be75d44 [twitter] fix duplicate ArkoseLogin check
forgot to replace this in 9e5d65fbf3
2024-06-06 19:44:42 +02:00
Mike Fährmann
2c8aa9b2de [deviantart] fix watching module ID extraction (#5696) 2024-06-06 15:21:04 +02:00
Mike Fährmann
9abeab5ecf [shimmie2] support 'vidya.pics' (#5632) 2024-06-06 15:08:56 +02:00
Mike Fährmann
162d4269ec [twitter] extend 'ratelimit' option (#5532)
allow waiting for a set amount of seconds
2024-06-06 01:18:08 +02:00
Mike Fährmann
2cab87c5b6 [kemonoparty:favorite] fix exception when sorting None (#5692) 2024-06-05 16:49:30 +02:00
Mike Fährmann
9b99d2c886 [philomena] support downloading SVG files (#5643) 2024-06-05 16:48:51 +02:00
Mike Fährmann
8fce9ea6d5 [hentainexus] restore module (#5275)
revert 97641cd151
2024-06-05 16:48:25 +02:00
Mike Fährmann
5d3d03a1f1 fix 6cfbc107
the former condition would return True for 2.31.*
6cfbc1071f (commitcomment-142642913)
2024-06-02 18:16:53 +02:00
Mike Fährmann
4d11cd9ffb [vichan] remove 'wikieat.club'
redirects to some non-vichan site
2024-06-02 18:16:24 +02:00
Mike Fährmann
31133b97fb [nitter] remove instances 2024-06-02 18:15:53 +02:00
Mike Fährmann
ce228ee163 [photobucket] remove module
had been broken for years and the new site is payed access only
2024-06-02 01:40:31 +02:00
Mike Fährmann
6cfbc1071f workaround for requests 2.32.3 (#5665)
manually call 'load_default_certs()' for SSLContexts
in custom HTTPAdapter instances
2024-06-01 16:02:18 +02:00
Mike Fährmann
807e2f7094 [realbooru] fix videos and provide fallback URLs (#2530)
revert acc94ac187.
2024-05-31 23:58:40 +02:00
Mike Fährmann
deacbcbfdf [tbscans] remove excess whitespace in 'manga' 2024-05-31 22:32:59 +02:00
Mike Fährmann
00440b8fb1 [slideshare] fix extraction 2024-05-31 21:05:50 +02:00
Mike Fährmann
281ab33f87 [4archive] fix extraction 2024-05-31 17:42:53 +02:00
Mike Fährmann
a53db09ca0 [artstation] disable TLS 1.2 ciphers by default (#5564, #5658) 2024-05-30 23:54:19 +02:00
Mike Fährmann
020050ea8b merge #5641: [pixeldrain] add support for single file album download 2024-05-25 23:43:43 +02:00
Mike Fährmann
154a890399 [pixeldrain] integrate into 'album' extractor 2024-05-25 23:42:23 +02:00
HornyQT
24e70b956b [pixeldrain] add support for single file album download 2024-05-25 16:06:50 +02:00
Mike Fährmann
0761b22a7f [hiperdex] update domain to 'hiperdex.top' (#5635) 2024-05-24 17:13:10 +02:00
Mike Fährmann
ea434963ae [subscribestar] fix file URLs (#5631) 2024-05-23 19:12:01 +02:00
Mike Fährmann
6198dfa424 [seiga] re-implement login with username & password 2024-05-23 18:52:53 +02:00
Mike Fährmann
329da4db5e [newgrounds] update and fix login procedure (#5109) 2024-05-23 17:06:22 +02:00
Mike Fährmann
bc25636e63 [patreon] fix bootstrap data extraction (#5624)
again
2024-05-22 00:17:49 +02:00
Mike Fährmann
141efc2ad3 [twitter] transfer 'twitter.com' cookies to 'x.com' (#5597) 2024-05-21 23:46:42 +02:00
Jan Wikholm
ece3837408 Enable user_has_liked as IG download filter
Background and context:

1. Instagram by default requires you to be logged in.
2. Your account can LIKE posts.
3. Getting all of your likes from IG can be a pain.

As an active IG user, I want to be able to download only posts I've liked.

The information of whether or not your logged-in user has liked the target post is available in the API results, but was not available to the end-user for filtering.

This small change allows `user_has_liked` to be used to e.g. download only liked posts of an entire IG account.

Example use:

```
$ gallery-dl --cookies-from-browser FIREFOX--filter 'user_has_liked' https://www.instagram.com/imgur/
```

This will only download the posts that have `has_liked: True` set in the returned REST API data.

Note: it will still need to loop through the entire account's posts since this is done per-post basis instead of looping just the liked posts, but at least you are able to use this IG feature as a download marker.
2024-05-18 12:05:08 +03:00
Mike Fährmann
6276f5cd94 [twitter] update domain to x.com (#5597) 2024-05-17 22:59:52 +02:00
Mike Fährmann
bfcb66af05 [poipiku] send LANG cookie to ensure English UI (#5590) 2024-05-17 22:59:31 +02:00
Mike Fährmann
f651b3b6ab merge #5601: [twitter] match '/video/' Tweet URLs 2024-05-17 22:49:12 +02:00
Mike Fährmann
2dec4bef60 merge #5591: [poipoku] avoid language-specific extraction 2024-05-17 22:47:51 +02:00