Commit Graph

4515 Commits

Author SHA1 Message Date
Mike Fährmann
a96745368e "fix" tests on Python 3.4 and 3.5
can't rely on dict insertion order
2023-04-26 19:31:27 +02:00
Mike Fährmann
7865067d19 [shimmie2] add generic extractors for Shimmie2 sites (#3734)
add support for
- loudbooru.com       (#3734)
- booru.cavemanon.xyz (#3734)
- giantessbooru.com   (#943)
- tentaclerape.net
2023-04-26 19:20:44 +02:00
Mike Fährmann
28419bf45a [itchio] add 'game' extractor (#3923) 2023-04-26 19:20:43 +02:00
Mike Fährmann
3905f05f00 [postprocessor:metadata] support putting keys in quotes
for mode 'modify' and 'delete'
based on fe41a2b1
2023-04-25 14:30:18 +02:00
Mike Fährmann
7459e4abce [postprocessor:metadata] fix traversing more than 1 level deep
for mode 'modify' and 'delete'
2023-04-25 14:17:25 +02:00
Mike Fährmann
5297ee0cd9 [tumblr] add 'day' extractor (#3951) 2023-04-24 22:01:47 +02:00
Mike Fährmann
de670bd7de [tumblr] update pagination logic (#2191) 2023-04-24 20:07:10 +02:00
Mike Fährmann
98c9fdb414 [deviantart] revert e9353c63; retry downloads with private token 2023-04-23 21:10:16 +02:00
Mike Fährmann
5d7435e803 [nitter] extract user IDs from encoded banner URLs
still requires a banner to be present to begin with
2023-04-23 19:13:27 +02:00
Mike Fährmann
7f25cab56e [sankaku] support post URLs with MD5 hashes (#3952) 2023-04-23 16:46:40 +02:00
Mike Fährmann
a05120412a [oauth] catch exception from 'webbrowser.get()' (#3947)
It raises an exception instead of returning None
when no runnable browser is available.
2023-04-23 15:00:09 +02:00
Mike Fährmann
b81ce381f0 fix backticks for 'extractor.redgifs.format' docs
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1518331927
2023-04-21 23:12:01 +02:00
Mike Fährmann
3fc2223893 merge #3935: [reddit] match 'preview.redd.it' URLs 2023-04-21 20:09:20 +02:00
Mike Fährmann
1d505b39f8 [twitter] support 'profile-conversation' entries (#3938) 2023-04-21 15:08:50 +02:00
Mike Fährmann
aaf58a1259 [imgur] document 'client-id' option (#3937) 2023-04-21 15:08:50 +02:00
Mike Fährmann
202f5d86a7 [reddit] ignore 'id-max' value "zik0zj"/2147483647
(#3939, #3862, #3697, #3606, #3546, #3521, #3412)
2023-04-21 15:08:50 +02:00
Mike Fährmann
8586ee81be [nana] fix 'keyword' tests 2023-04-21 15:08:50 +02:00
ClosedPort22
cd4bfb0dd1 [reddit] match 'preview.redd.it' URLs 2023-04-20 15:54:09 +08:00
Mike Fährmann
e07ceb90b3 fix 'executables.yml' workflow
or at least attempt to
2023-04-19 20:35:24 +02:00
Mike Fährmann
faca32a850 [sankaku] sanitize 'date:…' tags (#1790) 2023-04-19 20:09:11 +02:00
Mike Fährmann
6f1e34ec69 [vipergirls] add 'thread' and 'post' extractors
(#731, #2720, #3812)
2023-04-19 15:28:26 +02:00
Mike Fährmann
81bd2af83e [2chen] update domain to sturdychan.help 2023-04-19 13:54:44 +02:00
Mike Fährmann
f424d1fc23 include more optional dependencies in PyInstaller executables
(#3907)

- pyyaml
- toml (for Python<3.11)
- secretstorage (on Linux)
2023-04-18 20:51:31 +02:00
Mike Fährmann
f2cebd1db0 add PyYAML, toml, and SecretStorage to optional dependency list
(#3827)
2023-04-18 20:50:46 +02:00
Mike Fährmann
f500b45b5e [twitter] improve 480bc34e
only check for double user assignment where necessary
2023-04-18 20:50:23 +02:00
Mike Fährmann
5b635f2317 [imxto] add 'gallery' extractor (#1289) 2023-04-17 20:49:09 +02:00
Mike Fährmann
359e31e462 [nozomi] update file URLs (#3925)
Static images are now only available in WebP format over the 'w'
subdomain. GIFs also got their own 'g' subdomain.
2023-04-17 15:42:42 +02:00
Mike Fährmann
2dfd4a3de2 [imagefap] extract 'categories' metadata and fix empty 'tags' 2023-04-17 14:49:50 +02:00
Mike Fährmann
480bc34e54 [twitter] do not overwrite previously assigned users (#3922) 2023-04-16 17:30:43 +02:00
Mike Fährmann
02ec5bb8e5 [imagefap] extract 'description' metadata (#3905) 2023-04-16 17:02:16 +02:00
Mike Fährmann
842f964c49 release version 1.25.2 2023-04-15 22:31:10 +02:00
Mike Fährmann
d253a3c542 merge #3841: [urlshortener] add support for bit.ly & t.co 2023-04-15 18:08:21 +02:00
Mike Fährmann
5e63942b37 [urlshortener] update 2023-04-15 18:06:06 +02:00
Mike Fährmann
2edcdee32f [downloader:http] add MIME type and signature for .heic files
(#3915)
https://github.com/strukturag/libheif/issues/83
2023-04-15 17:09:22 +02:00
Mike Fährmann
c45f09d2a8 [imagechest] fix extraction (#3914) 2023-04-14 20:06:59 +02:00
Mike Fährmann
2cd4411ff8 [nitter] extract videos from 'source' elements (#3912) 2023-04-14 19:00:56 +02:00
Mike Fährmann
9501579279 [sexcom] fix fetching HD videos 2023-04-13 15:40:53 +02:00
Mike Fährmann
a2f7274eae [sexcom] fix pagination (#3906) 2023-04-13 15:39:15 +02:00
Mike Fährmann
e9353c63d6 [deviantart] keep using private access tokens
for deviations returned from a private API call

also fixes a bug from 0a7eee3e where '_pagination()'
would never switch from unspecified (None) to private access token
2023-04-13 14:46:06 +02:00
Mike Fährmann
e70af6a550 [hentaifoundry] do not update filters when cookies are provided 2023-04-13 14:16:53 +02:00
Mike Fährmann
9c29c904c7 [mastodon] try to get account IDs without access token
Try to query the public '/api/v1/accounts/lookup' endpoint
and fall back to '/v1/accounts/search' if it returns an error.

'/api/v1/accounts/lookup' is available since Mastodon v3.4.0.
The version of an instance can be found at '/api/v1/instance'.
2023-04-13 14:03:23 +02:00
Mike Fährmann
1614c5c4bf [generic] write regular expressions without 'x' flags 2023-04-10 20:45:23 +02:00
Mike Fährmann
d84a617273 [hentaifoundry] fix setting content filters (#3887) 2023-04-09 18:04:49 +02:00
ClosedPort22
875485313f [urlshortener] force HTTPS 2023-04-09 18:19:52 +08:00
Mike Fährmann
0a7eee3ee0 [deviantart] add 'public' option 2023-04-08 23:04:34 +02:00
Mike Fährmann
f5a59c4170 [twitter] add 'date_bookmarked' metadata (#3816) 2023-04-06 20:16:25 +02:00
Mike Fährmann
1c1f6fdc80 [twitter] fix regression from 160335ad
Tweets from 'homeConversation' or 'conversationthread' entries do not
contain a 'sortIndex' field. Accessing it raises a KeyError and would
erroneously get them labeled as 'deleted'.
2023-04-06 19:22:48 +02:00
Mike Fährmann
160335ad44 [twitter] add 'date_liked' metadata for liked Tweets (#3816) 2023-04-06 18:33:45 +02:00
Mike Fährmann
6d850ce629 [twitter] calculate 'date' from Tweet IDs
20 times faster than parsing 'created_at'
2023-04-05 22:29:14 +02:00
Mike Fährmann
25949bd767 merge #3871: [hotleak] Fix downloading of creators whose name starts with a category name 2023-04-04 16:24:20 +02:00