Commit Graph

3640 Commits

Author SHA1 Message Date
Mike Fährmann
8bb442f20d [redgifs][gfycat] provide fallback URLs (fixes #1962)
and extend the 'format' option
2021-10-22 22:47:29 +02:00
Mike Fährmann
b6443c576d [kemonoparty:discord] extract 'inline' files 2021-10-22 02:50:47 +02:00
Mike Fährmann
bcbf9bcf36 [kemonoparty] split 'discord' extractor (#1940)
in 'server' and 'channel'
2021-10-18 04:04:58 +02:00
Mike Fährmann
db857b40d8 [kemonoparty] improve inline extraction (#1899) 2021-10-17 21:47:11 +02:00
Mike Fährmann
975e0a4fe0 [furaffinity] unquote search queries (#1958)
instead of unescape
(unquote -> url params, unescape -> html entities)
2021-10-17 20:48:08 +02:00
Mike Fährmann
8d676151b7 [patreon] implement 'files' option (#1935) 2021-10-17 04:17:10 +02:00
Mike Fährmann
6695ef2e10 [patreon] better filenames for 'content' images (#1954) 2021-10-16 23:21:14 +02:00
Mike Fährmann
70005e3275 [kemonoparty:discord] support downloading from a specific channel
https://kemono.party/discord/server/<server-id>#<channel-name>>
2021-10-15 18:50:08 +02:00
Mike Fährmann
003f25931d [kemonoparty:discord] provide a 'channel_name' 2021-10-15 18:37:08 +02:00
Mike Fährmann
28bdd58e6d [nhentai] simplify 2021-10-14 16:45:53 +02:00
Mike Fährmann
50098762e3 [nhentai] add 'tag' extractor (closes #1950) 2021-10-14 16:23:47 +02:00
Mike Fährmann
fe6ce5495a [kemonoparty] add 'discord' extractor (#1827, #1940) 2021-10-13 20:33:05 +02:00
Mike Fährmann
918fc9974d [picarto] add 'gallery' extractor (closes #1931) 2021-10-13 01:22:10 +02:00
Mike Fährmann
e33125ad39 [pixiv] add 'sketch' extractor (#1497) 2021-10-13 00:02:11 +02:00
Mike Fährmann
e9dc6ff262 [inkbunny] add 'following' extractor (#515) 2021-10-11 21:10:20 +02:00
Mike Fährmann
9c8fc6e7b4 [inkbunny] match "long" URLs for pools and favorites (#1937) 2021-10-11 17:24:22 +02:00
Mike Fährmann
f33c2ef73b [cyberdrop] extract direct download URLs (#1943)
do not rely on redirects from f.cyberdrop.cc
2021-10-10 23:05:29 +02:00
Mike Fährmann
b93915c113 [inkbunny] add 'pool' extractor (#1937) 2021-10-09 22:07:07 +02:00
Mike Fährmann
373d3e1c57 [seisoparty] implement login with username & password (#1906) 2021-10-08 22:44:31 +02:00
Mike Fährmann
7c5f62b453 [seisoparty] add 'favorite' extractor (#1906) 2021-10-08 22:26:34 +02:00
Mike Fährmann
d93b5474c3 [mangadex] update parameter handling for API requests
- move common parameters into '_pagination()'
- add 'ratings' (#1908) and 'api-parameters' options
2021-10-05 19:46:48 +02:00
Mike Fährmann
cd66c3c415 [twitter] add 'size' option (#1881) 2021-10-05 19:14:54 +02:00
Mike Fährmann
fb98b3fdaf [redgifs][gfycat] remove webtoken code (fixes #1907) 2021-10-01 17:08:33 +02:00
Mike Fährmann
96215c926e [mangadex] fix retrieving chapters from 'pornographic' titles
(fixes #1908)
2021-10-01 16:48:53 +02:00
Mike Fährmann
da9685609c [kemonoparty] update file download URLs
(closes #1902, fixes #1903)
2021-09-30 23:02:46 +02:00
Mike Fährmann
783eae6fc5 [hiperdex] fix extraction 2021-09-30 00:32:34 +02:00
Mike Fährmann
e0bdacd932 [fappic] add 'image' extractor (closes #1898) 2021-09-28 23:35:29 +02:00
Mike Fährmann
9377543162 [mastodon] add 'following' extractor (#1891) 2021-09-26 00:12:34 +02:00
Mike Fährmann
2c2932973c [mastodon] support specifying accounts by ID
Same as a3b473bd for Twitter

Instead of just
https://instance.tld/@user

it is now also possible to refer to that account with
https://instance.tld/users/user
https://instance.tld/@id:12345
https://instance.tld/users/id:12345
2021-09-25 20:28:16 +02:00
Mike Fährmann
94143eb86c [twitter] add 'quote_by' metadata field (#1481)
Only present for tweets quoted by another tweet.
Represents the tweet_id of said tweet quoting this one.
2021-09-25 18:15:14 +02:00
Mike Fährmann
a23f5d45d7 [deviantart] fix bug with fetching premium content (#1879)
When a user has both 'watchers' and 'paid' folders and one of them is
inaccessible, the other one could get handled as inaccessible as well.
2021-09-23 18:02:20 +02:00
Mike Fährmann
ada36c2044 [deviantart] update default archive_fmt for single deviations
(#1874)
use the same as gallery downloads
2021-09-23 18:02:19 +02:00
Mike Fährmann
da16eabb82 [twitter] ensure card entries have a 'url' (#1868) 2021-09-23 18:02:19 +02:00
Mike Fährmann
e69ee41f25 implement 'page-reverse' option (#1854) 2021-09-23 18:02:19 +02:00
cyberdrop-me
c83668c2ff [CyberDrop] Change directory name format (#1871)
Album IDs are random, organization would be much better having the album name then the identifier at the end
2021-09-20 15:20:47 +02:00
Mike Fährmann
e4684c5cb9 [desktopography] simplify (#1740) 2021-09-17 20:09:24 +02:00
Giacomo Rossetto
4a7d7899ff Implement desktopography extractor (#1740) 2021-09-17 19:59:51 +02:00
Alice
9992ff38da [fantia] add 'date' metadata field (#1853) 2021-09-17 19:59:00 +02:00
Mike Fährmann
fba95c3a9e [nozomi] preserve case of search tags (fixes #1860) 2021-09-16 16:43:06 +02:00
Mike Fährmann
4b3e309b90 [aryion] update/improve pagination (#1849)
Manually increment the 'p' query parameter,
instead of relying on a "Next" link which only works up to page 200.
2021-09-16 16:27:25 +02:00
Mike Fährmann
266ed9b62e [aryion] add 'tag' extractor (closes #1849) 2021-09-14 23:33:33 +02:00
Mike Fährmann
6bbeaac029 [mangadex] fix extraction (fixes #1852) 2021-09-14 17:48:41 +02:00
Mike Fährmann
e9bf8d2591 [instagram] update default delay to 6-12 seconds (#1835) 2021-09-14 17:47:11 +02:00
Mike Fährmann
c9e6693530 allow specifying a minimum/maximum for 'sleep-*' options (#1835)
for example '"sleep-request": [5.0, 10.0]' to wait between 5 and 10
seconds between each HTTP request
2021-09-14 17:40:05 +02:00
Mike Fährmann
2ff2974353 [common] update default argument handling in Extractor.request()
more lines of code, but slightly less execution time
2021-09-11 01:26:11 +02:00
Mike Fährmann
0fd959a2a7 [twitter] support '/with_replies' URLs (closes #1833) 2021-09-10 20:44:26 +02:00
Mike Fährmann
e93360e45d [reddit] extend subcategory depending on input URL (closes #1836)
- https://www.reddit.com/r/lavaporn/
  -> 'subreddit'

- https://www.reddit.com/r/lavaporn/new/
  -> 'subreddit-new'

- https://www.reddit.com/user/username/
  -> 'user'

- https://www.reddit.com/user/username/gilded/
  -> 'user-gilded'
2021-09-10 20:44:17 +02:00
Mike Fährmann
7bbb1f92d7 [gelbooru_v02] add 'favorite' extractor (closes #1834) 2021-09-10 20:43:59 +02:00
Mike Fährmann
4ec11af6a4 [kemonoparty] implement login with username & password (#1824) 2021-09-09 01:06:25 +02:00
Mike Fährmann
0e33746fe0 [artstation] use '/album/all' view for user portfolios (#1826) 2021-09-08 21:46:58 +02:00