Commit Graph

26 Commits

Author SHA1 Message Date
Mike Fährmann
46b6b71159 [wallhaven] extract 'search[tags]' and 'search[tag_id]' metadata
(#6772)
2025-01-06 17:18:04 +01:00
Mike Fährmann
a453335a9f remove test results in extractor modules
and add generic example URLs
2023-09-11 16:30:55 +02:00
Mike Fährmann
a383eca7f6 decouple extractor initialization
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().

This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
2023-07-25 22:16:16 +02:00
Mike Fährmann
92d98697b2 [wallhaven] update API error message 2023-06-18 20:00:34 +02:00
Mike Fährmann
339fcdb8ad [wallhaven] handle '429 Too Many Requests' errors (#4192)
- set 1.4s delay between API requests
  (WH allows 45 requests per minute)
- wait and retry on 429 errors
2023-06-17 13:47:00 +02:00
enduser420
7897f68225 [wallhaven] update 'user' extractor (#3226)
* [wallhaven] update 'user' extractor

* [wallhaven] update 'configuration.rst'

add 'extractor.wallhaven.include' entry

* [wallhaven] add 'wallhaven.include' in gallery-dl.conf
2022-11-15 17:35:52 +01:00
enduser420
5a68b5cb3c [wallhaven] add 'user' extractor (#3213) 2022-11-15 12:25:12 +01:00
Mike Fährmann
b8d268f57e allow '/' and '?' in URL queries 2022-10-02 19:02:05 +02:00
Mike Fährmann
a69f198ac9 [wallhaven] implement 'metadata' option (#2803) 2022-08-08 21:46:36 +02:00
Mike Fährmann
c6a9bab019 update extractor test results 2022-07-12 15:49:22 +02:00
Mike Fährmann
e165e6c265 [wallhaven] add 'collections' extractor (#1351) 2021-03-02 01:32:26 +01:00
Mike Fährmann
faf561b6ca [wallhaven] add 'collection' extractor (#1351) 2021-03-01 17:12:11 +01:00
Mike Fährmann
5d3d94ba14 [wallhaven] refactor 2021-03-01 17:06:24 +01:00
Mike Fährmann
c51fbd72ba update extractor test results 2020-07-13 22:57:48 +02:00
Mike Fährmann
4e361b3008 add tests for specific datetime values 2020-02-23 16:48:30 +01:00
Mike Fährmann
2c332edaad [plurk] fix comment pagination 2019-11-27 19:39:56 +01:00
Mike Fährmann
ef17d94469 update test results 2019-10-21 21:53:21 +02:00
Mike Fährmann
d33f5a7423 [wallhaven] rewrite
- use API
- remove login support, add 'api-key' option
- remove support for "alpha" subdomain - alpha.wallhaven.cc used numeric
  IDs that can't be translated to the new ID system
- support direct links to wallpapers
2019-05-31 14:53:02 +02:00
Mike Fährmann
a2af2d2965 adjust cache maxage values 2019-03-14 22:21:49 +01:00
Mike Fährmann
4b1880fa5e propagate 'match' to base extractor constructor 2019-02-11 13:31:10 +01:00
Mike Fährmann
6284731107 simplify extractor constants
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
2019-02-08 13:45:40 +01:00
Mike Fährmann
22d7a783d5 update extraction result tests 2019-02-02 15:37:54 +01:00
Mike Fährmann
dd358b4564 improve cookie handling during logins 2019-01-30 17:09:32 +01:00
Mike Fährmann
1532d1b690 fix 'range' tests and update a few test results 2018-10-08 23:53:58 +02:00
Mike Fährmann
6ea9a78588 [wallhaven] add login capabilities
Being logged in is required to access NSFW wallpapers.
2018-09-19 21:04:01 +02:00
Mike Fährmann
c9290d8212 [wallhaven] add wallpaper and search extractors
todo:
- login support to gain access to NSFW wallpapers
- extractors for tag-, similar-, latest-listings
- skip() support
2018-09-17 21:26:13 +02:00