Commit Graph

37 Commits

Author SHA1 Message Date
Mike Fährmann
bce51e90a5 [reddit] support sorting options and sub-options (#15)
Example:
    https://www.reddit.com/r/<subreddit>/top/?sort=top&t=month
    (the 'sort=top' parameter is irrelevant and can be omitted)
2017-05-29 12:45:35 +02:00
Mike Fährmann
cbb4323f66 add setup.cfg to configure flake8 2017-05-19 19:22:39 +02:00
Mike Fährmann
b6b214f7e9 [deviantart] fix headers for custom-style journals
example: http://shimoda7.deviantart.com/journal/Temporary-absence-231936282
2017-05-15 15:58:06 +02:00
Mike Fährmann
e9a2738257 [deviantart] support images on top of journal entries
example: http://raxnae.deviantart.com/art/Kami-s-Journal-679482236
2017-05-13 21:42:29 +02:00
Mike Fährmann
92597f46d4 [deviantart] add title to journals 2017-05-13 15:36:52 +02:00
Mike Fährmann
107d29ad8a improve handling of text:... URLs
- don't require // after the colon
- open output files in text mode
2017-05-12 14:10:25 +02:00
Mike Fährmann
677c8ced11 [deviantart] add "journal" extractor
(#14)
2017-05-10 17:21:33 +02:00
Mike Fährmann
e5f79ae839 [deviantart] add support for all media types
- this includes
  - images
  - videos
  - flash-animations
  - journals

- also renamed some of the extractors
  - User  -> Gallery
  - Image -> Deviation
2017-05-10 16:45:45 +02:00
Mike Fährmann
9f1c83297f [pinterest] allow URLs with any TLD 2017-05-08 15:08:39 +02:00
Mike Fährmann
b3b92ac243 [deviantart] support "All" favorites and add "mature" option
- since there is apparently no actual way to get the "All" favorites
  listing via API, corresponding URLs (.../favourites/?catpath=/) will
  be handled by yielding all deviations from all favorite collections of
  that user

- the "mature" config key works on a per extractor basis (like "username"
  or "password"). values can be the strings "true" or "false", or the
  booleans true or false.

- (#14)
2017-05-06 21:26:27 +02:00
Mike Fährmann
7376ad7f3d [deviantart] turn the "Mature Content Filter" off
(#14)
2017-05-06 14:56:41 +02:00
Mike Fährmann
af56887a47 [exhentai] fall back to e-hentai if no username is given 2017-04-28 15:59:56 +02:00
Mike Fährmann
13dc5d72bc update some extractors to use https 2017-04-20 13:32:40 +02:00
Mike Fährmann
0770de0ea1 [deviantart:image] add support for sta.sh URLs 2017-04-17 11:52:16 +02:00
Mike Fährmann
11ce871718 [deviantart] add favourites-extractor 2017-04-03 18:23:13 +02:00
Mike Fährmann
d430732502 [deviantart] update extractors
- use base class for all extractors
- use API for single images
- add support for more API endpoints
- add additional keywords
2017-04-03 14:56:47 +02:00
Mike Fährmann
f622411be5 [deviantart] implement 'skip' method 2017-03-13 21:42:16 +01:00
Mike Fährmann
379125746a [deviantart] improve API error handling
(#7)
2017-03-08 16:40:20 +01:00
Mike Fährmann
2c2de778f2 [deviantart] adjust error message 2017-03-06 19:27:45 +01:00
Mike Fährmann
f36d685ce1 [deviantart] always request access token before api calls
(#7)
2017-03-05 02:22:36 +01:00
Mike Fährmann
38aa496ecb [deviantart] restore tests + set api version 2017-02-23 20:58:39 +01:00
Mike Fährmann
39b1a18f12 [deviantart] fix issue with missing 'content'-key 2017-02-22 01:42:08 +01:00
Mike Fährmann
94e10f249a code adjustments according to pep8 nr2 2017-02-01 00:53:19 +01:00
Mike Fährmann
72d3ca0bf9 [deviantart] use API for user-extractor 2017-01-12 21:08:49 +01:00
Mike Fährmann
58ce0b55e3 [deviantart] make sure to pick the highest quality image 2016-11-06 10:44:50 +01:00
Mike Fährmann
56d810c896 update keyword hashes for tests 2016-09-25 17:28:46 +02:00
Mike Fährmann
19c2d4ff6f remove explicit (sub)category keywords 2016-09-25 14:22:07 +02:00
Mike Fährmann
d7e168799d consistent extractor naming scheme + docstrings 2016-09-12 10:34:31 +02:00
Mike Fährmann
2449532132 add more extractor test-cases 2015-12-13 04:36:44 +01:00
Mike Fährmann
5589bc2ed7 [deviantart] fix non-terminating loop 2015-12-13 03:16:08 +01:00
Mike Fährmann
995d8578bf [deviantart] fix dates in image-extractor 2015-12-07 00:34:41 +01:00
Mike Fährmann
7d965a2897 [deviantart] add single image extractor 2015-12-06 21:13:57 +01:00
Mike Fährmann
e4a661fd6b [deviantart] fix issue with small images 2015-12-06 14:24:27 +01:00
Mike Fährmann
4d56b76aa8 update all other extractors 2015-11-21 04:26:30 +01:00
Mike Fährmann
c2f0720184 code cleanup to use nameext_from_url 2015-11-16 17:32:26 +01:00
Mike Fährmann
7d7c1afe20 [deviantart] adjust constructor paramters 2015-10-05 17:06:58 +02:00
Mike Fährmann
ae535ba0c1 add extractor 'deviantart' 2015-10-04 04:13:50 +02:00