Commit Graph

79 Commits

Author SHA1 Message Date
Mike Fährmann
dcd1bd3b6f release version 1.8.2 2019-04-12 10:38:51 +02:00
Mike Fährmann
ec88ff1562 [flickr] relax unit test results
Images are now randomly served from the 'live.staticflickr.com' domain
instead of the "old" 'farmN.staticflickr.com' one, making it impossible
to use static 'url' and 'keyword' hashes as results.

Image quality doesn't appear to be effected by which image-server is
used. Files from 'farmN' and 'live' are the same.
2019-03-30 18:31:59 +01:00
Mike Fährmann
bc2020e86c release version 1.8.1 2019-03-29 17:37:11 +01:00
Mike Fährmann
fb14f80d62 [tumblr] fix avatar URLs for non-OAuth1.0 calls (closes #193) 2019-03-17 11:07:22 +01:00
Mike Fährmann
8c20443839 release version 1.8.0 2019-03-15 15:27:11 +01:00
Mike Fährmann
bc0951d974 allow for simplified test data structures
Instead of a strict list of (URL, RESULTS)-tuples, extractor result
tests can now be a single (URL, RESULTS)-tuple, if it's just one test,
and "only matching" tests can now be a simple string.
2019-02-06 17:24:44 +01:00
Mike Fährmann
b49c3c9991 release version 1.7.0 2019-02-05 16:31:39 +01:00
Mike Fährmann
b8fed34548 add generalized extractors for Mastodon instances (#144)
Extractors for Mastodon instances can now be dynamically generated,
based on the instance names in the 'extractor.mastodon.*' config path.

Example:
{
    "extractor": {
        "mastodon": {
            "pawoo.net": { ... },
            "mastodon.xyz": { ... },
            "tabletop.social": { ... },
            ...
        }
    }
}

Each entry requires an 'access-token' value, which can be generated with
'gallery-dl oauth:mastodon:<instance URL>'.
An 'access-token' (as well as a 'client-id' and 'client-secret') for
pawoo.net is always available, but can be overwritten as necessary.
2019-01-19 14:28:59 +01:00
Mike Fährmann
4b441c162e release version 1.6.3 2019-01-18 12:31:04 +01:00
Mike Fährmann
0afa913de4 [tumblr] add tests for hidden and private blogs (#145)
Hidden / dashboard-only blogs are pretty straightforward and "only"
require a valid 'access-token' and 'access-token-secret' for the given
'api-key' and 'api-secret', so that signed OAuth1.0 requests are possible.

Private / password protected blogs on the other hand are a bit
cumbersome. In addition to a valid 'access-token' and
'access-token-secret', they also require the account belonging to those
tokens to be a member of the blog itself. Knowing the password and
entering it in the website isn't enough to access a blog through the
API. Following a private blog is also impossible, so that option can't
work either.
2019-01-03 16:12:24 +01:00
Mike Fährmann
67cc0ac873 release version 1.6.2 2019-01-01 16:26:58 +01:00
Mike Fährmann
770200888e [gfycat] use public API endpoint 2018-12-02 18:56:53 +01:00
Mike Fährmann
b1e22e8354 release version 1.6.1 2018-11-28 15:34:01 +01:00
Mike Fährmann
c2e59b9a7d update CHANGELOG.md
[ci skip]
2018-11-18 22:33:35 +01:00
Mike Fährmann
d4b2b73bef release version 1.6.0 2018-11-17 18:28:02 +01:00
Mike Fährmann
a36259d8f1 update setup.py
- add Python version check
- add classifiers
- simplify sys.exit() usage
2018-10-24 14:43:37 +02:00
Mike Fährmann
529aa21dd9 move FileAdapter definition into recursive.py 2018-09-16 20:59:22 +02:00
Mike Fährmann
31a5c7c2c0 release version 1.5.3 2018-09-14 18:18:43 +02:00
Mike Fährmann
0bc8ef51c8 [smugmug] Handle albums with no explicit owner (#100) 2018-09-01 12:55:02 +02:00
Mike Fährmann
ff83ee22b0 release version 1.5.2 2018-08-31 20:27:09 +02:00
Mike Fährmann
10365394d7 [twitter] add support for user-timelines (closes #96)
also adds a 'retweets' option to filter retweeted content
2018-08-17 20:04:11 +02:00
Mike Fährmann
e3055d356c release version 1.5.1 2018-08-17 13:21:36 +02:00
Mike Fährmann
a86f2bfc80 [pinterest] update not-found redirects 2018-08-07 12:13:19 +02:00
Mike Fährmann
7442d2940c release version 1.5.0 2018-08-03 17:50:27 +02:00
Mike Fährmann
6996f5c118 [mangahere] fix and improve chapter extraction 2018-07-09 20:07:40 +02:00
Mike Fährmann
764331823b release version 1.4.2 2018-07-06 16:02:40 +02:00
Mike Fährmann
b8c97d2295 use 'extractor.request()' for more HTTP requests 2018-06-25 23:40:59 +02:00
Mike Fährmann
cc15c6105c release version 1.4.1 2018-06-22 16:35:21 +02:00
Mike Fährmann
2d1a104739 [mangadex] unescape manga names and chapter titles
pretty sure I previously tested if unescaping strings from the
embedded JSON object was necessary ... maybe they changed it
2018-06-11 17:53:21 +02:00
Mike Fährmann
3bcce77f6d release version 1.4.0 2018-06-08 22:21:35 +02:00
Mike Fährmann
69a5e6ddb3 Merge branch 'master' into 1.4-dev 2018-05-04 10:19:02 +02:00
Mike Fährmann
82c50fa609 release version 1.3.5 2018-05-04 10:03:20 +02:00
Mike Fährmann
e54b43be08 [mangadex] add title info for chapter extractors 2018-04-22 16:20:04 +02:00
Mike Fährmann
a2020c736e release version 1.3.4 2018-04-20 18:42:09 +02:00
Mike Fährmann
6b72be8ee6 [tumblr] add 'hash' keyword
'hash' is the middle part of the filename in a tumblr image URL.
For example an image with '.../tumblr_p6tgemp1NZ1wgha4yo1_250.png' as
its URL would have 'p6tgemp1NZ1wgha4yo1' as hash.
2018-04-07 15:54:30 +02:00
Mike Fährmann
ffc0c67701 release version 1.3.3 2018-04-06 15:45:45 +02:00
Mike Fährmann
dd314279fb [test] add unit tests for extractor module functions 2018-03-25 11:49:42 +02:00
Mike Fährmann
a993d0ea90 release version 1.3.2 2018-03-23 15:27:56 +01:00
Mike Fährmann
7121eeae8b check supportedsites.rst in release script 2018-03-17 15:35:38 +01:00
Mike Fährmann
c59f9b71f1 release version 1.3.1 2018-03-16 12:29:02 +01:00
Mike Fährmann
749fbbfa6c [mangadex] add chapter- and manga-extractor 2018-03-05 18:37:21 +01:00
Mike Fährmann
b58449fd88 release version 1.3.0 2018-03-02 18:47:17 +01:00
Mike Fährmann
5008e105ee update archive IDs
... to behave in a more straightforward way when dealing with
bookmarks/favourites/etc.

specific IDs are now grouped by their owner, album-id, ... to
allow for duplicates when it would be expected.
2018-03-01 18:20:50 +01:00
Mike Fährmann
d122203be1 [mangastream] fix extraction 2018-02-17 22:40:16 +01:00
Mike Fährmann
8809b32aed release version 1.2.0 2018-02-16 22:29:57 +01:00
Mike Fährmann
6174a5c4ef [download] adjust filename extension on filetype mismatch
(closes #63)
2018-01-17 18:37:06 +01:00
Mike Fährmann
b6797032e3 release version 1.1.2 2018-01-12 15:09:18 +01:00
Mike Fährmann
28cd78aae0 [kissmanga] extend chapter-string regex (closes #58) 2017-12-24 22:53:10 +01:00
Mike Fährmann
0ba618dd1a release version 1.1.1 2017-12-22 17:01:04 +01:00
Mike Fährmann
595593a35e [sankaku] rewrite
- better code structure and extensibility
- better metadata
2017-12-12 18:09:45 +01:00