Commit Graph

3267 Commits

Author SHA1 Message Date
Mike Fährmann
4e9f8fe395 [shopify] support windsorstore.com (#1793) 2021-08-28 18:34:12 +02:00
Mike Fährmann
95157e0f4b [shopify] use API for product listings (#1793) 2021-08-28 18:23:22 +02:00
Mike Fährmann
292fffc83c add 'j' format string conversion
to convert to a JSON formatted string
2021-08-28 01:19:36 +02:00
Mike Fährmann
6651da27e9 [twitter] fix 'url' extraction for users without 'expanded_url'
(#1532, #1787)
2021-08-27 18:41:16 +02:00
Mike Fährmann
ecc8da4704 [deviantart] implement a 'watch' option (#1466, #1757) 2021-08-27 18:39:43 +02:00
Mike Fährmann
a4f249c22e [deviantart] prevent exception on empty videos (fixes #1796) 2021-08-25 20:14:50 +02:00
Mike Fährmann
ae78d95a5f [twitter] fix issue when filtering quote tweets (#1792)
When a user quotes his own Tweet and that Tweet gets filtered by
'"quoted": false', it could also get filtered when it appeared later
as regular Tweet.
2021-08-25 20:04:22 +02:00
Mike Fährmann
d3eab417ed implement a 'path-strip' option 2021-08-24 23:23:12 +02:00
Mike Fährmann
72c0cd30c7 do not return with a nonzero exit status when no results found
also change loglevel from 'warning' to 'info'
(#1789)
2021-08-24 18:49:13 +02:00
Mike Fährmann
6b229ac829 [furaffinity] expand URL pattern for searches (closes #1780) 2021-08-23 23:38:52 +02:00
Mike Fährmann
0817f468ef [twitter] expand t.co links in user descriptions (#1532, #1787) 2021-08-23 23:34:59 +02:00
Mike Fährmann
7c0ae88185 [twitter] add 'url' to user objects (#1532, #1787) 2021-08-23 22:51:35 +02:00
Mike Fährmann
5919dc5b5a [twitter] slightly improve '_transform_user()' 2021-08-23 22:28:09 +02:00
Mike Fährmann
c04f7ab139 [foolfuuka] add 'gallery' extractor (#1785) 2021-08-21 22:46:23 +02:00
Mike Fährmann
ddd175de77 [mangadex] prevent KeyError for manga without English title 2021-08-21 22:46:23 +02:00
Mike Fährmann
20ee091289 [429chan] add 'thread' and 'board' extractors (closes #1773) 2021-08-21 22:46:22 +02:00
Mike Fährmann
6b56b3ebe1 [twitter] report API errors as generic StopExtraction exceptions
prevents duplicate logging messages for nonexistent users
(#1759)
2021-08-21 22:46:22 +02:00
Mike Fährmann
51eb50749f [foolslide] remove entry for kobato.hologfx.com 2021-08-21 22:46:22 +02:00
Mike Fährmann
4718f9c5dd [oauth] use defaults when config values are set to None/null
(fixes #1778)
2021-08-21 22:46:01 +02:00
James C. Wise
1f02878351 [Deviantart] [#1776] Remove the "you need session cookies to download mature scraps" warning (#1777) 2021-08-16 22:50:53 +02:00
Mike Fährmann
bb6a130942 automatically set required DDoS-GUARD cookies (#1779)
for kemono.party and seiso.party
2021-08-16 17:40:29 +02:00
Mike Fährmann
bd08ee2859 remove most 'yield Message.Version' statements
only leave them in oauth.py as noop results
2021-08-16 03:10:48 +02:00
Mike Fährmann
bdfdabf498 show warning if extractor doesn't yield any results (#1759) 2021-08-16 02:49:36 +02:00
Mike Fährmann
d320ee6251 implement a 'fallback' option (closes #1770) 2021-08-16 01:47:59 +02:00
Mike Fährmann
c866fcba48 [twitter] fix 'logout' (#1719)
delete 'auth_token' cookie and cookies.txt path
2021-08-16 01:36:34 +02:00
Mike Fährmann
9cb5ea5eda update default User-Agent headers 2021-08-14 04:01:41 +02:00
Mike Fährmann
1e0f59d902 release version 1.18.3 2021-08-13 21:20:36 +02:00
Mike Fährmann
52984f7e22 [twitter] add option to log out when blocked (#1719) 2021-08-12 19:11:41 +02:00
Mike Fährmann
ed4b3c48cb fix flake8 and other tests 2021-08-12 16:05:26 +02:00
enormous-muscles
975e1ac6e2 Add Wikieat extractor (#1699)
* Add Wikieat extractor

* Add Wikieat extractor to extractor list
2021-08-12 15:13:20 +02:00
Nyasume
fa6af46756 Added ability to download GIFs instead of mp4 from Luscious and Reactor (#1701) 2021-08-12 15:12:42 +02:00
Ryu JuHeon
9429eaa0a3 [hitomi]: fix image URLs (#1765) 2021-08-12 14:39:10 +02:00
Mike Fährmann
c34dbc86bb [kemonoparty] update file server domain (#1764) 2021-08-10 22:24:08 +02:00
Mike Fährmann
e5a93e113f [twitter] extend 'replies' option (#1254)
Allow setting 'replies to '"self"' to only download from self-replies.
2021-08-10 22:14:00 +02:00
Mike Fährmann
f9096584ab [behance] fix 'collection' extraction 2021-08-10 00:48:31 +02:00
Mike Fährmann
229498b8aa [twitter] warn about suspended accounts etc (closes #1759) 2021-08-09 02:58:27 +02:00
Mike Fährmann
a5de2244d4 [furaffinity] fix using 'category-tranfer' (#1274) 2021-08-08 23:50:32 +02:00
Mike Fährmann
cadfad4eea [danbooru] add 'external' option (closes #1747) 2021-08-08 19:18:41 +02:00
Mike Fährmann
5b1c62bfa9 [furaffinity] add 'external' option (closes #1492) 2021-08-08 19:16:02 +02:00
Mike Fährmann
b5b1cf22b7 [downloader:http] reorder HTTP header sources
so that any header can be overwritten by a user, except Range
2021-08-05 23:01:54 +02:00
Mike Fährmann
5d5ab669fa [instagram] use custom User-Agent header for video downloads
(#1682, #1623, #1580)
2021-08-05 22:26:47 +02:00
Mike Fährmann
7b029dfe85 [instagram] increase default delay between HTTP requests to 8s
(closes #1732)
2021-08-05 22:08:35 +02:00
Mike Fährmann
5eca3781be [kemonoparty] fix username extraction (#1750) 2021-08-04 16:09:22 +02:00
Mike Fährmann
fe970fc87f [vk] prevent exception for empty/private profiles (fixes 1742) 2021-08-02 15:38:51 +02:00
Mike Fährmann
ac91a84543 [bbc] provide fallback URLs (#1706) 2021-07-30 01:14:07 +02:00
Mike Fährmann
a316e44f8e [bbc] add 'width' option (#1706) 2021-07-30 01:09:32 +02:00
Mike Fährmann
c37c2818fb [nsfwalbum] retry all requests when extracting image URLs
(#1733, fixes #1271)
2021-07-30 00:23:04 +02:00
Mike Fährmann
220cfe244e [deviantart] get original files for GIF previews (#1731) 2021-07-30 00:20:53 +02:00
Mike Fährmann
7a0da4f93f [newgrounds] add 'format' option (closes #1729) 2021-07-29 19:11:20 +02:00
Mike Fährmann
223a4e79cd [newgrounds] fix using 'category-tranfer' (#1274) 2021-07-29 15:54:04 +02:00