Mike Fährmann 84756982e9 [pixiv] implement 'include' option ...

- split 'user' extractor and its 'avatar' and 'background' options into
  separate extractors ('artworks', 'avatar', 'background')
- avatars can now be downloaded with
  https://www.pixiv.net/en/users/ID/avatar
  as URL and will use a proper archive key; similar for backgrounds
- options for the 'user' subcategory must be moved to 'artworks' to have
  the same effect as before

2022-05-02 09:03:35 +02:00

..

__init__.py

[gofile] add gofile.io extractor (#2364)

2022-03-29 17:31:57 +02:00

2chan.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

3dbooru.py

[moebooru] add generalized extractors for moebooru sites

2020-12-01 22:27:18 +01:00

4chan.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

8kun.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

8muses.py

update extractor test results

2021-11-01 02:58:53 +01:00

35photo.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

420chan.py

[429chan] add 'thread' and 'board' extractors (closes #1773)

2021-08-21 22:46:22 +02:00

500px.py

[500px] create directories per photo

2021-12-25 17:16:45 +01:00

adultempire.py

update extractor class hierarchies

2019-10-16 18:15:29 +02:00

architizer.py

update extractor test results

2021-07-20 20:21:33 +02:00

artstation.py

[artstation] use "browser": "firefox" by default (#2527)

2022-05-02 09:03:13 +02:00

aryion.py

[aryion] provide correct 'date' independent of dst

2022-03-24 22:57:18 +01:00

bbc.py

[bbc] provide fallback URLs (#1706)

2021-07-30 01:14:07 +02:00

bcy.py

update extractor test results

2021-11-01 02:58:53 +01:00

behance.py

update extractor test results

2022-02-06 21:39:24 +01:00

blogger.py

[blogger] support new image domain (fixes #2204)

2022-01-20 23:13:07 +01:00

booru.py

[booru] call nameext_from_url() before update() and _prepare()

2022-02-18 00:37:59 +01:00

comicvine.py

[comicvine] add extractor (closes #1712)

2021-07-23 16:17:06 +02:00

common.py

[e621] fix applying request_interval_min (#2533)

2022-04-27 21:10:34 +02:00

cyberdrop.py

[cyberdrop] match cyberdrop.to URLs (closes #2496)

2022-04-15 15:39:29 +02:00

danbooru.py

[e621] fix applying request_interval_min (#2533)

2022-04-27 21:10:34 +02:00

desktopography.py

[desktopography] simplify (#1740)

2021-09-17 20:09:24 +02:00

deviantart.py

[deviantart] implement 'pagination' option (#2488)

2022-04-18 18:08:01 +02:00

directlink.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

dynastyscans.py

update extractor test results

2022-02-06 21:39:24 +01:00

erome.py

[erome] send Referer header for file downloads (fixes #1829)

2021-09-08 00:29:16 +02:00

exhentai.py

update extractor test results

2022-04-18 17:24:00 +02:00

fallenangels.py

[fallenangels] fix extraction of '.5' chapters

2020-10-23 16:56:08 +02:00

fanbox.py

[fanbox] fetch data for each individual post (fixes #2388)

2022-03-11 17:36:05 +01:00

fantia.py

[fantia] apply patch (#2381)

2022-03-11 18:02:31 +01:00

flickr.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

foolfuuka.py

update extractor test results

2022-02-06 21:39:24 +01:00

foolslide.py

implement 'page-reverse' option (#1854)

2021-09-23 18:02:19 +02:00

furaffinity.py

[furaffinity] fix search result pagination (fixes #2402)

2022-03-18 13:44:36 +01:00

fuskator.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

gelbooru_v01.py

[gelbooru_v01] support some more boorus by default

2021-03-14 17:19:56 +01:00

gelbooru_v02.py

[realbooru] fix extraction (fixes #2530)

2022-05-02 09:03:34 +02:00

gelbooru.py

[gelbooru] improve and fix pagination (#2230, #2232)

2022-01-27 17:44:47 +01:00

generic.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

gfycat.py

[gfycat] show warning when there are no available formats

2021-10-26 19:26:50 +02:00

gofile.py

[gofile] add gofile.io extractor (#2364)

2022-03-29 17:31:57 +02:00

hbrowse.py

update extractor test results

2020-09-15 18:07:08 +02:00

hentai2read.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

hentaicosplays.py

[hentaicosplays] add Referer to headers (#2317)

2022-02-28 22:19:32 +01:00

hentaifoundry.py

[hentaifoundry] use scheme from input URL (fixes #1095)

2020-11-07 22:40:02 +01:00

hentaifox.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

hentaihand.py

update extractor test results

2021-11-01 02:58:53 +01:00

hentaihere.py

change results of text.nameext_from_url()

2019-02-14 16:07:17 +01:00

hiperdex.py

[hiperdex] fix extraction

2021-09-30 00:32:34 +02:00

hitomi.py

[hitomi] update metadata extraction (fixes #2444)

2022-03-26 12:46:18 +01:00

idolcomplex.py

[idolcomplex] improve and fix pagination (#1601)

2021-06-04 20:31:08 +02:00

imagebam.py

[imagebam] add support for /view/ paths (closes #2378)

2022-03-14 08:38:20 +01:00

imagechest.py

[imagechest] simplify code (#750)

2020-05-18 19:11:26 +02:00

imagefap.py

update extractor test results

2021-09-03 19:36:12 +02:00

imagehosts.py

[fappic] add 'image' extractor (closes #1898)

2021-09-28 23:35:29 +02:00

imgbb.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

imgbox.py

[Imgbox] Fix ImgboxExtractor (#2281)

2022-02-11 22:17:02 +01:00

imgth.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

imgur.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

inkbunny.py

[inkbunny] rename search parameters to their API equivalents

2022-02-13 23:00:49 +01:00

instagram.py

[instagram] add 'previews' option (#2135)

2022-03-19 15:26:40 +01:00

issuu.py

[issuu] fix extraction (#2483)

2022-04-10 14:23:10 +02:00

kabeuchi.py

[kabeuchi] add 'user' extractor (closes #561)

2020-03-13 16:45:42 +01:00

keenspot.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

kemonoparty.py

[kemonoparty] add 'duplicates' option (closes #2440)

2022-03-24 11:58:38 +01:00

khinsider.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

kissgoddess.py

[kissgoddess] extract all images (closes #2473)

2022-04-06 21:28:40 +02:00

kohlchan.py

Add Kohlchan extractor (#2251)

2022-02-04 23:22:17 +01:00

komikcast.py

[komikcast] fix extraction

2021-04-15 17:04:53 +02:00

lightroom.py

[lightroom] add Lightroom gallery extractor (#2263)

2022-02-11 21:30:59 +01:00

lineblog.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

livedoor.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

lolisafe.py

[lolisafe] fix typo

2022-04-15 15:02:30 +02:00

luscious.py

update extractor test results

2022-02-06 21:39:24 +01:00

mangadex.py

[mangadex] download chapters with 'externalUrl' (fixes #2503)

2022-04-18 18:09:52 +02:00

mangafox.py

[mangafox] cleanup

2021-07-04 03:21:02 +02:00

mangahere.py

update extractor test results

2022-02-06 21:39:24 +01:00

mangakakalot.py

[mangakakalot] update domain and fix extraction

2021-10-31 02:16:13 +01:00

manganelo.py

[manganelo] update domain to 'manganato.com'

2021-05-28 17:59:21 +02:00

mangapark.py

update extractor test results

2021-11-01 02:58:53 +01:00

mangasee.py

[mangasee] unescape manga names (fixes #2454)

2022-03-30 16:18:18 +02:00

mangoxo.py

[mangoxo] fix metadata extraction

2021-11-27 18:19:51 +01:00

mastodon.py

[mastodon] add 'following' extractor (#1891)

2021-09-26 00:12:34 +02:00

mememuseum.py

[mememuseum] add 'tag' and 'post' extractors (closes #2264)

2022-02-20 02:15:38 +01:00

message.py

remove 'Message.Metadata' (#866)

2021-01-31 02:12:37 +01:00

moebooru.py

[moebooru] fix 'tags' ending with a '+' when logged in (#1702)

2021-07-16 15:42:03 +02:00

myhentaigallery.py

[myhentaigallery] update and fix extraction (#1001)

2020-09-17 18:14:23 +02:00

myportfolio.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

naver.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

naverwebtoon.py

[naverwebtoon] support (best)challenge comics (closes #2542)

2022-05-02 09:03:34 +02:00

newgrounds.py

[newgrounds] update and fix pagination (#2456)

2022-04-07 15:38:41 +02:00

ngomik.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

nhentai.py

[nhentai] simplify

2021-10-14 16:45:53 +02:00

nijie.py

[nijie] support /history_nuita.php listings (closes #2541)

2022-05-02 09:03:34 +02:00

nozomi.py

[nozomi] preserve case of search tags (fixes #1860)

2021-09-16 16:43:06 +02:00

nsfwalbum.py

[nsfwalbum] retry all requests when extracting image URLs

2021-07-30 00:23:04 +02:00

oauth.py

[oauth:pixiv] add note about 'code' expiring in 30 seconds (#2306)

2022-02-19 23:47:30 +01:00

paheal.py

update extractor test results

2021-11-01 02:58:53 +01:00

patreon.py

[patreon] add explicit 'image_large' file type (#2257)

2022-03-06 17:07:13 +01:00

philomena.py

[philomena] fix search parameter escaping (#2215)

2022-01-23 01:03:37 +01:00

photobucket.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

photovogue.py

[photovogue] switch to .com, update api endpoint (#2494)

2022-04-27 22:37:53 +02:00

picarto.py

[picarto] add 'gallery' extractor (closes #1931)

2021-10-13 01:22:10 +02:00

piczel.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

pillowfort.py

update extractor test results

2022-02-06 21:39:24 +01:00

pinterest.py

[pinterest] support multiple files per pin (closes #1619, #2452)

2022-04-06 21:21:33 +02:00

pixiv.py

[pixiv] implement 'include' option

2022-05-02 09:03:35 +02:00

pixnet.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

plurk.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

pornhub.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

pururin.py

[pururin] update domain and fix extraction

2021-07-18 04:11:59 +02:00

reactor.py

[reactor] support thatpervert.com (closes #2029)

2021-11-26 18:58:07 +01:00

readcomiconline.py

[readcomiconline] add 'quality' option (#2467)

2022-04-15 18:10:37 +02:00

recursive.py

remove 'extractor.blacklist' context manager

2020-09-11 13:17:35 +02:00

reddit.py

[reddit] Support of standalone submissions on personal pages of users (#2301)

2022-02-13 23:03:46 +01:00

redgifs.py

[redgifs] support 'i.redgifs.com' URLs (closes #2300)

2022-02-13 23:00:50 +01:00

rule34us.py

[rule34us] extract tags per category (#1527)

2021-12-16 00:06:52 +01:00

sankaku.py

update extractor test results

2021-11-01 02:58:53 +01:00

sankakucomplex.py

implement 'util.unique_squence()'

2021-03-02 23:11:08 +01:00

seiga.py

[seiga] require authentication with 'user_session' cookie (#2372)

2022-03-11 02:10:15 +01:00

senmanga.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

sexcom.py

[sexcom] add fallback for empty files (#2485)

2022-04-10 14:22:07 +02:00

shopify.py

[shopify] support loungeunderwear.com (closes #2053)

2021-11-26 18:58:06 +01:00

simplyhentai.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

skeb.py

[skeb] refactor 'sent-requests' and add tests

2022-03-28 11:26:24 +02:00

slickpic.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

slideshare.py

[slideshare] fix extraction

2022-02-21 02:52:45 +01:00

smugmug.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

speakerdeck.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

subscribestar.py

[subscribestar] unescape attachment URLs (fixes #2370)

2022-03-09 19:06:04 +01:00

tapas.py

update extractor test results

2022-02-06 21:39:24 +01:00

telegraph.py

[telegraph] Add telegra.ph extractor (#2312)

2022-03-28 19:18:13 +02:00

test.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

toyhouse.py

[toyhouse] support 'art' listings (#1546, #2331)

2022-02-27 16:22:50 +01:00

tsumino.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

tumblr.py

[tumblr] notify users about registering an oauth application

2022-03-06 16:28:53 +01:00

tumblrgallery.py

[tumblrgallery] improve search pagination (fixes #2132)

2021-12-24 03:42:28 +01:00

twibooru.py

[twibooru] fix posts without 'name' (fixes #2434)

2022-03-21 10:08:37 +01:00

twitter.py

[twitter] fix various syndication issues

2022-04-15 20:49:26 +02:00

unsplash.py

update extractor test results

2022-04-18 17:24:00 +02:00

vanillarock.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

vk.py

[vk] handle photos without width/height info (fixes #2535)

2022-05-02 09:03:00 +02:00

vsco.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

wallhaven.py

[wallhaven] add 'collections' extractor (#1351)

2021-03-02 01:32:26 +01:00

wallpapercave.py

[wallpapercave] add extractor for images (#2205)

2022-02-11 23:44:51 +01:00

warosu.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

weasyl.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

webtoons.py

[webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net (#2005)

2021-11-11 20:03:34 +01:00

weibo.py

[weibo] fix infinite retries for deleted accounts (fixes #2521)

2022-04-27 20:23:11 +02:00

wikiart.py

update extractor test results

2022-04-18 17:24:00 +02:00

wikieat.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

xhamster.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

xvideos.py

update extractor test results

2021-11-27 19:26:44 +01:00

ytdl.py

refactor proxy handling code (#2357)

2022-03-10 23:55:35 +01:00