Nicholas Bishop f43bccb5be [furaffinity] Add 'thumbnail' (#1284) and 'folders' properties ...

Retrieve 'thumbnail' and 'folders' properties for each post.
'thumbnail' (#1284):
 - Preview image used for search results, writing posts, music, etc.
 - Filename format: <post_id>@600-<directory_containing_full_image>.jpg
'Folders' (related to #1817):
 - A list of all gallery folders containing this post
 - Folder name format: [<folder_category> - ]<folder_name>
 - Only works on new layout; old layout does not show folders, so list will be empty

A test is included for each property.

2024-07-04 15:41:14 -04:00

..

__init__.py

[hentainexus] restore module (#5275)

2024-06-05 16:48:25 +02:00

2ch.py

[2ch] update

2024-01-15 04:09:05 +01:00

2chan.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

2chen.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

3dbooru.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

4archive.py

[4archive] fix extraction

2024-05-31 17:42:53 +02:00

4chan.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

4chanarchives.py

[4chanarchives] disable Referer headers by default (#4686)

2023-10-20 17:39:50 +02:00

8chan.py

[8chan] fix downloaded files by sending 'TOS' cookie (#5578)

2024-05-11 15:34:21 +02:00

8muses.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

35photo.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

500px.py

send Referer headers by default

2023-09-19 00:02:04 +02:00

adultempire.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

architizer.py

[architizer] fix extraction (#4537)

2023-09-17 15:19:19 +02:00

artstation.py

[artstation] disable TLS 1.2 ciphers by default (#5564, #5658)

2024-05-30 23:54:19 +02:00

aryion.py

replace '24*3600' with '86400'

2023-12-18 23:57:22 +01:00

batoto.py

[batoto] fix crash when manga/chapter contains a '-' (#5200)

2024-02-16 00:10:08 +01:00

bbc.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

behance.py

[behance] add 'modules' option (#4799)

2023-11-17 22:54:38 +01:00

blogger.py

Combine lh*(-**).googleusercontent.com URL regex into one line.

2024-01-20 15:53:11 -06:00

bluesky.py

[bluesky] filter reposts only for user timelines (#5528)

2024-05-01 16:00:07 +02:00

booru.py

[booru] add 'url' option

2023-01-13 16:32:32 +01:00

bunkr.py

[bunkr] remove 'description' metadata

2024-03-22 02:14:41 +01:00

catbox.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

chevereto.py

[chevereto] remove 'pixl.li'

2024-01-20 02:21:40 +01:00

comicvine.py

fix bug in test_init and update example URLs

2023-09-14 13:27:03 +02:00

common.py

[skeb] fix '429 Too Many Requests' errors (#5766)

2024-06-21 00:12:05 +02:00

cyberdrop.py

[cyberdrop] update to site layout changes

2023-11-26 18:03:13 +01:00

danbooru.py

[danbooru] provide 'tags' as list (#4942)

2023-12-21 14:39:38 +01:00

desktopography.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

deviantart.py

[deviantart] fix 2c8aa9b2 (#5696)

2024-06-08 02:00:36 +02:00

directlink.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

dynastyscans.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

e621.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

erome.py

[erome] extract 'date' metadata (#5796)

2024-06-27 21:07:23 +02:00

exhentai.py

[exhentai] fix blank page detection

2024-05-11 22:01:34 +02:00

fallenangels.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

fanbox.py

[fanbox] remove debug code (#5759)

2024-06-21 21:05:01 +02:00

fanleaks.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

fantia.py

[fantia] simplify 'tags' to a list of strings (#4752)

2023-11-02 15:25:01 +01:00

fapachi.py

[fapachi] ignore empty entries

2024-02-16 22:43:37 +01:00

fapello.py

fapello.py Fullsize image

2024-03-21 18:08:18 +01:00

flickr.py

[flickr] add 'contexts' option (#5324)

2024-03-18 17:36:16 +01:00

foolfuuka.py

[foolfuuka] improve 'board' pattern & support pages (#5408)

2024-04-01 22:31:25 +02:00

foolslide.py

[foolslide] remove 'powermanga.org'

2023-11-26 23:19:05 +01:00

furaffinity.py

[furaffinity] Add 'thumbnail' (#1284) and 'folders' properties

2024-07-04 15:41:14 -04:00

fuskator.py

[fuskator] make metadata extraction non-fatal (#5039)

2024-01-08 19:18:12 +01:00

gelbooru_v01.py

fix bug in test_init and update example URLs

2023-09-14 13:27:03 +02:00

gelbooru_v02.py

[realbooru] fix videos and provide fallback URLs (#2530)

2024-05-31 23:58:40 +02:00

gelbooru.py

[gelbooru] improve pagination logic for meta tags (#5478)

2024-04-15 23:14:48 +02:00

generic.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

gofile.py

[gofile] fix extraction

2024-03-15 20:34:54 +01:00

hatenablog.py

[hatenablog] implement additional suggestion

2024-01-13 10:43:25 +11:00

hentai2read.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

hentaicosplays.py

[hentaicosplays] force 'https://' for download URLs

2023-11-26 02:08:12 +01:00

hentaifoundry.py

[hentaifoundry] check for and update expired sessions (#4694)

2023-11-13 00:27:22 +01:00

hentaifox.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

hentaihand.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

hentaihere.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

hentainexus.py

fix: static method defines hostname, update url link

2024-06-10 14:35:03 +10:00

hiperdex.py

[hiperdex] update domain to 'hiperdex.top' (#5635)

2024-05-24 17:13:10 +02:00

hitomi.py

[hitomi] extract 'title_jpn' metadata (#5706)

2024-06-08 00:05:19 +02:00

hotleak.py

[hotleak] download files with 404 status code (#5395)

2024-04-19 16:08:31 +02:00

idolcomplex.py

[idolcomplex] fix metadata extraction

2024-03-22 01:43:05 +01:00

imagebam.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

imagechest.py

[imagechest] add 'user' extractor (#5143)

2024-02-11 18:38:33 +01:00

imagefap.py

Fix imagefap extrcator

2024-03-15 23:44:25 +01:00

imagehosts.py

[imagetwist] add 'gallery' extractor (#5190)

2024-02-11 18:41:02 +01:00

imgbb.py

replace '24*3600' with '86400'

2023-12-18 23:57:22 +01:00

imgbox.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

imgth.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

imgur.py

[imgur] match gallery/album/image URLs with title slugs (#5593)

2024-05-17 22:44:37 +02:00

inkbunny.py

[inkbunny] retry API calls with a loop instead of recursion

2024-05-01 22:46:24 +02:00

instagram.py

[instagram] add 'profile' extractor (#5262)

2024-06-28 22:54:07 +02:00

issuu.py

[issuu] fix extraction

2024-01-20 16:44:48 +01:00

itaku.py

send Referer headers by default

2023-09-19 00:02:04 +02:00

itchio.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

jschan.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

kabeuchi.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

keenspot.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

kemonoparty.py

[kemonoparty:favorite] fix exception when sorting None (#5692)

2024-06-05 16:49:30 +02:00

khinsider.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

komikcast.py

[komikcast] fix 'manga' extractor (#5027)

2024-01-06 14:19:44 +01:00

lensdump.py

[lensdump] support more direct link formats (#5293)

2024-03-09 23:33:58 +01:00

lexica.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

lightroom.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

livedoor.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

lolisafe.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

luscious.py

[luscious] fix IndexError for files without thumbnail (#5122)

2024-01-28 01:43:29 +01:00

lynxchan.py

[lynxchan] update 'bbw-chan' domain (#4970)

2023-12-25 15:29:05 +01:00

mangadex.py

[tests] check extractor category values

2024-01-19 14:21:09 +01:00

mangafox.py

send Referer headers by default

2023-09-19 00:02:04 +02:00

mangahere.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

mangakakalot.py

[mangakakalot] update domain

2023-09-19 00:18:21 +02:00

manganelo.py

[manganelo] fix extraction & recognize '.to' TLDs (#5005)

2024-01-01 22:05:21 +01:00

mangapark.py

fix bug in test_init and update example URLs

2023-09-14 13:27:03 +02:00

mangaread.py

[mangaread] fix extraction

2023-11-25 23:53:27 +01:00

mangasee.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

mangoxo.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

mastodon.py

[mastodon] add support for card images

2024-05-01 16:00:07 +02:00

message.py

remove 'Message.Metadata' (#866)

2021-01-31 02:12:37 +01:00

misskey.py

[misskey] support 'misskey.design' (#4713)

2023-10-25 17:47:03 +02:00

moebooru.py

[moebooru] add 'metadata' option (#4646)

2023-10-12 21:34:25 +02:00

myhentaigallery.py

[myhentaigallery] recognize '/g/' URLs (#4920)

2023-12-12 20:02:28 +01:00

myportfolio.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

naver.py

[naver] unescape post 'title' and 'description'

2024-03-06 00:46:19 +01:00

naverwebtoon.py

[naverwebtoon] support '/webtoon/' paths for all comics (#5123)

2024-02-04 21:38:46 +01:00

newgrounds.py

[newgrounds] extend 'format' option (#5709)

2024-06-12 20:46:45 +02:00

nhentai.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

nijie.py

[nijie] support downloading videos (#5707, #5617)

2024-06-08 22:55:28 +02:00

nitter.py

[nitter] remove instances

2024-06-02 18:15:53 +02:00

nozomi.py

send Referer headers by default

2023-09-19 00:02:04 +02:00

nsfwalbum.py

[nsfwalbum] detect '/error.jpg' images (#4598)

2023-10-02 15:38:22 +02:00

oauth.py

improve a1bb3279, fix oauth:pixiv (#5757)

2024-06-18 16:50:04 +02:00

paheal.py

[paheal] cleanup

2024-02-27 02:27:20 +01:00

patreon.py

[patreon] fix bootstrap data extraction (#5624)

2024-05-22 00:17:49 +02:00

philomena.py

[philomena] support downloading SVG files (#5643)

2024-06-05 16:48:51 +02:00

photovogue.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

picarto.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

piczel.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

pillowfort.py

replace '24*3600' with '86400'

2023-12-18 23:57:22 +01:00

pinterest.py

[pinterest] fix section URLs for boards with /?# in name (#5104)

2024-02-05 15:54:06 +01:00

pixeldrain.py

[pixeldrain] integrate into 'album' extractor

2024-05-25 23:42:23 +02:00

pixiv.py

[pixiv] change 'sanity_level' debug message to a warning (#5180)

2024-04-19 16:41:31 +02:00

pixnet.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

plurk.py

replace static 'sleep-request' defaults with dynamic ones

2023-12-18 22:06:26 +01:00

poipiku.py

[poipiku] send LANG cookie to ensure English UI (#5590)

2024-05-17 22:59:31 +02:00

poringa.py

[poringa] improvements and fixes

2023-12-30 20:37:09 +01:00

pornhub.py

[pornhub:gif] extract 'viewkey' and 'timestamp' metadata (#4463)

2024-03-22 18:00:20 +01:00

pornpics.py

[pornpics] update 'channel' extraction & add test

2024-02-13 23:48:46 +01:00

postmill.py

[postmill] implement suggestions

2023-12-23 13:28:36 +11:00

pururin.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

reactor.py

replace static 'sleep-request' defaults with dynamic ones

2023-12-18 22:06:26 +01:00

readcomiconline.py

[common] add Extractor.input() method

2024-04-16 00:02:48 +02:00

recursive.py

[recursive] simplify

2023-09-13 21:47:20 +02:00

reddit.py

[docs] update docs/configuration links (#5059, #5369, #5423)

2024-04-13 02:18:44 +02:00

redgifs.py

[redgifs] make 'date' available for directories (#5262)

2024-03-01 23:39:16 +01:00

rule34us.py

[rule34us] add fallback for 'video-cdn1' videos (#4985)

2023-12-30 18:33:46 +01:00

sankaku.py

[sankaku] add 'id-format' option (#5073)

2024-01-26 17:56:08 +01:00

sankakucomplex.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

seiga.py

[seiga] re-implement login with username & password

2024-05-23 18:52:53 +02:00

senmanga.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

sexcom.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

shimmie2.py

[shimmie2] support 'vidya.pics' (#5632)

2024-06-06 15:08:56 +02:00

shopify.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

simplyhentai.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

skeb.py

[skeb] fix '429 Too Many Requests' errors (#5766)

2024-06-21 00:12:05 +02:00

slickpic.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

slideshare.py

[slideshare] fix extraction

2024-05-31 21:05:50 +02:00

smugmug.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

soundgasm.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

speakerdeck.py

[speakerdeck] inherit from GalleryExtractor

2024-06-15 21:56:51 +02:00

steamgriddb.py

[steamgriddb] raise proper exception for deleted assets

2024-03-22 17:53:06 +01:00

subscribestar.py

Fix subscribestar date parsing in udated posts

2024-06-24 16:40:59 +02:00

szurubooru.py

[szurubooru] support empty tag searches (#5711)

2024-06-11 20:25:06 +02:00

tapas.py

[tapas] add 'creator' extractor (#5306)

2024-04-11 23:41:50 +02:00

tcbscans.py

[tcbscans] support other domains

2024-06-21 21:29:11 +05:30

telegraph.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

tmohentai.py

[tmohentai] 'categories' -> 'genres'

2023-11-21 22:11:43 +01:00

toyhouse.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

tsumino.py

replace '24*3600' with '86400'

2023-12-18 23:57:22 +01:00

tumblr.py

[docs] update docs/configuration links (#5059, #5369, #5423)

2024-04-13 02:18:44 +02:00

tumblrgallery.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

twibooru.py

[philomena] support downloading SVG files (#5643)

2024-06-05 16:48:51 +02:00

twitter.py

merge #5802: [twitter] extract 'bookmark_count' and 'view_count'

2024-06-28 23:21:57 +02:00

unsplash.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

uploadir.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

urlgalleries.py

[urlgalleries] simplify + resolve redirects

2023-12-08 22:43:56 +01:00

urlshortener.py

add 'config_instance' method

2024-01-18 03:20:36 +01:00

vanillarock.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

vichan.py

[vichan] remove 'wikieat.club'

2024-06-02 18:16:24 +02:00

vipergirls.py

[vipergirls] improve 'thread' URL pattern

2024-06-29 17:38:57 +02:00

vk.py

[vk] transform image URLs to non-blurred versions (#5017)

2024-01-07 00:19:10 +01:00

vsco.py

[vsco] add 'avatar' extractor (#5341)

2024-05-02 18:12:19 +02:00

wallhaven.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

wallpapercave.py

[wallpapercave] fix extraction

2023-11-24 21:54:21 +01:00

warosu.py

[warosu] fix 'board_name' metadata

2024-03-06 01:28:47 +01:00

weasyl.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

webmshare.py

fix bug in test_init and update example URLs

2023-09-14 13:27:03 +02:00

webtoons.py

[webtoons] fix extracting comic and episode name with commas

2024-01-21 09:50:27 +11:00

weibo.py

[weibo] rework pagination logic (#4168)

2024-03-14 00:06:25 +01:00

wikiart.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

wikifeet.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

wikimedia.py

[wikimedia] support wiki.gg wikis

2024-04-09 19:24:01 +02:00

xhamster.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

xvideos.py

[xvideos] fix galleries with more than 500 images (#5244)

2024-02-26 15:36:41 +01:00

ytdl.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

zerochan.py

[zerochan] use API by default (#3669)

2024-02-25 00:36:14 +01:00

zzup.py

[zzup] add 'gallery' extractor

2024-01-04 21:38:59 +05:30