missionfloyd d31a3b5da3 [everia.club] Add support ...

- Unescape title and URL
- Add tags and categories metadata
    Lookup tag id with API instead of downloading tag page
- Add category extractor
- Add tests
- Rename EveriaExtractor to EveriaPostExtractor
- Fix EveriaPostExtractor example
- Lookup tags/categories by post id
- Add date extractor
- Remove leftover pages parameter
- Add error handling for invalid dates.
- Add filename numbering
    Parse date
- Rename extract() to images()
- Remove html import
- Fix search/date URLs with page number
- Fix tag/category search
- Fix post extractor
- Fix tag, category extractors
- Fix search extractor
- Only load first page once
- Fix date extractor
- Fix tests
- Clean up search extractor

2024-11-03 14:09:07 +01:00

..

__init__.py

[everia.club] Add support

2024-11-03 14:09:07 +01:00

2ch.py

[2ch] update

2024-01-15 04:09:05 +01:00

2chan.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

2chen.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

3dbooru.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

4archive.py

[4archive] fix extraction

2024-05-31 17:42:53 +02:00

4chan.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

4chanarchives.py

[4chanarchives] disable Referer headers by default (#4686)

2023-10-20 17:39:50 +02:00

8chan.py

[8chan] don't make network requests in '_init()' (#6387)

2024-10-27 19:36:49 +01:00

8muses.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

35photo.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

500px.py

send Referer headers by default

2023-09-19 00:02:04 +02:00

adultempire.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

agnph.py

[agnph] implement 'tags' option (#5284)

2024-07-30 14:16:19 +02:00

ao3.py

[ao3] add 'subscriptions' extractor (#6247)

2024-09-29 13:01:51 +02:00

architizer.py

[architizer] fix extraction (#4537)

2023-09-17 15:19:19 +02:00

artstation.py

[artstation] disable TLS 1.2 ciphers by default (#5564, #5658)

2024-05-30 23:54:19 +02:00

aryion.py

[aryion] update favorite extractor

2024-07-21 12:34:06 +02:00

batoto.py

[batoto] return 'chapter_url' as string (#5562)

2024-09-05 17:47:38 +02:00

bbc.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

behance.py

[dl:ytdl] implement explicit HLS/DASH handling

2024-10-16 15:16:21 +02:00

blogger.py

[blogger] remove 'micmicidol.club'

2024-10-10 14:23:58 +02:00

bluesky.py

merge #6410: [bluesky] match common bluesky embed fixes

2024-11-02 18:28:07 +01:00

booru.py

[booru] allow multiple 'url' keys (#5859)

2024-07-17 20:49:52 +02:00

boosty.py

[boosty] update default video format list (#2387)

2024-10-31 20:55:32 +01:00

bunkr.py

[bunkr] try different domain when encountering a CF challenge page

2024-10-23 21:17:01 +02:00

catbox.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

chevereto.py

[chevereto] remove 'deltaporno.com'

2024-10-10 13:07:08 +02:00

cien.py

[cien] fix extraction when authenticated (#5934)

2024-08-03 21:57:18 +02:00

civitai.py

[civitai] add 'metadata' option (#6383)

2024-10-27 15:46:00 +01:00

cohost.py

use 'True if COND else False' for bool conversions

2024-10-14 20:57:47 +02:00

comicvine.py

fix bug in test_init and update example URLs

2023-09-14 13:27:03 +02:00

common.py

[output] define and use global TTY_STD... values

2024-10-28 14:59:14 +01:00

cyberdrop.py

[cyberdrop] fix extraction

2024-08-19 13:37:14 +02:00

danbooru.py

[pixiv][danbooru] set '_ugoira_original' for ugoira results

2024-10-11 13:19:45 +02:00

desktopography.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

deviantart.py

use 'v[0] == "c"' instead of 'v.startswith("c")'

2024-10-15 08:24:06 +02:00

directlink.py

[directlink] extend recognized file extensions (#5924)

2024-08-02 16:13:09 +02:00

dynastyscans.py

[dynastyscans] extract chapter 'tags'

2024-07-29 16:50:47 +05:30

e621.py

[e621] reorder

2024-08-12 18:01:29 +02:00

erome.py

[erome] extract 'date' metadata (#5796)

2024-06-27 21:07:23 +02:00

everia.py

[everia.club] Add support

2024-11-03 14:09:07 +01:00

exhentai.py

use 'v[0] == "c"' instead of 'v.startswith("c")'

2024-10-15 08:24:06 +02:00

fanbox.py

[fanbox] add 'comments' option, extend 'metadata' option (#6287)

2024-10-06 22:31:41 +02:00

fanleaks.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

fantia.py

[fantia] simplify 'tags' to a list of strings (#4752)

2023-11-02 15:25:01 +01:00

fapachi.py

[fapachi] ignore empty entries

2024-02-16 22:43:37 +01:00

fapello.py

fapello.py Fullsize image

2024-03-21 18:08:18 +01:00

flickr.py

[flickr] update default API credentials (#6300)

2024-10-10 11:50:34 +02:00

foolfuuka.py

use 'v[0] == "c"' instead of 'v.startswith("c")'

2024-10-15 08:24:06 +02:00

foolslide.py

[foolslide] remove 'powermanga.org'

2023-11-26 23:19:05 +01:00

furaffinity.py

[furaffinity] fix 'favorite' pagination (#6151)

2024-09-06 08:52:05 +02:00

fuskator.py

[fuskator] make metadata extraction non-fatal (#5039)

2024-01-08 19:18:12 +01:00

gelbooru_v01.py

fix bug in test_init and update example URLs

2023-09-14 13:27:03 +02:00

gelbooru_v02.py

[gelbooru_v02] unescape categorized tags

2024-10-10 17:30:55 +02:00

gelbooru.py

[gelbooru] improve pagination logic for meta tags (#5478)

2024-04-15 23:14:48 +02:00

generic.py

[generic] ensure 'path' metadata is always defined

2024-10-10 14:06:47 +02:00

gofile.py

[gofile] fix "KeyError: 'childrenIds'" (#5993)

2024-08-11 15:26:58 +02:00

hatenablog.py

[hatenablog] implement additional suggestion

2024-01-13 10:43:25 +11:00

hentai2read.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

hentaicosplays.py

[hentaicosplays] support 'hentai-cosplay-xxx.com' (#5959)

2024-08-10 12:14:18 +02:00

hentaifoundry.py

[hentaifoundry] check for and update expired sessions (#4694)

2023-11-13 00:27:22 +01:00

hentaifox.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

hentaihand.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

hentaihere.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

hentainexus.py

[hentainexus] fix error for spread pages (#5827)

2024-07-05 21:36:29 +02:00

hiperdex.py

[hiperdex] update domain to 'hiperdex.top' (#5635)

2024-05-24 17:13:10 +02:00

hitomi.py

[hitomi] update

2024-10-29 16:56:52 +01:00

hotleak.py

[hotleak] fix AttributeError (#5950)

2024-08-07 08:26:23 +02:00

idolcomplex.py

[idolcomplex] fix metadata extraction

2024-03-22 01:43:05 +01:00

imagebam.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

imagechest.py

[imagechest] add 'user' extractor (#5143)

2024-02-11 18:38:33 +01:00

imagefap.py

[imagefap] fix '{num}' in default filenames for single images

2024-10-10 13:40:50 +02:00

imagehosts.py

[imagetwist] add 'gallery' extractor (#5190)

2024-02-11 18:41:02 +01:00

imgbb.py

replace '24*3600' with '86400'

2023-12-18 23:57:22 +01:00

imgbox.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

imgth.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

imgur.py

[imgur] match gallery/album/image URLs with title slugs (#5593)

2024-05-17 22:44:37 +02:00

inkbunny.py

[inkbunny:favorite] update test

2024-09-25 20:25:33 +02:00

instagram.py

[util] use minimal separators for 'json_dumps()'

2024-10-01 17:03:13 +02:00

issuu.py

[issuu] fix extraction

2024-01-20 16:44:48 +01:00

itaku.py

send Referer headers by default

2023-09-19 00:02:04 +02:00

itchio.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

jschan.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

kabeuchi.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

keenspot.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

kemonoparty.py

[kemonoparty:favorite] fix exception when sorting None (#5692)

2024-06-05 16:49:30 +02:00

khinsider.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

koharu.py

[koharu] improve format selection (#6088)

2024-08-29 09:33:24 +02:00

komikcast.py

[komikcast] update domain to 'komikcast.cz'

2024-10-10 16:52:40 +02:00

lensdump.py

[lensdump] fix extraction (#6313)

2024-10-24 13:59:39 +02:00

lexica.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

lightroom.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

livedoor.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

lolisafe.py

[saint] add 'album' and 'media' extractors (#4405, #6324)

2024-10-27 22:27:30 +01:00

luscious.py

[luscious] fix IndexError for files without thumbnail (#5122)

2024-01-28 01:43:29 +01:00

lynxchan.py

[lynxchan] update 'bbw-chan' domain (#4970)

2023-12-25 15:29:05 +01:00

mangadex.py

[mangadex] apply 'lang' only to chapter results (#6372)

2024-10-27 07:55:14 +01:00

mangafox.py

send Referer headers by default

2023-09-19 00:02:04 +02:00

mangahere.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

mangakakalot.py

use 'v[0] == "c"' instead of 'v.startswith("c")'

2024-10-15 08:24:06 +02:00

manganelo.py

[manganelo] fix extraction & recognize '.to' TLDs (#5005)

2024-01-01 22:05:21 +01:00

mangapark.py

fix bug in test_init and update example URLs

2023-09-14 13:27:03 +02:00

mangaread.py

[mangaread] fix extraction

2023-11-25 23:53:27 +01:00

mangasee.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

mangoxo.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

mastodon.py

[mastodon] add support for card images

2024-05-01 16:00:07 +02:00

message.py

remove 'Message.Metadata' (#866)

2021-01-31 02:12:37 +01:00

misskey.py

[misskey] support 'misskey.design' (#4713)

2023-10-25 17:47:03 +02:00

moebooru.py

[moebooru] add 'metadata' option (#4646)

2023-10-12 21:34:25 +02:00

myhentaigallery.py

[myhentaigallery] fix 'tags' extraction

2024-10-10 17:06:17 +02:00

myportfolio.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

naver.py

[naver] unescape post 'title' and 'description'

2024-03-06 00:46:19 +01:00

naverwebtoon.py

[naverwebtoon] support '/webtoon/' paths for all comics (#5123)

2024-02-04 21:38:46 +01:00

newgrounds.py

[newgrounds] support page numbers in URLs (#6320)

2024-10-14 14:25:09 +02:00

nhentai.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

nijie.py

[nijie] fix image URLs for single image posts (#5842)

2024-07-10 15:06:25 +02:00

nitter.py

[nitter] remove instances

2024-06-02 18:15:53 +02:00

noop.py

[noop] add 'noop' extractor

2024-10-28 19:45:24 +01:00

nozomi.py

use 'True if COND else False' for bool conversions

2024-10-14 20:57:47 +02:00

nsfwalbum.py

[nsfwalbum] detect '/error.jpg' images (#4598)

2023-10-02 15:38:22 +02:00

oauth.py

[oauth] prevent empty browser names

2024-10-01 08:22:50 +02:00

paheal.py

[paheal] implement fast '--range' support (#5905)

2024-07-30 12:55:57 +02:00

patreon.py

[patreon] use legacy mobile UA when no 'session_id' is set

2024-10-31 17:26:33 +01:00

philomena.py

[philomena] support downloading SVG files (#5643)

2024-06-05 16:48:51 +02:00

photovogue.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

picarto.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

piczel.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

pillowfort.py

replace '24*3600' with '86400'

2023-12-18 23:57:22 +01:00

pinterest.py

[pinterest] support 'story' pins (#6188, #6078, #4229)

2024-10-19 17:47:31 +02:00

pixeldrain.py

[pixeldrain] integrate into 'album' extractor

2024-05-25 23:42:23 +02:00

pixiv.py

[pixiv] get ugoira frame extension from 'meta_single_page' (#6056)

2024-10-31 19:47:05 +01:00

pixnet.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

plurk.py

replace static 'sleep-request' defaults with dynamic ones

2023-12-18 22:06:26 +01:00

poipiku.py

[poipiku] send LANG cookie to ensure English UI (#5590)

2024-05-17 22:59:31 +02:00

poringa.py

[poringa] improvements and fixes

2023-12-30 20:37:09 +01:00

pornhub.py

[pornhub] fix KeyError when album images are missing (#6299)

2024-10-09 17:18:06 +02:00

pornpics.py

[pornpics] update 'channel' extraction & add test

2024-02-13 23:48:46 +01:00

postmill.py

use 'v[0] == "c"' instead of 'v.startswith("c")'

2024-10-15 08:24:06 +02:00

reactor.py

replace static 'sleep-request' defaults with dynamic ones

2023-12-18 22:06:26 +01:00

readcomiconline.py

[readcomiconline] update (#5866)

2024-07-23 18:56:49 +02:00

recursive.py

[recursive] simplify

2023-09-13 21:47:20 +02:00

reddit.py

[reddit] simplify

2024-10-28 14:44:15 +01:00

redgifs.py

Update redgifs.py to include 0-9 regex

2024-07-28 02:34:17 -04:00

rule34us.py

[rule34us] make 'file_url' extraction more robust (#6289)

2024-10-10 09:11:38 +02:00

rule34vault.py

[rule34vault] update

2024-10-28 22:28:23 +01:00

saint.py

[saint] add 'album' and 'media' extractors (#4405, #6324)

2024-10-27 22:27:30 +01:00

sankaku.py

[sankaku] restore old 'tags' format (#6043)

2024-08-17 19:25:19 +02:00

sankakucomplex.py

[sankakucomplex] update domain to 'news.sankakucomplex.com'

2024-07-26 20:39:55 +02:00

scrolller.py

[scrolller] add initial support (#295, #3418, #5051)

2024-10-21 14:17:18 +02:00

seiga.py

[seiga] re-implement login with username & password

2024-05-23 18:52:53 +02:00

senmanga.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

sexcom.py

[sexcom] add 'likes' extractor (#6149)

2024-09-06 07:44:06 +02:00

shimmie2.py

[shimmie2] use 'self.groups' to access matched URL values

2024-10-10 19:01:30 +02:00

shopify.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

simplyhentai.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

skeb.py

[skeb] prevent 429 errors and need for 'request_key' cookie

2024-09-26 15:15:37 +02:00

slickpic.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

slideshare.py

[slideshare] fix extraction

2024-05-31 21:05:50 +02:00

smugmug.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

soundgasm.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

speakerdeck.py

[speakerdeck] inherit from GalleryExtractor

2024-06-15 21:56:51 +02:00

steamgriddb.py

[steamgriddb] raise proper exception for deleted assets

2024-03-22 17:53:06 +01:00

subscribestar.py

Fix subscribestar date parsing in udated posts

2024-06-24 16:40:59 +02:00

szurubooru.py

[bcbnsfw] use '*' as query when retrieving all posts (#6135)

2024-09-05 20:43:23 +02:00

tapas.py

[tapas] add 'creator' extractor (#5306)

2024-04-11 23:41:50 +02:00

tcbscans.py

[tcbscans] support other domains

2024-06-21 21:29:11 +05:30

telegraph.py

use 'v[0] == "c"' instead of 'v.startswith("c")'

2024-10-15 08:24:06 +02:00

tmohentai.py

[tmohentai] 'categories' -> 'genres'

2023-11-21 22:11:43 +01:00

toyhouse.py

[toyhouse] fix extraction for image URLs

2024-09-02 17:15:02 +02:00

tsumino.py

use 'v[0] == "c"' instead of 'v.startswith("c")'

2024-10-15 08:24:06 +02:00

tumblr.py

[tumblr] fix 401 Unauthorized for likes when using api-key (#5994)

2024-08-12 09:09:59 +02:00

tumblrgallery.py

[tumblrgallery] fix file downloads (#6391)

2024-10-29 08:38:59 +01:00

twibooru.py

[philomena] support downloading SVG files (#5643)

2024-06-05 16:48:51 +02:00

twitter.py

[twitter] remove cookies migration workaround

2024-10-31 17:10:13 +01:00

unsplash.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

uploadir.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

urlgalleries.py

[urlgalleries] fix extraction

2024-10-11 20:16:32 +02:00

urlshortener.py

add 'config_instance' method

2024-01-18 03:20:36 +01:00

vanillarock.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

vichan.py

[vichan] remove 'wikieat.club'

2024-06-02 18:16:24 +02:00

vipergirls.py

[vipergirls] improve 'thread' URL pattern

2024-06-29 17:38:57 +02:00

vk.py

[vk] document 'offset', add '--range' support

2024-10-17 21:20:21 +02:00

vsco.py

[vsco] add 'include' option (#5911)

2024-07-31 12:32:04 +02:00

wallhaven.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

wallpapercave.py

[wallpapercave] support 'album' listings (#5925)

2024-08-02 16:13:09 +02:00

warosu.py

[warosu] fix extraction

2024-07-26 21:09:07 +02:00

weasyl.py

[weasyl:favorite] update

2024-09-25 20:02:01 +02:00

webmshare.py

fix bug in test_init and update example URLs

2023-09-14 13:27:03 +02:00

webtoons.py

[webtoons] fix extracting comic and episode name with commas

2024-01-21 09:50:27 +11:00

weibo.py

[weibo] rework pagination logic (#4168)

2024-03-14 00:06:25 +01:00

wikiart.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

wikifeet.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

wikimedia.py

[wikimedia] fix non-English Fandom/wiki.gg articles (#6370)

2024-10-24 13:00:02 +02:00

xhamster.py

remove test results in extractor modules

2023-09-11 16:30:55 +02:00

xvideos.py

[xvideos] fix galleries with more than 500 images (#5244)

2024-02-26 15:36:41 +01:00

ytdl.py

[ytdl] simplify '_process_entries()'

2024-09-03 21:17:31 +02:00

zerochan.py

[zerochan] improve redirect handling, add 'redirects' option (#5891)

2024-08-10 11:32:30 +02:00

zzup.py

[zzup] support 'up.zzup.com' galleries (#6181)

2024-09-15 11:01:27 +02:00