Mike Fährmann f6553ffd2f [twitter] simplify '_pagination_users' ...

- remove 'stop' variable
- call 'cursor.startswith()' only once

2023-07-10 14:39:09 +02:00

..

__init__.py

merge #3447: [jschan] add generic extractors for jschan imageboards

2023-06-08 16:52:26 +02:00

2chan.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

2chen.py

[2chen] update domain to sturdychan.help

2023-04-19 13:54:44 +02:00

3dbooru.py

[moebooru] add generalized extractors for moebooru sites

2020-12-01 22:27:18 +01:00

4chan.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

4chanarchives.py

[4chanarchives] add end condition for 'board' extractor (#4012)

2023-05-06 20:52:45 +02:00

8chan.py

update extractor test results

2022-12-08 18:58:29 +01:00

8muses.py

merge #3329: [8muses] Add 'parts' to album data

2023-05-25 16:31:29 +02:00

35photo.py

update extractor test results

2022-12-08 18:58:29 +01:00

500px.py

replace json.dumps with direct calls to JSONEncoder.encode

2023-02-09 15:51:40 +01:00

adultempire.py

update extractor class hierarchies

2019-10-16 18:15:29 +02:00

architizer.py

update extractor test results

2021-07-20 20:21:33 +02:00

artstation.py

[artstation] add 'max-posts' option (#3270)

2022-11-23 22:00:18 +01:00

aryion.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

bbc.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

bcy.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

behance.py

[behance] 'items()' -> 'values()'

2023-04-30 13:53:51 +02:00

blogger.py

[blogger] download files from 'lh*.googleusercontent.com' (4070)

2023-05-28 19:58:20 +02:00

booru.py

[booru] add 'url' option

2023-01-13 16:32:32 +01:00

bunkr.py

[bunkr] fix video downloads

2023-06-08 17:21:37 +02:00

catbox.py

[catbox] add 'file' extractor (#3570)

2023-02-15 19:50:26 +01:00

comicvine.py

[comicvine] add extractor (closes #1712)

2021-07-23 16:17:06 +02:00

common.py

update default User-Agent header to Firefox 115 ESR

2023-07-05 15:12:50 +02:00

cyberdrop.py

[cyberdrop] add fallback URLs (#2668)

2022-06-13 14:19:40 +02:00

danbooru.py

[danbooru] refactor pagination logic (#4002)

2023-05-14 18:39:59 +02:00

desktopography.py

[desktopography] simplify (#1740)

2021-09-17 20:09:24 +02:00

deviantart.py

[deviantart] revert e9353c63; retry downloads with private token

2023-04-23 21:10:16 +02:00

directlink.py

[generic] revert pattern change

2023-03-09 22:25:23 +01:00

dynastyscans.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

e621.py

[danbooru] refactor pagination logic (#4002)

2023-05-14 18:39:59 +02:00

erome.py

replace remaining time.sleep() calls

2023-02-23 00:35:37 +01:00

exhentai.py

[exhentai] remove and update sad panda check

2023-05-03 17:39:49 +02:00

fallenangels.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

fanbox.py

[fanbox] skip 404ed fanbox embeds (#4088)

2023-06-03 15:40:21 +02:00

fanleaks.py

[fanleaks] update 'model' URL pattern

2022-12-30 19:29:55 +05:30

fantia.py

[fantia] send 'X-Requested-With' header (#4273)

2023-07-06 19:03:53 +02:00

fapachi.py

[fapachi] add 'post' and 'user' extractors (#3347)

2022-12-02 13:54:29 +01:00

fapello.py

[fapello] set 'filename_fmt'

2022-12-16 20:57:39 +05:30

flickr.py

[flickr] add 'exif' option

2023-07-01 19:19:39 +02:00

foolfuuka.py

[foolfuuka] add 'archive.palanq.win'

2023-05-02 19:58:55 +02:00

foolslide.py

[foolslide] remove 'sensescans.com'

2023-05-02 20:09:04 +02:00

furaffinity.py

[furaffinity] improve 'description' HTML (#4224)

2023-06-24 20:30:40 +02:00

fuskator.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

gelbooru_v01.py

[gelbooru_v01] replace 'extract_all()' with 'extract_from()'

2023-06-23 15:17:42 +02:00

gelbooru_v02.py

[realbooru] fix extraction

2023-04-02 20:45:16 +02:00

gelbooru.py

[gelbooru] fix --range for favorites (#3704)

2023-03-23 22:58:13 +01:00

generic.py

[generic] write regular expressions without 'x' flags

2023-04-10 20:45:23 +02:00

gfycat.py

[gfycat] implement login support (#3770, #4271)

2023-07-06 18:56:34 +02:00

gofile.py

[gofile] automatically fetch 'website-token' by default

2023-05-20 17:00:27 +02:00

hbrowse.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

hentai2read.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

hentaicosplays.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

hentaifoundry.py

[hentaifoundry] do not update filters when cookies are provided

2023-04-13 14:16:53 +02:00

hentaifox.py

[hentaifox] fix titles containing '@' (#4201)

2023-06-18 20:01:33 +02:00

hentaihand.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

hentaihere.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

hiperdex.py

[hiperdex] fix extraction

2023-03-25 18:18:27 +01:00

hitomi.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

hotleak.py

Fix indentation

2023-04-03 13:44:14 +00:00

idolcomplex.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

imagebam.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

imagechest.py

[imagechest] update

2023-05-22 22:42:16 +02:00

imagefap.py

[imagefap] extract 'categories' metadata and fix empty 'tags'

2023-04-17 14:49:50 +02:00

imagehosts.py

merge #4134: [postimage] add gallery support, update image extractor

2023-06-03 15:56:35 +02:00

imgbb.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

imgbox.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

imgth.py

[imgth] rewrite

2022-12-07 21:19:06 +01:00

imgur.py

[imgur] fix internal image/album URLs

2023-05-06 15:13:38 +02:00

inkbunny.py

[inkbunny] provide additional metadata (#3274)

2022-11-22 18:54:22 +01:00

instagram.py

[instagram] fix retrieving '/tagged' posts (#4122)

2023-06-09 16:04:39 +02:00

issuu.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

itaku.py

[itaku] remove 'Extreme' rating (#3287)

2022-11-24 11:09:00 +01:00

itchio.py

[itchio] add 'game' extractor (#3923)

2023-04-26 19:20:43 +02:00

jpgfish.py

[jpgfish] update domain to 'jpg.pet' (#4138)

2023-06-03 15:49:56 +02:00

jschan.py

[jschan] update

2023-06-08 16:50:09 +02:00

kabeuchi.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

keenspot.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

kemonoparty.py

[kemonoparty] support '.su' TLD (#4139)

2023-06-06 20:55:03 +02:00

khinsider.py

[khinsider] fix metadata extraction

2022-12-07 21:36:34 +01:00

komikcast.py

[komikcast] update domain and fix extraction

2022-12-06 22:00:23 +01:00

lensdump.py

[lensdump] update

2023-05-26 23:39:17 +02:00

lexica.py

[lexica] add 'search' extractor (#3567)

2023-01-28 16:00:32 +01:00

lightroom.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

lineblog.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

livedoor.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

lolisafe.py

[bunkr] update domain (#3391)

2022-12-11 23:18:01 +01:00

luscious.py

update extractor test results

2022-08-28 00:16:12 +02:00

lynxchan.py

[lynxchan/bbw-chan] add 'thread' and 'board' extractors

2022-12-26 20:59:42 +05:30

mangadex.py

[mangadex] update links to API docs

2023-05-24 12:32:13 +02:00

mangafox.py

[mangafox] extract more metadata (#3167)

2022-12-14 19:56:59 +01:00

mangahere.py

update extractor test results

2022-07-12 15:49:22 +02:00

mangakakalot.py

update extractor test results

2022-07-12 15:49:22 +02:00

manganelo.py

[manganelo] match more minor version separators (#3972)

2023-04-27 13:12:11 +02:00

mangapark.py

[mangapark] extract 'source_id' for manga

2023-07-02 15:17:10 +02:00

mangaread.py

[mangaread] fix 'tags' extraction

2023-05-25 17:04:20 +02:00

mangasee.py

[mangasee] extract 'author' and 'genre' metadata (#3703)

2023-02-26 14:12:19 +01:00

mangoxo.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

mastodon.py

[mastodon] try to get account IDs without access token

2023-04-13 14:03:23 +02:00

mememuseum.py

[mememuseum] add 'tag' and 'post' extractors (closes #2264)

2022-02-20 02:15:38 +01:00

message.py

remove 'Message.Metadata' (#866)

2021-01-31 02:12:37 +01:00

misskey.py

[misskey] update

2023-05-23 22:17:17 +02:00

moebooru.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

myhentaigallery.py

[myhentaigallery] handle whitespace before the title tag

2023-01-06 16:33:04 +01:00

myportfolio.py

remove '&' from URL patterns part 2

2023-05-03 20:26:25 +02:00

naver.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

naverwebtoon.py

[naverwebtoon] fix extraction (#3729)

2023-03-19 17:08:58 +01:00

newgrounds.py

[newgrounds] access 'response.text' only once

2023-07-04 21:49:57 +02:00

nhentai.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

nijie.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

nitter.py

[nitter] extract user IDs from encoded banner URLs

2023-04-23 19:13:27 +02:00

nozomi.py

[nozomi] update file URLs (#3925)

2023-04-17 15:42:42 +02:00

nsfwalbum.py

[nsfwalbum] detect placeholder images

2023-05-17 15:18:10 +02:00

nudecollect.py

[nudecollect] add 'image' and 'album' extractors

2023-01-26 17:25:33 +05:30

oauth.py

remove '*' indicating keyword-only arguments

2023-05-02 22:23:33 +02:00

paheal.py

[paheal] fix extraction (#4262)

2023-07-04 17:36:41 +02:00

patreon.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

philomena.py

[philomena] match URLs with www subdomain

2023-01-24 22:43:24 +01:00

photobucket.py

replace remaining instances of base64 with binascii

2023-03-02 18:25:47 +01:00

photovogue.py

[photovogue] switch to .com, update api endpoint (#2494)

2022-04-27 22:37:53 +02:00

picarto.py

[picarto] add 'gallery' extractor (closes #1931)

2021-10-13 01:22:10 +02:00

piczel.py

[piczel] update API server (#4244)

2023-06-30 17:19:53 +02:00

pillowfort.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

pinterest.py

remove '&' from URL patterns part 2

2023-05-03 20:26:25 +02:00

pixiv.py

[pixiv:novel] only detect Pixiv embeds (#4175)

2023-06-13 18:58:35 +02:00

pixnet.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

plurk.py

replace remaining time.sleep() calls

2023-02-23 00:35:37 +01:00

poipiku.py

[poipiku] improve error detection (#4206)

2023-06-27 23:12:26 +02:00

pornhub.py

[pornhub] improve redirect handling (#4188)

2023-06-15 16:32:53 +02:00

pornpics.py

[pornpics] support '/pornstar' and '/channels' listings

2023-02-18 22:38:21 +01:00

pururin.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

reactor.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

readcomiconline.py

update extractor test results

2022-07-12 15:49:22 +02:00

recursive.py

remove 'extractor.blacklist' context manager

2020-09-11 13:17:35 +02:00

reddit.py

[reddit] fix crash with empty 'crosspost_parent_lists' (#4120)

2023-06-01 14:51:58 +02:00

redgifs.py

[redgifs] update 'search' URL pattern (#4115)

2023-05-30 15:42:31 +02:00

rule34us.py

[rule34us] extract tags per category (#1527)

2021-12-16 00:06:52 +01:00

sankaku.py

[sankaku] improve warnings for unavailable posts

2023-07-01 19:11:41 +02:00

sankakucomplex.py

remove '&' from URL patterns part 2

2023-05-03 20:26:25 +02:00

seiga.py

[seiga] raise error when redirected to login page (#3401)

2022-12-17 12:52:17 +01:00

senmanga.py

[senmanga] ensure download URLs have a scheme (#4235)

2023-06-27 13:49:33 +02:00

sexcom.py

[sexcom] fix fetching HD videos

2023-04-13 15:40:53 +02:00

shimmie2.py

[shimmie2] add generic extractors for Shimmie2 sites (#3734)

2023-04-26 19:20:44 +02:00

shopify.py

[shopify] fix 'collection' extractor

2023-04-03 12:19:09 +05:30

simplyhentai.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

skeb.py

[skeb] fix extraction (#3112)

2022-10-29 15:07:21 +02:00

slickpic.py

update extractor test results

2022-12-08 18:58:29 +01:00

slideshare.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

smugmug.py

update extractor test results

2022-12-08 18:58:29 +01:00

soundgasm.py

[soundgasm] rewrite (#3578)

2023-02-15 16:52:07 +01:00

speakerdeck.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

subscribestar.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

szurubooru.py

[szurubooru] add 'tag' and 'post' extractors (#3583, #3713)

2023-03-01 18:47:10 +01:00

tapas.py

update extractor test results

2022-08-28 00:16:12 +02:00

tcbscans.py

[tcbscans] update domain to 'tcbscans.com' (#4080)

2023-05-20 13:59:35 +02:00

telegraph.py

[telegraph] fix extraction when images not in <figure> (#3590)

2023-01-31 22:14:44 +01:00

test.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

toyhouse.py

[toyhouse] support 'art' listings (#1546, #2331)

2022-02-27 16:22:50 +01:00

tsumino.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

tumblr.py

[tumblr] add 'day' extractor (#3951)

2023-04-24 22:01:47 +02:00

tumblrgallery.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

twibooru.py

update extractor test results

2022-12-08 18:58:29 +01:00

twitter.py

[twitter] simplify '_pagination_users'

2023-07-10 14:39:09 +02:00

unsplash.py

update extractor test results

2022-12-08 18:58:29 +01:00

uploadir.py

[uploadir] use utf-8 filenames (#3162)

2022-11-05 19:03:48 +01:00

urlshortener.py

remove '&' from URL patterns part 2

2023-05-03 20:26:25 +02:00

vanillarock.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

vichan.py

[vichan] recognize board url w/o trailing slash (#3087)

2022-10-24 15:52:54 +02:00

vipergirls.py

[vipergirls] implement login support (#4166)

2023-06-13 21:05:09 +02:00

vk.py

fix 'keywords' in extractor tests (#3491)

2023-01-03 15:14:23 +01:00

vsco.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

wallhaven.py

[wallhaven] update API error message

2023-06-18 20:00:34 +02:00

wallpapercave.py

[wallpapercave] add extractor for images (#2205)

2022-02-11 23:44:51 +01:00

warosu.py

[warosu] fix and update

2022-12-07 21:23:45 +01:00

weasyl.py

replace 'text.extract()' with 'text.extr()' where possible

2022-11-05 01:14:09 +01:00

webmshare.py

[webmshare] add 'video' extractor (#2410)

2022-12-14 19:59:07 +01:00

webtoons.py

update extractor test results

2022-12-08 18:58:29 +01:00

weibo.py

[weibo] fix end of cursor based pagination

2023-07-04 17:41:22 +02:00

wikiart.py

update extractor test results

2022-04-18 17:24:00 +02:00

wikifeet.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

xhamster.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

xvideos.py

replace json.loads with direct calls to JSONDecoder.decode

2023-02-09 15:22:00 +01:00

ytdl.py

refactor proxy handling code (#2357)

2022-03-10 23:55:35 +01:00

zerochan.py

fix 'keywords' in extractor tests (#3491)

2023-01-03 15:14:23 +01:00