Mike Fährmann e670dc518e [weibo] update pagination code (fixes #2244) ...

- send proper headers and query parameters
- use 'since_id' instead of page numbers
- set a 1-2 second delay between requests

2022-01-31 19:16:01 +01:00

..

__init__.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

2chan.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

3dbooru.py

[moebooru] add generalized extractors for moebooru sites

2020-12-01 22:27:18 +01:00

4chan.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

8kun.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

8muses.py

update extractor test results

2021-11-01 02:58:53 +01:00

35photo.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

420chan.py

[429chan] add 'thread' and 'board' extractors (closes #1773)

2021-08-21 22:46:22 +02:00

500px.py

[500px] create directories per photo

2021-12-25 17:16:45 +01:00

adultempire.py

update extractor class hierarchies

2019-10-16 18:15:29 +02:00

architizer.py

update extractor test results

2021-07-20 20:21:33 +02:00

artstation.py

[artstation] create directories per asset (closes #2136)

2021-12-25 17:16:45 +01:00

aryion.py

[aryion] update/improve pagination (#1849)

2021-09-16 16:27:25 +02:00

bbc.py

[bbc] provide fallback URLs (#1706)

2021-07-30 01:14:07 +02:00

bcy.py

update extractor test results

2021-11-01 02:58:53 +01:00

behance.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

blogger.py

[blogger] support new image domain (fixes #2204)

2022-01-20 23:13:07 +01:00

booru.py

[booru] add an option to extract notes (only gelbooru for now) (#1457)

2021-04-13 23:40:24 +02:00

comicvine.py

[comicvine] add extractor (closes #1712)

2021-07-23 16:17:06 +02:00

common.py

[patreon] Disable TLS 1.2 by default (#2249)

2022-01-30 23:30:44 +01:00

cyberdrop.py

add album extractor for lolisafe/chibisafe instances

2021-12-21 19:24:17 +01:00

danbooru.py

[danbooru] add 'external' option (closes #1747)

2021-08-08 19:18:41 +02:00

desktopography.py

[desktopography] simplify (#1740)

2021-09-17 20:09:24 +02:00

deviantart.py

[deviantart] adjust API endpoints

2021-12-21 00:18:06 +01:00

directlink.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

dynastyscans.py

[dynastyscans] provide 'date' as proper datetime object (#2050)

2021-11-21 22:50:52 +01:00

e621.py

[e621] return pool posts in order (closes #1195)

2020-12-26 19:00:29 +01:00

erome.py

[erome] send Referer header for file downloads (fixes #1829)

2021-09-08 00:29:16 +02:00

exhentai.py

[exhentai] add 'source' option

2021-12-16 23:16:19 +01:00

fallenangels.py

[fallenangels] fix extraction of '.5' chapters

2020-10-23 16:56:08 +02:00

fanbox.py

[fanbox] support pixiv redirects (closes #2122)

2021-12-25 17:15:39 +01:00

fantia.py

use Extractor._check_cookies() for all cookie checks

2021-12-16 02:21:16 +01:00

flickr.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

foolfuuka.py

update extractor test results

2021-11-27 19:26:44 +01:00

foolslide.py

implement 'page-reverse' option (#1854)

2021-09-23 18:02:19 +02:00

furaffinity.py

[furaffinity] warn when no session cookies were found

2021-12-15 16:21:05 +01:00

fuskator.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

gelbooru_v01.py

[gelbooru_v01] support some more boorus by default

2021-03-14 17:19:56 +01:00

gelbooru_v02.py

[rule34] use https://api.rule34.xxx for API requests

2022-01-08 17:14:50 +01:00

gelbooru.py

[gelbooru] improve and fix pagination (#2230, #2232)

2022-01-27 17:44:47 +01:00

generic.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

gfycat.py

[gfycat] show warning when there are no available formats

2021-10-26 19:26:50 +02:00

hbrowse.py

update extractor test results

2020-09-15 18:07:08 +02:00

hentai2read.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

hentaicosplays.py

[hentaicosplays] add 'slug' metadata field (closes #1483)

2021-04-19 16:28:01 +02:00

hentaifoundry.py

[hentaifoundry] use scheme from input URL (fixes #1095)

2020-11-07 22:40:02 +01:00

hentaifox.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

hentaihand.py

update extractor test results

2021-11-01 02:58:53 +01:00

hentaihere.py

change results of text.nameext_from_url()

2019-02-14 16:07:17 +01:00

hiperdex.py

[hiperdex] fix extraction

2021-09-30 00:32:34 +02:00

hitomi.py

[hitomi] fix 'tag' extraction (fixes #2189)

2022-01-13 16:45:46 +01:00

idolcomplex.py

[idolcomplex] improve and fix pagination (#1601)

2021-06-04 20:31:08 +02:00

imagebam.py

[imagebam] fix extraction of NSFW images (#1534)

2021-05-22 21:41:44 +02:00

imagechest.py

[imagechest] simplify code (#750)

2020-05-18 19:11:26 +02:00

imagefap.py

update extractor test results

2021-09-03 19:36:12 +02:00

imagehosts.py

[fappic] add 'image' extractor (closes #1898)

2021-09-28 23:35:29 +02:00

imgbb.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

imgbox.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

imgth.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

imgur.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

inkbunny.py

[inkbunny] add 'search' extractor (closes #2094)

2021-12-12 03:08:14 +01:00

instagram.py

[instagram] fix highlights extraction (#2197)

2022-01-24 00:20:12 +01:00

issuu.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

kabeuchi.py

[kabeuchi] add 'user' extractor (closes #561)

2020-03-13 16:45:42 +01:00

keenspot.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

kemonoparty.py

[kemonoparty] fix DMs extraction (#2008)

2022-01-25 23:16:13 +01:00

khinsider.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

komikcast.py

[komikcast] fix extraction

2021-04-15 17:04:53 +02:00

lineblog.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

livedoor.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

lolisafe.py

[bunkr] fix .mp4 downloads (closes #2239)

2022-01-28 23:21:16 +01:00

luscious.py

update extractor test results

2021-11-01 02:58:53 +01:00

mangadex.py

[mangadex] re-enable warning for external chapters (#2193)

2022-01-16 03:21:50 +01:00

mangafox.py

[mangafox] cleanup

2021-07-04 03:21:02 +02:00

mangahere.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

mangakakalot.py

[mangakakalot] update domain and fix extraction

2021-10-31 02:16:13 +01:00

manganelo.py

[manganelo] update domain to 'manganato.com'

2021-05-28 17:59:21 +02:00

mangapark.py

update extractor test results

2021-11-01 02:58:53 +01:00

mangasee.py

[mangasee] add 'chapter' and 'manga' extractors

2021-06-27 02:03:03 +02:00

mangoxo.py

[mangoxo] fix metadata extraction

2021-11-27 18:19:51 +01:00

mastodon.py

[mastodon] add 'following' extractor (#1891)

2021-09-26 00:12:34 +02:00

message.py

remove 'Message.Metadata' (#866)

2021-01-31 02:12:37 +01:00

moebooru.py

[moebooru] fix 'tags' ending with a '+' when logged in (#1702)

2021-07-16 15:42:03 +02:00

myhentaigallery.py

[myhentaigallery] update and fix extraction (#1001)

2020-09-17 18:14:23 +02:00

myportfolio.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

naver.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

naverwebtoon.py

[naverwebtoon] fix comic extraction

2021-07-18 03:41:54 +02:00

newgrounds.py

[newgrounds] set suitabilities filter before starting a search

2022-01-11 23:50:29 +01:00

ngomik.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

nhentai.py

[nhentai] simplify

2021-10-14 16:45:53 +02:00

nijie.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

nozomi.py

[nozomi] preserve case of search tags (fixes #1860)

2021-09-16 16:43:06 +02:00

nsfwalbum.py

[nsfwalbum] retry all requests when extracting image URLs

2021-07-30 00:23:04 +02:00

oauth.py

[oauth] fix typo

2021-09-08 20:14:39 +02:00

paheal.py

update extractor test results

2021-11-01 02:58:53 +01:00

patreon.py

[patreon] Disable TLS 1.2 by default (#2249)

2022-01-30 23:30:44 +01:00

philomena.py

[philomena] fix search parameter escaping (#2215)

2022-01-23 01:03:37 +01:00

photobucket.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

photovogue.py

[photovogue] update (#1253)

2021-01-22 19:38:10 +01:00

picarto.py

[picarto] add 'gallery' extractor (closes #1931)

2021-10-13 01:22:10 +02:00

piczel.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

pillowfort.py

[pillowfort] implement login with username & password (#846)

2021-05-19 02:59:16 +02:00

pinterest.py

[pinterest] add 'search' extractor (#1411)

2021-03-29 01:41:28 +02:00

pixiv.py

[pixiv] allow setting a date range for search results (#2133)

2021-12-23 23:03:39 +01:00

pixnet.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

plurk.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

pornhub.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

pururin.py

[pururin] update domain and fix extraction

2021-07-18 04:11:59 +02:00

reactor.py

[reactor] support thatpervert.com (closes #2029)

2021-11-26 18:58:07 +01:00

readcomiconline.py

[readcomiconline] change domain to 'readcomiconline.li'

2021-05-01 16:41:16 +02:00

recursive.py

remove 'extractor.blacklist' context manager

2020-09-11 13:17:35 +02:00

reddit.py

[reddit] allow downloading from quarantined subreddits (#2180)

2022-01-14 21:55:59 +01:00

redgifs.py

[redgifs] improve URL extraction

2021-11-05 20:02:43 +01:00

rule34us.py

[rule34us] extract tags per category (#1527)

2021-12-16 00:06:52 +01:00

sankaku.py

update extractor test results

2021-11-01 02:58:53 +01:00

sankakucomplex.py

implement 'util.unique_squence()'

2021-03-02 23:11:08 +01:00

seiga.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

senmanga.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

sexcom.py

[sexcom] extend URL pattern (fixes #2220)

2022-01-24 01:19:40 +01:00

shopify.py

[shopify] support loungeunderwear.com (closes #2053)

2021-11-26 18:58:06 +01:00

simplyhentai.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

skeb.py

[skeb] add 'thumbnails' option (#2047) (#2051)

2021-11-23 21:16:42 +01:00

slickpic.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

slideshare.py

update extractor test results

2021-11-01 02:58:53 +01:00

smugmug.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

speakerdeck.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

subscribestar.py

[subscribestar] emit metadata for posts without media (#1569)

2021-11-18 23:42:17 +01:00

tapas.py

update extractor test results

2021-11-01 02:58:53 +01:00

test.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

tsumino.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

tumblr.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

tumblrgallery.py

[tumblrgallery] improve search pagination (fixes #2132)

2021-12-24 03:42:28 +01:00

twitter.py

[twitter] restore errors for protected timelines etc (fixes #2237)

2022-01-30 16:42:13 +01:00

unsplash.py

update extractor test results

2021-09-03 19:36:12 +02:00

vanillarock.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

vk.py

[vk] add 'album' extractor (#474, fixes #1952)

2021-10-23 00:46:20 +02:00

vsco.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

wallhaven.py

[wallhaven] add 'collections' extractor (#1351)

2021-03-02 01:32:26 +01:00

warosu.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

weasyl.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

webtoons.py

[webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net (#2005)

2021-11-11 20:03:34 +01:00

weibo.py

[weibo] update pagination code (fixes #2244)

2022-01-31 19:16:01 +01:00

wikiart.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

wikieat.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

xhamster.py

generic extractor (#735)

2021-12-29 22:39:29 +01:00

xvideos.py

update extractor test results

2021-11-27 19:26:44 +01:00

ytdl.py

use yt-dlp by default (#1850, #2028)

2021-11-29 18:24:26 +01:00