Mike Fährmann d433735750 [kemonoparty] skip duplicate files (#2032, #1991, #1899) ...

Extract the SHA-256 file hash from URLs
and skip files with the same hash in the same post.

- provide a 'hash' metadata field (empty string if not available)
- remove 'patreon-skip-file' option

2021-11-17 22:44:15 +01:00

..

__init__.py

[seisoparty] remove module

2021-11-09 22:41:04 +01:00

2chan.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

3dbooru.py

[moebooru] add generalized extractors for moebooru sites

2020-12-01 22:27:18 +01:00

4chan.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

8kun.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

8muses.py

update extractor test results

2021-11-01 02:58:53 +01:00

35photo.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

420chan.py

[429chan] add 'thread' and 'board' extractors (closes #1773)

2021-08-21 22:46:22 +02:00

500px.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

adultempire.py

update extractor class hierarchies

2019-10-16 18:15:29 +02:00

architizer.py

update extractor test results

2021-07-20 20:21:33 +02:00

artstation.py

[artstation] use '/album/all' view for user portfolios (#1826)

2021-09-08 21:46:58 +02:00

aryion.py

[aryion] update/improve pagination (#1849)

2021-09-16 16:27:25 +02:00

bbc.py

[bbc] provide fallback URLs (#1706)

2021-07-30 01:14:07 +02:00

bcy.py

update extractor test results

2021-11-01 02:58:53 +01:00

behance.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

blogger.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

booru.py

[booru] add an option to extract notes (only gelbooru for now) (#1457)

2021-04-13 23:40:24 +02:00

comicvine.py

[comicvine] add extractor (closes #1712)

2021-07-23 16:17:06 +02:00

common.py

fix calculating retry sleep times (fixes #1990)

2021-10-29 23:53:48 +02:00

cyberdrop.py

{cyberdrop] restore video extraction (fixes #1993)

2021-10-31 04:34:01 +01:00

danbooru.py

[danbooru] add 'external' option (closes #1747)

2021-08-08 19:18:41 +02:00

desktopography.py

[desktopography] simplify (#1740)

2021-09-17 20:09:24 +02:00

deviantart.py

[deviantart] fix 'index' values for stashed deviations

2021-11-01 01:08:24 +01:00

directlink.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

dynastyscans.py

update extractor test results

2021-09-03 19:36:12 +02:00

e621.py

[e621] return pool posts in order (closes #1195)

2020-12-26 19:00:29 +01:00

erome.py

[erome] send Referer header for file downloads (fixes #1829)

2021-09-08 00:29:16 +02:00

exhentai.py

[exhentai] improve image limits check (#1808)

2021-08-29 21:19:55 +02:00

fallenangels.py

[fallenangels] fix extraction of '.5' chapters

2020-10-23 16:56:08 +02:00

fanbox.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

fantia.py

[desktopography] simplify (#1740)

2021-09-17 20:09:24 +02:00

flickr.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

foolfuuka.py

update extractor test results

2021-11-01 02:58:53 +01:00

foolslide.py

implement 'page-reverse' option (#1854)

2021-09-23 18:02:19 +02:00

furaffinity.py

[furaffinity] unquote search queries (#1958)

2021-10-17 20:48:08 +02:00

fuskator.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

gelbooru_v01.py

[gelbooru_v01] support some more boorus by default

2021-03-14 17:19:56 +01:00

gelbooru_v02.py

[gelbooru_v02] add 'favorite' extractor (closes #1834)

2021-09-10 20:43:59 +02:00

gelbooru.py

[gelbooru] add extractor for '/redirect.php' URLs (#1530)

2021-05-07 15:34:53 +02:00

gfycat.py

[gfycat] show warning when there are no available formats

2021-10-26 19:26:50 +02:00

hbrowse.py

update extractor test results

2020-09-15 18:07:08 +02:00

hentai2read.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

hentaicosplays.py

[hentaicosplays] add 'slug' metadata field (closes #1483)

2021-04-19 16:28:01 +02:00

hentaifoundry.py

[hentaifoundry] use scheme from input URL (fixes #1095)

2020-11-07 22:40:02 +01:00

hentaifox.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

hentaihand.py

update extractor test results

2021-11-01 02:58:53 +01:00

hentaihere.py

change results of text.nameext_from_url()

2019-02-14 16:07:17 +01:00

hiperdex.py

[hiperdex] fix extraction

2021-09-30 00:32:34 +02:00

hitomi.py

update extractor test results

2021-11-01 02:58:53 +01:00

idolcomplex.py

[idolcomplex] improve and fix pagination (#1601)

2021-06-04 20:31:08 +02:00

imagebam.py

[imagebam] fix extraction of NSFW images (#1534)

2021-05-22 21:41:44 +02:00

imagechest.py

[imagechest] simplify code (#750)

2020-05-18 19:11:26 +02:00

imagefap.py

update extractor test results

2021-09-03 19:36:12 +02:00

imagehosts.py

[fappic] add 'image' extractor (closes #1898)

2021-09-28 23:35:29 +02:00

imgbb.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

imgbox.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

imgth.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

imgur.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

inkbunny.py

[inkbunny] add 'following' extractor (#515)

2021-10-11 21:10:20 +02:00

instagram.py

[instagram] include user metadata for 'tagged' downloads (#2024)

2021-11-15 21:21:59 +01:00

issuu.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

kabeuchi.py

[kabeuchi] add 'user' extractor (closes #561)

2020-03-13 16:45:42 +01:00

keenspot.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

kemonoparty.py

[kemonoparty] skip duplicate files (#2032, #1991, #1899)

2021-11-17 22:44:15 +01:00

khinsider.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

komikcast.py

[komikcast] fix extraction

2021-04-15 17:04:53 +02:00

lineblog.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

livedoor.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

luscious.py

update extractor test results

2021-11-01 02:58:53 +01:00

mangadex.py

[mangadex] update parameter handling for API requests

2021-10-05 19:46:48 +02:00

mangafox.py

[mangafox] cleanup

2021-07-04 03:21:02 +02:00

mangahere.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

mangakakalot.py

[mangakakalot] update domain and fix extraction

2021-10-31 02:16:13 +01:00

manganelo.py

[manganelo] update domain to 'manganato.com'

2021-05-28 17:59:21 +02:00

mangapark.py

update extractor test results

2021-11-01 02:58:53 +01:00

mangasee.py

[mangasee] add 'chapter' and 'manga' extractors

2021-06-27 02:03:03 +02:00

mangoxo.py

[mangoxo] fix login and extraction

2021-10-31 02:16:13 +01:00

mastodon.py

[mastodon] add 'following' extractor (#1891)

2021-09-26 00:12:34 +02:00

message.py

remove 'Message.Metadata' (#866)

2021-01-31 02:12:37 +01:00

moebooru.py

[moebooru] fix 'tags' ending with a '+' when logged in (#1702)

2021-07-16 15:42:03 +02:00

myhentaigallery.py

[myhentaigallery] update and fix extraction (#1001)

2020-09-17 18:14:23 +02:00

myportfolio.py

[myportfolio] fix extraction

2021-04-24 01:22:57 +02:00

naver.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

naverwebtoon.py

[naverwebtoon] fix comic extraction

2021-07-18 03:41:54 +02:00

newgrounds.py

[newgrounds] add 'format' option (closes #1729)

2021-07-29 19:11:20 +02:00

ngomik.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

nhentai.py

[nhentai] simplify

2021-10-14 16:45:53 +02:00

nijie.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

nozomi.py

[nozomi] preserve case of search tags (fixes #1860)

2021-09-16 16:43:06 +02:00

nsfwalbum.py

[nsfwalbum] retry all requests when extracting image URLs

2021-07-30 00:23:04 +02:00

oauth.py

[oauth] fix typo

2021-09-08 20:14:39 +02:00

paheal.py

update extractor test results

2021-11-01 02:58:53 +01:00

patreon.py

update extractor test results

2021-11-01 02:58:53 +01:00

philomena.py

[philomena] support furbooru.org (closes #1995)

2021-11-15 20:57:51 +01:00

photobucket.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

photovogue.py

[photovogue] update (#1253)

2021-01-22 19:38:10 +01:00

picarto.py

[picarto] add 'gallery' extractor (closes #1931)

2021-10-13 01:22:10 +02:00

piczel.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

pillowfort.py

[pillowfort] implement login with username & password (#846)

2021-05-19 02:59:16 +02:00

pinterest.py

[pinterest] add 'search' extractor (#1411)

2021-03-29 01:41:28 +02:00

pixiv.py

[pixiv] add 'sketch' extractor (#1497)

2021-10-13 00:02:11 +02:00

pixnet.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

plurk.py

remove '&' from URL patterns

2020-10-22 23:31:25 +02:00

pornhub.py

update extractor test results

2021-09-03 19:36:12 +02:00

pururin.py

[pururin] update domain and fix extraction

2021-07-18 04:11:59 +02:00

reactor.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

readcomiconline.py

[readcomiconline] change domain to 'readcomiconline.li'

2021-05-01 16:41:16 +02:00

recursive.py

remove 'extractor.blacklist' context manager

2020-09-11 13:17:35 +02:00

reddit.py

[reddit] prevent crash for galleries with no 'media_metadata'

2021-11-03 17:55:40 +01:00

redgifs.py

[redgifs] improve URL extraction

2021-11-05 20:02:43 +01:00

sankaku.py

update extractor test results

2021-11-01 02:58:53 +01:00

sankakucomplex.py

implement 'util.unique_squence()'

2021-03-02 23:11:08 +01:00

seiga.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

senmanga.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

sexcom.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

shopify.py

[shopify] support windsorstore.com (#1793)

2021-08-28 18:34:12 +02:00

simplyhentai.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

skeb.py

[skeb] add 'user' and 'post' extractors (#1031) (#1971)

2021-10-26 20:00:41 +02:00

slickpic.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

slideshare.py

update extractor test results

2021-11-01 02:58:53 +01:00

smugmug.py

update extractor test results

2021-11-01 02:58:53 +01:00

speakerdeck.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

subscribestar.py

update extractor test results

2021-07-04 22:00:32 +02:00

tapas.py

update extractor test results

2021-11-01 02:58:53 +01:00

test.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

tsumino.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

tumblr.py

update extractor test results

2021-03-28 23:06:44 +02:00

tumblrgallery.py

[tumblrgallery] simplify

2021-03-03 15:37:56 +01:00

twitter.py

[twitter] fix extractor for direct image links (fixes #2030)

2021-11-16 22:57:46 +01:00

unsplash.py

update extractor test results

2021-09-03 19:36:12 +02:00

vanillarock.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

vk.py

[vk] add 'album' extractor (#474, fixes #1952)

2021-10-23 00:46:20 +02:00

vsco.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

wallhaven.py

[wallhaven] add 'collections' extractor (#1351)

2021-03-02 01:32:26 +01:00

warosu.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

weasyl.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

webtoons.py

[webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net (#2005)

2021-11-11 20:03:34 +01:00

weibo.py

[weibo] extend 'retweets' option (closes #1542)

2021-05-27 23:09:42 +02:00

wikiart.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

wikieat.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

xhamster.py

remove most 'yield Message.Version' statements

2021-08-16 03:10:48 +02:00

xvideos.py

update extractor test results

2021-11-01 02:58:53 +01:00

ytdl.py

[ytdl] improve error handling (#1680)

2021-11-15 22:56:42 +01:00