github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
ad30653b17b6759ba237d36ce2bdfb2e58019df5
gallery-dl/gallery_dl/extractor
History
Mike Fährmann ad30653b17 allow running a BaseExtractor for any URL 
by prefixing it with '<base-category>:'

For example:
  shopify:https://partakefoods.com/products/crunchy-cookie-variety-pack
  gelbooru_v01:https://5naf.booru.org/index.php?page=post&s=view&id=46963

Available base categories are:
  mastodon, shopify, moebooru, gelbooru_v01, gelbooru_v02,
  reactor, foolslide, foolfuuka,  philomena
2021-12-15 00:32:17 +01:00
..
__init__.py
[rule34us] add 'tag' and 'post' extractors (#1527)
2021-12-14 00:27:46 +01:00
2chan.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
3dbooru.py
[moebooru] add generalized extractors for moebooru sites
2020-12-01 22:27:18 +01:00
4chan.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
8kun.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
8muses.py
update extractor test results
2021-11-01 02:58:53 +01:00
35photo.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
420chan.py
[429chan] add 'thread' and 'board' extractors (closes #1773)
2021-08-21 22:46:22 +02:00
500px.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
adultempire.py
update extractor class hierarchies
2019-10-16 18:15:29 +02:00
architizer.py
update extractor test results
2021-07-20 20:21:33 +02:00
artstation.py
[artstation] use '/album/all' view for user portfolios (#1826)
2021-09-08 21:46:58 +02:00
aryion.py
[aryion] update/improve pagination (#1849)
2021-09-16 16:27:25 +02:00
bbc.py
[bbc] provide fallback URLs (#1706)
2021-07-30 01:14:07 +02:00
bcy.py
update extractor test results
2021-11-01 02:58:53 +01:00
behance.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
blogger.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
booru.py
[booru] add an option to extract notes (only gelbooru for now) (#1457)
2021-04-13 23:40:24 +02:00
comicvine.py
[comicvine] add extractor (closes #1712)
2021-07-23 16:17:06 +02:00
common.py
allow running a BaseExtractor for any URL
2021-12-15 00:32:17 +01:00
cyberdrop.py
{cyberdrop] restore video extraction (fixes #1993)
2021-10-31 04:34:01 +01:00
danbooru.py
[danbooru] add 'external' option (closes #1747)
2021-08-08 19:18:41 +02:00
desktopography.py
[desktopography] simplify (#1740)
2021-09-17 20:09:24 +02:00
deviantart.py
[deviantart] fix 'index' values for stashed deviations
2021-11-01 01:08:24 +01:00
directlink.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
dynastyscans.py
[dynastyscans] provide 'date' as proper datetime object (#2050)
2021-11-21 22:50:52 +01:00
e621.py
[e621] return pool posts in order (closes #1195)
2020-12-26 19:00:29 +01:00
erome.py
[erome] send Referer header for file downloads (fixes #1829)
2021-09-08 00:29:16 +02:00
exhentai.py
update extractor test results
2021-11-27 19:26:44 +01:00
fallenangels.py
[fallenangels] fix extraction of '.5' chapters
2020-10-23 16:56:08 +02:00
fanbox.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
fantia.py
[desktopography] simplify (#1740)
2021-09-17 20:09:24 +02:00
flickr.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
foolfuuka.py
update extractor test results
2021-11-27 19:26:44 +01:00
foolslide.py
implement 'page-reverse' option (#1854)
2021-09-23 18:02:19 +02:00
furaffinity.py
[furaffinity] unquote search queries (#1958)
2021-10-17 20:48:08 +02:00
fuskator.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
gelbooru_v01.py
[gelbooru_v01] support some more boorus by default
2021-03-14 17:19:56 +01:00
gelbooru_v02.py
[gelbooru] workaround pagination limits
2021-11-26 18:56:31 +01:00
gelbooru.py
[gelbooru] add extractor for '/redirect.php' URLs (#1530)
2021-05-07 15:34:53 +02:00
gfycat.py
[gfycat] show warning when there are no available formats
2021-10-26 19:26:50 +02:00
hbrowse.py
update extractor test results
2020-09-15 18:07:08 +02:00
hentai2read.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
hentaicosplays.py
[hentaicosplays] add 'slug' metadata field (closes #1483)
2021-04-19 16:28:01 +02:00
hentaifoundry.py
[hentaifoundry] use scheme from input URL (fixes #1095)
2020-11-07 22:40:02 +01:00
hentaifox.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
hentaihand.py
update extractor test results
2021-11-01 02:58:53 +01:00
hentaihere.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
hiperdex.py
[hiperdex] fix extraction
2021-09-30 00:32:34 +02:00
hitomi.py
update extractor test results
2021-11-01 02:58:53 +01:00
idolcomplex.py
[idolcomplex] improve and fix pagination (#1601)
2021-06-04 20:31:08 +02:00
imagebam.py
[imagebam] fix extraction of NSFW images (#1534)
2021-05-22 21:41:44 +02:00
imagechest.py
[imagechest] simplify code (#750)
2020-05-18 19:11:26 +02:00
imagefap.py
update extractor test results
2021-09-03 19:36:12 +02:00
imagehosts.py
[fappic] add 'image' extractor (closes #1898)
2021-09-28 23:35:29 +02:00
imgbb.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
imgbox.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
imgth.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
imgur.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
inkbunny.py
[inkbunny] add 'search' extractor (closes #2094)
2021-12-12 03:08:14 +01:00
instagram.py
[instagram] allow downloading specific stories (closes #2088)
2021-12-11 21:34:25 +01:00
issuu.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
kabeuchi.py
[kabeuchi] add 'user' extractor (closes #561)
2020-03-13 16:45:42 +01:00
keenspot.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
kemonoparty.py
{kemonoparty[ change default 'files' order to attachments,file,inline
2021-11-29 04:41:30 +01:00
khinsider.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
komikcast.py
[komikcast] fix extraction
2021-04-15 17:04:53 +02:00
lineblog.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
livedoor.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
luscious.py
update extractor test results
2021-11-01 02:58:53 +01:00
mangadex.py
[mangadex] load additional metadata using includes[] directives
2021-11-22 01:16:33 +01:00
mangafox.py
[mangafox] cleanup
2021-07-04 03:21:02 +02:00
mangahere.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
mangakakalot.py
[mangakakalot] update domain and fix extraction
2021-10-31 02:16:13 +01:00
manganelo.py
[manganelo] update domain to 'manganato.com'
2021-05-28 17:59:21 +02:00
mangapark.py
update extractor test results
2021-11-01 02:58:53 +01:00
mangasee.py
[mangasee] add 'chapter' and 'manga' extractors
2021-06-27 02:03:03 +02:00
mangoxo.py
[mangoxo] fix metadata extraction
2021-11-27 18:19:51 +01:00
mastodon.py
[mastodon] add 'following' extractor (#1891)
2021-09-26 00:12:34 +02:00
message.py
remove 'Message.Metadata' (#866)
2021-01-31 02:12:37 +01:00
moebooru.py
[moebooru] fix 'tags' ending with a '+' when logged in (#1702)
2021-07-16 15:42:03 +02:00
myhentaigallery.py
[myhentaigallery] update and fix extraction (#1001)
2020-09-17 18:14:23 +02:00
myportfolio.py
[myportfolio] fix extraction
2021-04-24 01:22:57 +02:00
naver.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
naverwebtoon.py
[naverwebtoon] fix comic extraction
2021-07-18 03:41:54 +02:00
newgrounds.py
[newgrounds] add 'format' option (closes #1729)
2021-07-29 19:11:20 +02:00
ngomik.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
nhentai.py
[nhentai] simplify
2021-10-14 16:45:53 +02:00
nijie.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
nozomi.py
[nozomi] preserve case of search tags (fixes #1860)
2021-09-16 16:43:06 +02:00
nsfwalbum.py
[nsfwalbum] retry all requests when extracting image URLs
2021-07-30 00:23:04 +02:00
oauth.py
[oauth] fix typo
2021-09-08 20:14:39 +02:00
paheal.py
update extractor test results
2021-11-01 02:58:53 +01:00
patreon.py
update extractor test results
2021-11-01 02:58:53 +01:00
philomena.py
[philomena] support furbooru.org (closes #1995)
2021-11-15 20:57:51 +01:00
photobucket.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
photovogue.py
[photovogue] update (#1253)
2021-01-22 19:38:10 +01:00
picarto.py
[picarto] add 'gallery' extractor (closes #1931)
2021-10-13 01:22:10 +02:00
piczel.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
pillowfort.py
[pillowfort] implement login with username & password (#846)
2021-05-19 02:59:16 +02:00
pinterest.py
[pinterest] add 'search' extractor (#1411)
2021-03-29 01:41:28 +02:00
pixiv.py
[pixiv] add 'sketch' extractor (#1497)
2021-10-13 00:02:11 +02:00
pixnet.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
plurk.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
pornhub.py
update extractor test results
2021-09-03 19:36:12 +02:00
pururin.py
[pururin] update domain and fix extraction
2021-07-18 04:11:59 +02:00
reactor.py
[reactor] support thatpervert.com (closes #2029)
2021-11-26 18:58:07 +01:00
readcomiconline.py
[readcomiconline] change domain to 'readcomiconline.li'
2021-05-01 16:41:16 +02:00
recursive.py
remove 'extractor.blacklist' context manager
2020-09-11 13:17:35 +02:00
reddit.py
[reddit] prevent crash for galleries with no 'media_metadata'
2021-11-03 17:55:40 +01:00
redgifs.py
[redgifs] improve URL extraction
2021-11-05 20:02:43 +01:00
rule34us.py
[rule34us] add 'tag' and 'post' extractors (#1527)
2021-12-14 00:27:46 +01:00
sankaku.py
update extractor test results
2021-11-01 02:58:53 +01:00
sankakucomplex.py
implement 'util.unique_squence()'
2021-03-02 23:11:08 +01:00
seiga.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
senmanga.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
sexcom.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
shopify.py
[shopify] support loungeunderwear.com (closes #2053)
2021-11-26 18:58:06 +01:00
simplyhentai.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
skeb.py
[skeb] add 'thumbnails' option (#2047) (#2051)
2021-11-23 21:16:42 +01:00
slickpic.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
slideshare.py
update extractor test results
2021-11-01 02:58:53 +01:00
smugmug.py
update extractor test results
2021-11-01 02:58:53 +01:00
speakerdeck.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
subscribestar.py
[subscribestar] emit metadata for posts without media (#1569)
2021-11-18 23:42:17 +01:00
tapas.py
update extractor test results
2021-11-01 02:58:53 +01:00
test.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
tsumino.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
tumblr.py
update extractor test results
2021-03-28 23:06:44 +02:00
tumblrgallery.py
[tumblrgallery] simplify
2021-03-03 15:37:56 +01:00
twitter.py
[twitter] fix extractor for direct image links (fixes #2030)
2021-11-16 22:57:46 +01:00
unsplash.py
update extractor test results
2021-09-03 19:36:12 +02:00
vanillarock.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
vk.py
[vk] add 'album' extractor (#474, fixes #1952)
2021-10-23 00:46:20 +02:00
vsco.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
wallhaven.py
[wallhaven] add 'collections' extractor (#1351)
2021-03-02 01:32:26 +01:00
warosu.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
weasyl.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
webtoons.py
[webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net (#2005)
2021-11-11 20:03:34 +01:00
weibo.py
[weibo] extend 'retweets' option (closes #1542)
2021-05-27 23:09:42 +02:00
wikiart.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
wikieat.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
xhamster.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
xvideos.py
update extractor test results
2021-11-27 19:26:44 +01:00
ytdl.py
use yt-dlp by default (#1850, #2028)
2021-11-29 18:24:26 +01:00