github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
19403a7fffd65a361912ac7917a5597568537857
gallery-dl/gallery_dl/extractor
History
Kyle Anthony Williams a14b72be21 [webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net (#2005) 
* [webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net

This trick to avoid having to set a Referer header comes from
Webtoon's RSS feeds. The two URLs below are equivalent in content:

https://webtoon-phinf.pstatic.net/20210929_153/1632867980912DmcGK_JPEG/16328679808882705182.jpg?type=q90
https://swebtoon-phinf.pstatic.net/20210929_153/1632867980912DmcGK_JPEG/16328679808882705182.jpg?type=q90

The URL with the domain "webtoon-phinf.pstatic.net" needs a Referer
header, and the domain "swebtoon-phinf.pstatic.net" does not. This
is because of the environment "swebtoon" images live in, one without
explicit network control: RSS feeds on sites such as Feedly. This change should
make it easier for gallery-dl developers to embed Webtoon comics without
worrying about headers.
2021-11-11 20:03:34 +01:00
..
__init__.py
[seisoparty] remove module
2021-11-09 22:41:04 +01:00
2chan.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
3dbooru.py
[moebooru] add generalized extractors for moebooru sites
2020-12-01 22:27:18 +01:00
4chan.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
8kun.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
8muses.py
update extractor test results
2021-11-01 02:58:53 +01:00
35photo.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
420chan.py
[429chan] add 'thread' and 'board' extractors (closes #1773)
2021-08-21 22:46:22 +02:00
500px.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
adultempire.py
update extractor class hierarchies
2019-10-16 18:15:29 +02:00
architizer.py
update extractor test results
2021-07-20 20:21:33 +02:00
artstation.py
[artstation] use '/album/all' view for user portfolios (#1826)
2021-09-08 21:46:58 +02:00
aryion.py
[aryion] update/improve pagination (#1849)
2021-09-16 16:27:25 +02:00
bbc.py
[bbc] provide fallback URLs (#1706)
2021-07-30 01:14:07 +02:00
bcy.py
update extractor test results
2021-11-01 02:58:53 +01:00
behance.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
blogger.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
booru.py
[booru] add an option to extract notes (only gelbooru for now) (#1457)
2021-04-13 23:40:24 +02:00
comicvine.py
[comicvine] add extractor (closes #1712)
2021-07-23 16:17:06 +02:00
common.py
fix calculating retry sleep times (fixes #1990)
2021-10-29 23:53:48 +02:00
cyberdrop.py
{cyberdrop] restore video extraction (fixes #1993)
2021-10-31 04:34:01 +01:00
danbooru.py
[danbooru] add 'external' option (closes #1747)
2021-08-08 19:18:41 +02:00
desktopography.py
[desktopography] simplify (#1740)
2021-09-17 20:09:24 +02:00
deviantart.py
[deviantart] fix 'index' values for stashed deviations
2021-11-01 01:08:24 +01:00
directlink.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
dynastyscans.py
update extractor test results
2021-09-03 19:36:12 +02:00
e621.py
[e621] return pool posts in order (closes #1195)
2020-12-26 19:00:29 +01:00
erome.py
[erome] send Referer header for file downloads (fixes #1829)
2021-09-08 00:29:16 +02:00
exhentai.py
[exhentai] improve image limits check (#1808)
2021-08-29 21:19:55 +02:00
fallenangels.py
[fallenangels] fix extraction of '.5' chapters
2020-10-23 16:56:08 +02:00
fanbox.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
fantia.py
[desktopography] simplify (#1740)
2021-09-17 20:09:24 +02:00
flickr.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
foolfuuka.py
update extractor test results
2021-11-01 02:58:53 +01:00
foolslide.py
implement 'page-reverse' option (#1854)
2021-09-23 18:02:19 +02:00
furaffinity.py
[furaffinity] unquote search queries (#1958)
2021-10-17 20:48:08 +02:00
fuskator.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
gelbooru_v01.py
[gelbooru_v01] support some more boorus by default
2021-03-14 17:19:56 +01:00
gelbooru_v02.py
[gelbooru_v02] add 'favorite' extractor (closes #1834)
2021-09-10 20:43:59 +02:00
gelbooru.py
[gelbooru] add extractor for '/redirect.php' URLs (#1530)
2021-05-07 15:34:53 +02:00
gfycat.py
[gfycat] show warning when there are no available formats
2021-10-26 19:26:50 +02:00
hbrowse.py
update extractor test results
2020-09-15 18:07:08 +02:00
hentai2read.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
hentaicosplays.py
[hentaicosplays] add 'slug' metadata field (closes #1483)
2021-04-19 16:28:01 +02:00
hentaifoundry.py
[hentaifoundry] use scheme from input URL (fixes #1095)
2020-11-07 22:40:02 +01:00
hentaifox.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
hentaihand.py
update extractor test results
2021-11-01 02:58:53 +01:00
hentaihere.py
…
hiperdex.py
[hiperdex] fix extraction
2021-09-30 00:32:34 +02:00
hitomi.py
update extractor test results
2021-11-01 02:58:53 +01:00
idolcomplex.py
[idolcomplex] improve and fix pagination (#1601)
2021-06-04 20:31:08 +02:00
imagebam.py
[imagebam] fix extraction of NSFW images (#1534)
2021-05-22 21:41:44 +02:00
imagechest.py
[imagechest] simplify code (#750)
2020-05-18 19:11:26 +02:00
imagefap.py
update extractor test results
2021-09-03 19:36:12 +02:00
imagehosts.py
[fappic] add 'image' extractor (closes #1898)
2021-09-28 23:35:29 +02:00
imgbb.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
imgbox.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
imgth.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
imgur.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
inkbunny.py
[inkbunny] add 'following' extractor (#515)
2021-10-11 21:10:20 +02:00
instagram.py
[instagram] update query hashes
2021-10-27 21:37:31 +02:00
issuu.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
kabeuchi.py
[kabeuchi] add 'user' extractor (closes #561)
2020-03-13 16:45:42 +01:00
keenspot.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
kemonoparty.py
[kemonoparty] provide 'date' metadata for gumroad (#2007)
2021-11-11 19:38:10 +01:00
khinsider.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
komikcast.py
[komikcast] fix extraction
2021-04-15 17:04:53 +02:00
lineblog.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
livedoor.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
luscious.py
update extractor test results
2021-11-01 02:58:53 +01:00
mangadex.py
[mangadex] update parameter handling for API requests
2021-10-05 19:46:48 +02:00
mangafox.py
[mangafox] cleanup
2021-07-04 03:21:02 +02:00
mangahere.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
mangakakalot.py
[mangakakalot] update domain and fix extraction
2021-10-31 02:16:13 +01:00
manganelo.py
[manganelo] update domain to 'manganato.com'
2021-05-28 17:59:21 +02:00
mangapark.py
update extractor test results
2021-11-01 02:58:53 +01:00
mangasee.py
[mangasee] add 'chapter' and 'manga' extractors
2021-06-27 02:03:03 +02:00
mangoxo.py
[mangoxo] fix login and extraction
2021-10-31 02:16:13 +01:00
mastodon.py
[mastodon] add 'following' extractor (#1891)
2021-09-26 00:12:34 +02:00
message.py
remove 'Message.Metadata' (#866)
2021-01-31 02:12:37 +01:00
moebooru.py
[moebooru] fix 'tags' ending with a '+' when logged in (#1702)
2021-07-16 15:42:03 +02:00
myhentaigallery.py
[myhentaigallery] update and fix extraction (#1001)
2020-09-17 18:14:23 +02:00
myportfolio.py
[myportfolio] fix extraction
2021-04-24 01:22:57 +02:00
naver.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
naverwebtoon.py
[naverwebtoon] fix comic extraction
2021-07-18 03:41:54 +02:00
newgrounds.py
[newgrounds] add 'format' option (closes #1729)
2021-07-29 19:11:20 +02:00
ngomik.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
nhentai.py
[nhentai] simplify
2021-10-14 16:45:53 +02:00
nijie.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
nozomi.py
[nozomi] preserve case of search tags (fixes #1860)
2021-09-16 16:43:06 +02:00
nsfwalbum.py
[nsfwalbum] retry all requests when extracting image URLs
2021-07-30 00:23:04 +02:00
oauth.py
[oauth] fix typo
2021-09-08 20:14:39 +02:00
paheal.py
update extractor test results
2021-11-01 02:58:53 +01:00
patreon.py
update extractor test results
2021-11-01 02:58:53 +01:00
philomena.py
update extractor test results
2021-11-01 02:58:53 +01:00
photobucket.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
photovogue.py
[photovogue] update (#1253)
2021-01-22 19:38:10 +01:00
picarto.py
[picarto] add 'gallery' extractor (closes #1931)
2021-10-13 01:22:10 +02:00
piczel.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
pillowfort.py
[pillowfort] implement login with username & password (#846)
2021-05-19 02:59:16 +02:00
pinterest.py
[pinterest] add 'search' extractor (#1411)
2021-03-29 01:41:28 +02:00
pixiv.py
[pixiv] add 'sketch' extractor (#1497)
2021-10-13 00:02:11 +02:00
pixnet.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
plurk.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
pornhub.py
update extractor test results
2021-09-03 19:36:12 +02:00
pururin.py
[pururin] update domain and fix extraction
2021-07-18 04:11:59 +02:00
reactor.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
readcomiconline.py
[readcomiconline] change domain to 'readcomiconline.li'
2021-05-01 16:41:16 +02:00
recursive.py
remove 'extractor.blacklist' context manager
2020-09-11 13:17:35 +02:00
reddit.py
[reddit] prevent crash for galleries with no 'media_metadata'
2021-11-03 17:55:40 +01:00
redgifs.py
[redgifs] improve URL extraction
2021-11-05 20:02:43 +01:00
sankaku.py
update extractor test results
2021-11-01 02:58:53 +01:00
sankakucomplex.py
implement 'util.unique_squence()'
2021-03-02 23:11:08 +01:00
seiga.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
senmanga.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
sexcom.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
shopify.py
[shopify] support windsorstore.com (#1793)
2021-08-28 18:34:12 +02:00
simplyhentai.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
skeb.py
[skeb] add 'user' and 'post' extractors (#1031) (#1971)
2021-10-26 20:00:41 +02:00
slickpic.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
slideshare.py
update extractor test results
2021-11-01 02:58:53 +01:00
smugmug.py
update extractor test results
2021-11-01 02:58:53 +01:00
speakerdeck.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
subscribestar.py
update extractor test results
2021-07-04 22:00:32 +02:00
tapas.py
update extractor test results
2021-11-01 02:58:53 +01:00
test.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
tsumino.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
tumblr.py
update extractor test results
2021-03-28 23:06:44 +02:00
tumblrgallery.py
[tumblrgallery] simplify
2021-03-03 15:37:56 +01:00
twitter.py
[twitter] add 'pinned' option
2021-10-29 22:10:58 +02:00
unsplash.py
update extractor test results
2021-09-03 19:36:12 +02:00
vanillarock.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
vk.py
[vk] add 'album' extractor (#474, fixes #1952)
2021-10-23 00:46:20 +02:00
vsco.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
wallhaven.py
[wallhaven] add 'collections' extractor (#1351)
2021-03-02 01:32:26 +01:00
warosu.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
weasyl.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
webtoons.py
[webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net (#2005)
2021-11-11 20:03:34 +01:00
weibo.py
[weibo] extend 'retweets' option (closes #1542)
2021-05-27 23:09:42 +02:00
wikiart.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
wikieat.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
xhamster.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
xvideos.py
update extractor test results
2021-11-01 02:58:53 +01:00
ytdl.py
[ytdl] implement parsing ytdl command-line options (#1680)
2021-11-07 02:44:11 +01:00