github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
0aa8345a137a0e1fa323356216726537d0bd539d
gallery-dl/gallery_dl/extractor
History
Marius Kaufmann 0aa8345a13 [mastodon] allow downloading without access token (#2782) 
Most mastodon instances allow accessing /api/v1/accounts/XXXX/statuses and api/v1/statuses/XXXX without an API access token.
This commit allows users to download at least some links from such a mastodon instance that does not already have access tokens hard-coded into the extractor.
User extractor only works on links that include the user id such as https://mastodon.tld/@id:12345. Status links work as-is.
2022-07-27 12:07:06 +02:00
..
__init__.py
[bunkr] fix extraction (#2732)
2022-07-15 13:00:57 +02:00
2chan.py
update extractor test results
2022-07-12 15:49:22 +02:00
3dbooru.py
[moebooru] add generalized extractors for moebooru sites
2020-12-01 22:27:18 +01:00
4chan.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
8kun.py
update extractor test results
2022-07-12 15:49:22 +02:00
8muses.py
update extractor test results
2022-07-12 15:49:22 +02:00
35photo.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
420chan.py
[429chan] add 'thread' and 'board' extractors (closes #1773)
2021-08-21 22:46:22 +02:00
500px.py
update extractor test results
2022-07-12 15:49:22 +02:00
adultempire.py
update extractor class hierarchies
2019-10-16 18:15:29 +02:00
architizer.py
update extractor test results
2021-07-20 20:21:33 +02:00
artstation.py
[artstation] add 'num' and 'count' metadata fields (#2764)
2022-07-19 14:25:07 +02:00
aryion.py
[aryion] provide correct 'date' independent of dst
2022-03-24 22:57:18 +01:00
bbc.py
[bbc] provide fallback URLs (#1706)
2021-07-30 01:14:07 +02:00
bcy.py
update extractor test results
2021-11-01 02:58:53 +01:00
behance.py
update extractor test results
2022-02-06 21:39:24 +01:00
blogger.py
update extractor test results
2022-07-12 15:49:22 +02:00
booru.py
[booru] call nameext_from_url() before update() and _prepare()
2022-02-18 00:37:59 +01:00
bunkr.py
[bunkr] fix extraction (#2732)
2022-07-15 13:00:57 +02:00
comicvine.py
[comicvine] add extractor (closes #1712)
2021-07-23 16:17:06 +02:00
common.py
add global 'warnings' option (#2762)
2022-07-18 22:20:30 +02:00
cyberdrop.py
[cyberdrop] add fallback URLs (#2668)
2022-06-13 14:19:40 +02:00
danbooru.py
update extractor test results
2022-07-12 15:49:22 +02:00
desktopography.py
[desktopography] simplify (#1740)
2021-09-17 20:09:24 +02:00
deviantart.py
update extractor test results
2022-07-12 15:49:22 +02:00
directlink.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
dynastyscans.py
update extractor test results
2022-02-06 21:39:24 +01:00
erome.py
[erome] send Referer header for file downloads (fixes #1829)
2021-09-08 00:29:16 +02:00
exhentai.py
update extractor test results
2022-07-12 15:49:22 +02:00
fallenangels.py
[fallenangels] fix extraction of '.5' chapters
2020-10-23 16:56:08 +02:00
fanbox.py
fanbox: download cover images in original size (#2784)
2022-07-27 10:53:04 +02:00
fantia.py
[fantia] apply patch (#2381)
2022-03-11 18:02:31 +01:00
flickr.py
generic extractor (#735)
2021-12-29 22:39:29 +01:00
foolfuuka.py
[foolfuuka] remove archive.wakarimasen.moe
2022-07-10 23:13:49 +02:00
foolslide.py
add pre-generated 'pattern' for supported BaseExtractor sites
2022-05-09 22:20:09 +02:00
furaffinity.py
[furaffinity] fix search result pagination (fixes #2402)
2022-03-18 13:44:36 +01:00
fuskator.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
gelbooru_v01.py
[gelbooru_v01] remove 'tlb.booru.org' from supported domains
2022-05-10 12:23:05 +02:00
gelbooru_v02.py
[gelbooru] add support for api_key and user_id (#2767)
2022-07-18 18:46:31 +02:00
gelbooru.py
[gelbooru] add support for api_key and user_id (#2767)
2022-07-18 18:46:31 +02:00
generic.py
generic extractor (#735)
2021-12-29 22:39:29 +01:00
gfycat.py
[gfycat] cleanup
2022-05-29 15:24:23 +02:00
gofile.py
[gofile] fix 401 Unauthorized errors (#2632)
2022-06-01 13:02:34 +02:00
hbrowse.py
update extractor test results
2020-09-15 18:07:08 +02:00
hentai2read.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
hentaicosplays.py
[hentaicosplays] add Referer to headers (#2317)
2022-02-28 22:19:32 +01:00
hentaifoundry.py
[hentaifoundry] fix metadata extraction
2022-07-12 22:19:22 +02:00
hentaifox.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
hentaihand.py
update extractor test results
2022-07-12 15:49:22 +02:00
hentaihere.py
…
hiperdex.py
[hiperdex] fix extraction
2021-09-30 00:32:34 +02:00
hitomi.py
[hitomi] update metadata extraction (fixes #2444)
2022-03-26 12:46:18 +01:00
idolcomplex.py
[idolcomplex] improve and fix pagination (#1601)
2021-06-04 20:31:08 +02:00
imagebam.py
[imagebam] add support for /view/ paths (closes #2378)
2022-03-14 08:38:20 +01:00
imagechest.py
[imagechest] simplify code (#750)
2020-05-18 19:11:26 +02:00
imagefap.py
update extractor test results
2022-07-12 15:49:22 +02:00
imagehosts.py
[fappic] add 'image' extractor (closes #1898)
2021-09-28 23:35:29 +02:00
imgbb.py
generic extractor (#735)
2021-12-29 22:39:29 +01:00
imgbox.py
[Imgbox] Fix ImgboxExtractor (#2281)
2022-02-11 22:17:02 +01:00
imgth.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
imgur.py
[imgur] prevent exception for empty albums (closes #2557)
2022-05-04 17:34:50 +02:00
inkbunny.py
[inkbunny] rename search parameters to their API equivalents
2022-02-13 23:00:49 +01:00
instagram.py
[Instagram] Add support for user's saved collection (#2769)
2022-07-27 10:49:45 +02:00
issuu.py
[issuu] fix extraction (#2483)
2022-04-10 14:23:10 +02:00
itaku.py
[itaku] fix 'date' parsing
2022-07-10 20:45:51 +02:00
kabeuchi.py
[kabeuchi] add 'user' extractor (closes #561)
2020-03-13 16:45:42 +01:00
keenspot.py
generic extractor (#735)
2021-12-29 22:39:29 +01:00
kemonoparty.py
[kemonoparty] ensure all files have an 'extension' (#2740)
2022-07-10 13:53:07 +02:00
khinsider.py
[khinsider] extract 'platform' metadata
2022-07-12 18:31:31 +02:00
kissgoddess.py
[kissgoddess] extract all images (closes #2473)
2022-04-06 21:28:40 +02:00
kohlchan.py
Add Kohlchan extractor (#2251)
2022-02-04 23:22:17 +01:00
komikcast.py
[komikcast] update domain
2022-07-12 23:07:58 +02:00
lightroom.py
[lightroom] add Lightroom gallery extractor (#2263)
2022-02-11 21:30:59 +01:00
lineblog.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
livedoor.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
lolisafe.py
[bunkr] fix extraction (#2732)
2022-07-15 13:00:57 +02:00
luscious.py
update extractor test results
2022-02-06 21:39:24 +01:00
mangadex.py
[mangadex] download chapters with 'externalUrl' (fixes #2503)
2022-04-18 18:09:52 +02:00
mangafox.py
[mangafox] send Referer headers (#2592)
2022-05-15 14:41:16 +02:00
mangahere.py
update extractor test results
2022-07-12 15:49:22 +02:00
mangakakalot.py
update extractor test results
2022-07-12 15:49:22 +02:00
manganelo.py
update extractor test results
2022-07-12 15:49:22 +02:00
mangapark.py
update extractor test results
2022-07-12 15:49:22 +02:00
mangasee.py
[mangasee] use randomly generated PHPSESSID cookie (#2560)
2022-05-05 19:35:32 +02:00
mangoxo.py
[mangoxo] fix metadata extraction
2021-11-27 18:19:51 +01:00
mastodon.py
[mastodon] allow downloading without access token (#2782)
2022-07-27 12:07:06 +02:00
mememuseum.py
[mememuseum] add 'tag' and 'post' extractors (closes #2264)
2022-02-20 02:15:38 +01:00
message.py
remove 'Message.Metadata' (#866)
2021-01-31 02:12:37 +01:00
moebooru.py
[hypnohub] move to gelbooru_v02 instances (#2631)
2022-05-28 21:10:05 +02:00
myhentaigallery.py
update extractor test results
2022-07-12 15:49:22 +02:00
myportfolio.py
generic extractor (#735)
2021-12-29 22:39:29 +01:00
naver.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
naverwebtoon.py
[naverwebtoon] support (best)challenge comics (closes #2542)
2022-05-02 09:03:34 +02:00
newgrounds.py
[newgrounds] prevent exception on empty results (#2727)
2022-07-03 11:44:46 +02:00
ngomik.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
nhentai.py
[nhentai] simplify
2021-10-14 16:45:53 +02:00
nijie.py
[horne] add support for horne.red (#2700)
2022-06-25 16:52:16 +02:00
nozomi.py
[nozomi] small code optimizations
2022-07-14 14:59:11 +02:00
nsfwalbum.py
[nsfwalbum] retry all requests when extracting image URLs
2021-07-30 00:23:04 +02:00
oauth.py
replace calls to print() with stdout_write() (#2529)
2022-05-19 17:09:24 +02:00
paheal.py
[paheal] add 'metadata' option (#2641)
2022-06-04 16:05:49 +02:00
patreon.py
[patreon] add explicit 'image_large' file type (#2257)
2022-03-06 17:07:13 +01:00
philomena.py
update extractor test results
2022-07-12 15:49:22 +02:00
photobucket.py
generic extractor (#735)
2021-12-29 22:39:29 +01:00
photovogue.py
[photovogue] switch to .com, update api endpoint (#2494)
2022-04-27 22:37:53 +02:00
picarto.py
[picarto] add 'gallery' extractor (closes #1931)
2021-10-13 01:22:10 +02:00
piczel.py
update extractor test results
2022-07-12 15:49:22 +02:00
pillowfort.py
update extractor test results
2022-02-06 21:39:24 +01:00
pinterest.py
[pinterest] handle section pins with separate extractors (#2684)
2022-07-03 18:12:16 +02:00
pixiv.py
[pixiv] fix default filenames for backgrounds
2022-07-11 12:45:38 +02:00
pixnet.py
generic extractor (#735)
2021-12-29 22:39:29 +01:00
plurk.py
remove '&' from URL patterns
2020-10-22 23:31:25 +02:00
poipiku.py
[poipiku] add simple password support (#1602)
2022-06-22 18:21:01 +02:00
pornhub.py
generic extractor (#735)
2021-12-29 22:39:29 +01:00
pururin.py
[pururin] update domain and fix extraction
2021-07-18 04:11:59 +02:00
reactor.py
add pre-generated 'pattern' for supported BaseExtractor sites
2022-05-09 22:20:09 +02:00
readcomiconline.py
update extractor test results
2022-07-12 15:49:22 +02:00
recursive.py
remove 'extractor.blacklist' context manager
2020-09-11 13:17:35 +02:00
reddit.py
[reddit] add 'home' extractor (#2614)
2022-05-26 15:28:33 +02:00
redgifs.py
[redgifs] support 'i.redgifs.com' URLs (closes #2300)
2022-02-13 23:00:50 +01:00
rule34us.py
[rule34us] extract tags per category (#1527)
2021-12-16 00:06:52 +01:00
sankaku.py
[sankaku] rewrite URLs to s.sankakucomplex.com (#2746)
2022-07-11 12:46:04 +02:00
sankakucomplex.py
implement 'util.unique_squence()'
2021-03-02 23:11:08 +01:00
seiga.py
[seiga] require authentication with 'user_session' cookie (#2372)
2022-03-11 02:10:15 +01:00
senmanga.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
sexcom.py
[sexcom] add fallback for empty files (#2485)
2022-04-10 14:22:07 +02:00
shopify.py
[shopifx] natively support a few more sites (closes #2089)
2022-05-10 15:49:36 +02:00
simplyhentai.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
skeb.py
update extractor test results
2022-07-12 15:49:22 +02:00
slickpic.py
update extractor test results
2022-07-12 15:49:22 +02:00
slideshare.py
[slideshare] fix 'description' extraction
2022-07-12 18:38:44 +02:00
smugmug.py
update extractor test results
2022-07-12 15:49:22 +02:00
speakerdeck.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
subscribestar.py
[subscribestar] fix 'date' metadata (#2642)
2022-06-04 12:24:08 +02:00
tapas.py
update extractor test results
2022-02-06 21:39:24 +01:00
telegraph.py
[telegraph] Add telegra.ph extractor (#2312)
2022-03-28 19:18:13 +02:00
test.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
toyhouse.py
[toyhouse] support 'art' listings (#1546, #2331)
2022-02-27 16:22:50 +01:00
tsumino.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
tumblr.py
[tumblr] attempt to get higher-quality images (#2761)
2022-07-27 10:47:43 +02:00
tumblrgallery.py
[tumblrgallery] improve search pagination (fixes #2132)
2021-12-24 03:42:28 +01:00
twibooru.py
update extractor test results
2022-07-12 15:49:22 +02:00
twitter.py
[twitter] implement constant 'user' for 'from:…' searches
2022-07-17 19:14:32 +02:00
unsplash.py
[unsplash] add collection_title and …_id metadata fields (#2670)
2022-06-12 18:26:20 +02:00
vanillarock.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
vk.py
[vk] get URLs from *_src entries (#2535)
2022-06-27 10:24:35 +02:00
vsco.py
update extractor test results
2022-07-12 15:49:22 +02:00
wallhaven.py
update extractor test results
2022-07-12 15:49:22 +02:00
wallpapercave.py
[wallpapercave] add extractor for images (#2205)
2022-02-11 23:44:51 +01:00
warosu.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
weasyl.py
[weasyl] implement 'metadata' option (#2610)
2022-05-20 22:32:35 +02:00
webtoons.py
[webtoons] extract real episode number (#2591)
2022-05-17 22:33:29 +02:00
weibo.py
update extractor test results
2022-07-12 15:49:22 +02:00
wikiart.py
update extractor test results
2022-04-18 17:24:00 +02:00
wikieat.py
remove most 'yield Message.Version' statements
2021-08-16 03:10:48 +02:00
xhamster.py
generic extractor (#735)
2021-12-29 22:39:29 +01:00
xvideos.py
update extractor test results
2021-11-27 19:26:44 +01:00
ytdl.py
refactor proxy handling code (#2357)
2022-03-10 23:55:35 +01:00