github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
369eb6612533fb33dd7d2ccc58f0d1f92b108407
gallery-dl/gallery_dl/extractor
History
Leonardo Taccari 790b1336a6 [instagram] Add support for hashtags 
Add support for hashtags (TagPage-s), i.e. explore/tags/<tag> URLs.

This also introduce a get_metadata() method in order to append
possible further metadata per-(sub)extractor.

Refactor and generalize _extract_profilepage() to _extract_page()
in order to be reused by _extract_profilepage() and _extract_tagpage()
simply by passing the type of page (`ProfilePage' or `TagPage') and picking up
the respective fields in shared data.
2019-03-24 14:05:34 +01:00
..
__init__.py
[hypnohub] add extractors (closes #196)
2019-03-23 09:50:39 +01:00
2chan.py
store the full original URL in Extractor.url
2019-02-12 18:46:48 +01:00
3dbooru.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
4chan.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
8chan.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
35photo.py
[35photo] add user-, genre-, and image-extractors (#162)
2019-03-18 01:11:30 +01:00
500px.py
[500px] add user-, gallery-, and image-extractors (#185)
2019-03-20 17:32:36 +01:00
artstation.py
[artstation] add extractor for artwork listings (#80)
2019-02-18 12:45:44 +01:00
behance.py
provide type information for Queue messages
2019-02-12 21:32:32 +01:00
bobx.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
booru.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
chan.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
common.py
cache cfclearance cookies
2019-03-14 16:14:29 +01:00
danbooru.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
deviantart.py
[deviantart] improve URLs for non-downloadable deviations
2019-03-21 15:37:22 +01:00
directlink.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
dynastyscans.py
[dynastyscans] add extractors for images and image searches
2019-02-18 12:25:52 +01:00
e621.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
exhentai.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
fallenangels.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
flickr.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
foolfuuka.py
small code changes and cleanups
2019-03-13 22:03:02 +01:00
foolslide.py
[seaotterscans] remove extractor
2019-03-13 22:02:45 +01:00
gelbooru.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
gfycat.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
hbrowse.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
hentai2read.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
hentaicafe.py
move TestJob into test module; test _extractor values
2019-02-17 18:18:31 +01:00
hentaifoundry.py
[hentaifoundry] improve/fix extraction
2019-02-25 16:16:09 +01:00
hentaifox.py
adjust metadata types for GalleryExtractors
2019-03-02 14:53:04 +01:00
hentaihere.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
hitomi.py
adjust metadata types for GalleryExtractors
2019-03-02 14:53:04 +01:00
hypnohub.py
[hypnohub] add extractors (closes #196)
2019-03-23 09:50:39 +01:00
idolcomplex.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
imagebam.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
imagefap.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
imagehosts.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
imgbox.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
imgth.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
imgur.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
instagram.py
[instagram] Add support for hashtags
2019-03-24 14:05:34 +01:00
khinsider.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
kissmanga.py
automatically detect and bypass cloudflare challenge pages
2019-03-10 15:31:33 +01:00
komikcast.py
fix typo in README
2019-03-24 11:03:02 +01:00
konachan.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
luscious.py
[komikcast] fix extraction
2019-03-18 11:12:19 +01:00
mangadex.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
mangafox.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
mangahere.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
mangapanda.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
mangapark.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
mangareader.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
mangastream.py
change Chapter and MangaExtractor classes
2019-02-11 18:38:47 +01:00
mastodon.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
message.py
document message identifiers
2018-01-23 21:38:30 +01:00
myportfolio.py
[myportfolio] replace unit test
2019-03-10 15:06:16 +01:00
newgrounds.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
ngomik.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
nhentai.py
adjust metadata types for GalleryExtractors
2019-03-02 14:53:04 +01:00
nijie.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
oauth.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
paheal.py
[paheal] rename "tags" to "search_tags"
2019-02-17 18:18:09 +01:00
photobucket.py
provide type information for Queue messages
2019-02-12 21:32:32 +01:00
piczel.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
pinterest.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
pixiv.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
pururin.py
adjust metadata types for GalleryExtractors
2019-03-02 14:53:04 +01:00
reactor.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
readcomiconline.py
automatically detect and bypass cloudflare challenge pages
2019-03-10 15:31:33 +01:00
recursive.py
store the full original URL in Extractor.url
2019-02-12 18:46:48 +01:00
reddit.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
rule34.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
safebooru.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
sankaku.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
seiga.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
senmanga.py
change Chapter and MangaExtractor classes
2019-02-11 18:38:47 +01:00
shopify.py
small code changes and cleanups
2019-03-13 22:03:02 +01:00
simplyhentai.py
adjust metadata types for GalleryExtractors
2019-03-02 14:53:04 +01:00
slideshare.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
smugmug.py
[smugmug] improve format selection (closes #183)
2019-03-10 15:20:35 +01:00
test.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
tsumino.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
tumblr.py
[tumblr] fix avatar URLs for non-OAuth1.0 calls (closes #193)
2019-03-17 11:07:22 +01:00
twitter.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
wallhaven.py
adjust cache maxage values
2019-03-14 22:21:49 +01:00
warosu.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
weibo.py
[weibo] fix unit test URL patterns
2019-03-15 15:19:39 +01:00
xvideos.py
filter "private" kwdict entries
2019-02-13 13:22:11 +01:00
yandere.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
yuki.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00