github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
62b65e59d094e2fef36a7d21757f52ff1da010b7
gallery-dl/gallery_dl/extractor
History
Vrihub 62b65e59d0 Add instagram metadata: post_pageurl, post_tags (#743) 
* Add instagram metadata: post_pageurl, post_tags

Add the following metadata for instagram:
- post_pageurl: json string with url of the post page
- post_tags: json array with instagram tags extracted from the post description

* Oops: rename post_tags to tags for --write-tags

This way, --write-tags will pick up the post tags.

* Rename to post_url, improve regex

* Add post_url and tags to tests

* Remove duplicate tags and sort them

* Bugfix: don't create empty tag lists

* Metadata: add location

* Metadata: add tagged_users for each media

* Move self._find_tags() to base class

* Make flake happy
2020-05-28 21:58:24 +02:00
..
__init__.py
[webtoons] Add a new extractor for webtoons.com (#761)
2020-05-18 19:04:20 +02:00
2chan.py
[2chan] fix metadata extraction
2019-12-03 17:01:11 +01:00
3dbooru.py
update extractor test results
2020-02-27 22:15:40 +01:00
4chan.py
[4chan] add extractor for entire boards (closes #510)
2019-12-09 20:36:05 +01:00
8kun.py
[8kun] adjust URL pattern
2020-02-11 19:00:13 +01:00
8muses.py
add tests for specific datetime values
2020-02-23 16:48:30 +01:00
35photo.py
[35photo] add 'tag' extractor
2020-03-24 02:49:00 +01:00
500px.py
[500px] match 'web.500px.com' subdomains
2020-04-26 22:17:20 +02:00
adultempire.py
update extractor class hierarchies
2019-10-16 18:15:29 +02:00
artstation.py
[artstation] improve embed extraction (#720)
2020-04-30 21:25:03 +02:00
aryion.py
[aryion] support downloading from folders (fixes #694)
2020-04-18 01:25:54 +02:00
bcy.py
[bcy] reduce requests to '/item/detail/<id>' (#613)
2020-03-04 01:37:51 +01:00
behance.py
[behance] get images from 'media_collection' modules
2019-11-27 01:04:33 +01:00
blogger.py
update test results
2020-05-02 21:13:00 +02:00
bobx.py
[bobx] set generated session cookie (closes #482)
2019-11-25 20:04:11 +01:00
booru.py
[gelbooru] improve post ID extraction for pools
2020-04-22 21:28:18 +02:00
common.py
move dump_response() into a separate function (#737)
2020-05-25 22:21:58 +02:00
danbooru.py
[danbooru] change default for 'ugoira' to 'false'
2020-05-20 19:57:28 +02:00
deviantart.py
write OAuth token to cache by default (#616)
2020-05-25 22:35:45 +02:00
directlink.py
[directlink] send Referer headers (closes #536)
2019-12-25 17:17:07 +01:00
dynastyscans.py
miscellaneous fixes and adjustments
2019-08-01 22:09:43 +02:00
e621.py
[e621] derive from Danbooru extractors (#651)
2020-03-22 21:08:45 +01:00
exhentai.py
[exhentai] restrict default directory name length (#545)
2019-12-27 21:29:00 +01:00
fallenangels.py
[luscious] fix tag extraction
2019-05-14 17:35:52 +02:00
flickr.py
update extractor test results
2020-02-16 21:48:46 +01:00
foolfuuka.py
update test results
2020-01-01 16:05:38 +01:00
foolslide.py
update test results
2020-04-26 22:14:28 +02:00
furaffinity.py
[furaffinity] add 'following' extractor (#515)
2020-04-17 22:18:39 +02:00
fuskator.py
update extractor class hierarchies
2019-10-16 18:15:29 +02:00
gelbooru.py
[gelbooru] simplify and fix pool extraction
2020-05-18 19:04:51 +02:00
gfycat.py
[gfycat] include title in default filenames (closes #434)
2019-10-02 21:46:01 +02:00
hbrowse.py
update test results
2019-11-30 23:59:32 +01:00
hentai2read.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
hentaicafe.py
update extractor class hierarchies
2019-10-16 18:15:29 +02:00
hentaifoundry.py
add tests for specific datetime values
2020-02-23 16:48:30 +01:00
hentaifox.py
[hentaifox] fix extraction
2019-12-02 22:21:45 +01:00
hentaihand.py
[hentaihand] add extractors (closes #605)
2020-02-19 21:55:47 +01:00
hentaihere.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
hentainexus.py
[hentainexus] reduce line length (flake8) & update test
2020-03-31 22:08:43 +02:00
hiperdex.py
update extractor test results
2020-05-28 02:18:06 +02:00
hitomi.py
[hitomi] add extractor for tag searches (closes #697)
2020-04-20 21:55:19 +02:00
hypnohub.py
[reddit] fix 'extractor.blacklist()' arguments
2019-09-24 23:01:12 +02:00
idolcomplex.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
imagebam.py
[imagebam] update URL test results
2019-08-07 21:47:44 +02:00
imagechest.py
[imagechest] simplify code (#750)
2020-05-18 19:11:26 +02:00
imagefap.py
[imagefap] generalize URL patterns and add tests (#552)
2020-01-02 14:26:18 +01:00
imagehosts.py
[imagetwist] replace test image
2019-12-22 22:13:13 +01:00
imgbb.py
[imgbb] improve redirect handling
2020-04-20 23:36:57 +02:00
imgbox.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
imgth.py
[imgth] fix image URLs
2019-09-19 14:56:48 +02:00
imgur.py
[imgur] treat 't/unmuted' URLs as galleries
2020-05-25 22:21:57 +02:00
instagram.py
Add instagram metadata: post_pageurl, post_tags (#743)
2020-05-28 21:58:24 +02:00
issuu.py
add tests for specific datetime values
2020-02-23 16:48:30 +01:00
kabeuchi.py
[kabeuchi] add 'user' extractor (closes #561)
2020-03-13 16:45:42 +01:00
keenspot.py
[keenspot] fix extraction for "TwoKinds"
2019-06-17 19:49:39 +02:00
khinsider.py
update test results
2020-02-22 03:25:32 +01:00
kissmanga.py
improve parameter extraction when solving Cloudflare challenge
2020-04-22 22:08:17 +02:00
komikcast.py
[komikcast] ignore banner image
2019-10-03 17:34:06 +02:00
konachan.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
lineblog.py
[lineblog] add blog and post extractors (closes #404)
2019-09-06 22:16:42 +02:00
livedoor.py
update test results
2020-01-12 21:41:06 +01:00
luscious.py
update extractor test results
2020-04-11 23:00:42 +02:00
mangadex.py
update extractor test results
2020-05-28 02:18:06 +02:00
mangafox.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
mangahere.py
[mangahere] send 'isAdult' cookie (fixes #556)
2020-01-04 21:25:35 +01:00
mangapanda.py
change results of text.nameext_from_url()
2019-02-14 16:07:17 +01:00
mangapark.py
update test results
2020-04-26 22:14:28 +02:00
mangareader.py
update extractor test results
2020-02-16 21:48:46 +01:00
mangastream.py
change Chapter and MangaExtractor classes
2019-02-11 18:38:47 +01:00
mangoxo.py
[mangoxo] fix login
2020-03-08 23:01:51 +01:00
mastodon.py
add global SENTINEL object
2020-05-19 22:32:53 +02:00
message.py
Added an additional channel for downloading the metadata of an entire post or gallery.
2019-12-09 00:56:27 -06:00
myportfolio.py
[myportfolio] fix extraction of galleries without title
2020-04-08 21:08:05 +02:00
naver.py
[naver] adjust directory names and metadata structure
2019-10-31 16:53:48 +01:00
newgrounds.py
add 'text.ensure_http_scheme()'
2020-05-19 22:32:53 +02:00
ngomik.py
[ngomik] fix extraction
2019-07-28 10:53:46 +02:00
nhentai.py
adjust metadata types for GalleryExtractors
2019-03-02 14:53:04 +01:00
nijie.py
[nijie] fix 'date' parsing
2019-11-30 23:08:21 +01:00
nozomi.py
[nozomi] move '_unpack()' method to global scope
2020-04-20 21:44:16 +02:00
nsfwalbum.py
update extractor class hierarchies
2019-10-16 18:15:29 +02:00
oauth.py
write OAuth token to cache by default (#616)
2020-05-25 22:35:45 +02:00
paheal.py
update extractor test results
2020-02-27 22:15:40 +01:00
patreon.py
add 'text.ensure_http_scheme()'
2020-05-19 22:32:53 +02:00
photobucket.py
update test results
2019-11-30 23:59:32 +01:00
piczel.py
[piczel] fix extraction for single images
2020-03-31 22:47:23 +02:00
pinterest.py
[pinterest] improve detection of invalid pin.it links
2020-01-18 21:06:44 +01:00
pixiv.py
[pixiv] implement 'avatar' option (#595, #623)
2020-03-09 21:18:16 +01:00
pixnet.py
[pixnet] add extractors (closes #177)
2019-04-11 19:27:02 +02:00
plurk.py
[plurk] add delay between comment requests
2019-12-01 01:03:31 +01:00
pornhub.py
improve 'deviantart.quality' description
2019-08-30 18:41:18 +02:00
pururin.py
add tests for specific datetime values
2020-02-23 16:48:30 +01:00
reactor.py
[reactor] fix image URLs
2019-08-16 14:07:22 +02:00
readcomiconline.py
[kissmanga][readcomiconline] add 'captcha' option (#279)
2019-05-27 22:24:48 +02:00
realbooru.py
update test results
2020-05-02 21:13:00 +02:00
recursive.py
reuse connection adapters from parent extractors
2020-05-12 23:52:01 +02:00
reddit.py
write OAuth token to cache by default (#616)
2020-05-25 22:35:45 +02:00
redgifs.py
[redgifs] fix extraction (#724)
2020-05-28 02:18:42 +02:00
rule34.py
update test results
2019-04-12 09:59:48 +02:00
safebooru.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
sankaku.py
embed error messages in StopExtraction exceptions
2019-10-28 16:39:49 +01:00
sankakucomplex.py
miscellaneous fixes and adjustments
2019-08-01 22:09:43 +02:00
seiga.py
[seiga] support mobile URLs (closes #401)
2019-08-28 22:56:43 +02:00
senmanga.py
update misc test results
2019-11-20 21:45:48 +01:00
sexcom.py
[sexcom] replace 404ed test
2020-05-18 19:04:51 +02:00
shopify.py
update test results
2020-01-12 21:41:06 +01:00
simplyhentai.py
[simplyhentai] ignore certificate errors in video test
2020-03-28 21:07:30 +01:00
slickpic.py
allow multiple hashes for content tests
2020-01-18 00:19:35 +01:00
slideshare.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
smugmug.py
let extractors opt-out of cookie option usage
2020-01-01 21:12:37 +01:00
speakerdeck.py
[speakerdeck] Add a new extractor for speakerdeck.com (#726)
2020-05-01 22:32:22 +02:00
test.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
tsumino.py
add tests for specific datetime values
2020-02-23 16:48:30 +01:00
tumblr.py
prevent flake8 errors from comments looking like type annotations
2020-05-12 20:08:05 +02:00
twitter.py
update extractor test results
2020-05-28 02:18:06 +02:00
vanillarock.py
[vanillarock] add post and tag extractors (closes #254)
2019-06-23 22:45:36 +02:00
vsco.py
[vsco] fix extraction
2020-04-30 21:12:06 +02:00
wallhaven.py
add tests for specific datetime values
2020-02-23 16:48:30 +01:00
warosu.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00
webtoons.py
[webtoons] make archive_fmt unique (#779)
2020-05-25 21:23:54 +02:00
weibo.py
[weibo] add 'videos' option
2020-04-30 00:00:30 +02:00
wikiart.py
update extractor test results
2020-05-28 02:18:06 +02:00
xhamster.py
[xhamster] support xhamster.porncache.net domains (closes #700)
2020-04-22 18:31:05 +02:00
xvideos.py
[xvideos] improve
2019-12-13 19:03:56 +01:00
yandere.py
simplify extractor constants
2019-02-08 13:45:40 +01:00
yuki.py
propagate 'match' to base extractor constructor
2019-02-11 13:31:10 +01:00