The Patreon-provided URLs for the next set of posts aren't always complete, i.e. they can be missing their scheme and the subsequent double slash: "www.patreon.com/…"
47 KiB
47 KiB
Changelog
Unreleased
1.10.6 - 2019-10-11
Additions
--execcommand-line option to specify a command to run after each file download (#421)
Changes
- Include titles in
gfycatdefault filenames (#434)
Fixes
- Fetch working download URLs for
deviantart(#436) - Various fixes and improvements for
yaplogblogs (#443) - Fix image URL generation for
hitomigalleries - Miscellaneous fixes for
behanceandxvideos
1.10.5 - 2019-09-28
Additions
instagram.highlightsoption to include highlighted stories when downloading user profiles (#329)- Support for
/user/URLs onreddit(#350) - Support for
imguruser profiles and favorites (#420) - Additional metadata fields on
nijie(#423)
Fixes
- Improve handling of private
deviantartartworks (#414) and 429 status codes (#424) - Prevent fatal errors when trying to open download-archive files (#417)
- Detect and ignore unavailable videos on
weibo(#427) - Update the
scopeof newredditrefresh-tokens (#428) - Fix inconsistencies with the
reddit.commentsoption (#429) - Extend URL patterns for
hentaicafemanga andpixivartworks - Improve detection of unavailable albums on
lusciousandimgbb - Miscellaneous fixes for
tsumino
1.10.4 - 2019-09-08
Additions
- Support for
lineblog- https://www.lineblog.me/ (#404)fuskator- https://fuskator.com/ (#407)
ugoiraoption fordanbooruto download pre-rendered ugoira animations (#406)
Fixes
- Download the correct files from
twitterreplies (#403) - Prevent crash when trying to use unavailable downloader modules (#405)
- Fix
pixivauthentication (#411) - Improve
exhentaiimage limit checks - Miscellaneous fixes for
hentaicafe,simplyhentai,tumblr
1.10.3 - 2019-08-30
Additions
- Provide
filenamemetadata for alldeviantartfiles (#392, #400) - Implement a
ytdl.outtmploption to let youtube-dl handle filenames by itself (#395) - Support
seigamobile URLs (#401)
Fixes
- Extract more than the first 32 posts from
piczelgalleries (#396) - Fix filenames of archives created with
--zip(#397) - Skip unavailable images and videos on
flickr(#398) - Fix filesystem paths on Windows with Python 3.6 and lower (#402)
1.10.2 - 2019-08-23
Additions
- Support for
instagramstories and IGTV (#371, #373) - Support for individual
imgbbimages (#363) deviantart.qualityoption to set the JPEG compression quality for newer images (#369)enumerateoption forextractor.skip(#306)adjust-extensionsoption to control filename extension adjustmentspath-removeoption to remove control characters etc. from filesystem paths
Changes
- Rename
restrict-filenamestopath-restrict - Adjust
pixivmetadata and default filename format (#366)- Set
filenameto"{category}_{user[id]}_{id}{suffix}.{extension}"to restore the old default
- Set
- Improve and optimize directory and filename generation
Fixes
- Allow the
classifypost-processor to handle files with unknown filename extension (#138) - Fix rate limit handling for OAuth APIs (#368)
- Fix artwork and scraps extraction on
deviantart(#376, #392) - Distinguish between
imguralbum and gallery URLs (#380) - Prevent crash when using
--ugoira-conv(#382) - Handle multi-image posts on
patreon(#383) - Miscellaneous fixes for
*reactor,simplyhentai
1.10.1 - 2019-08-02
Fixes
- Use the correct domain for exhentai.org input URLs
1.10.0 - 2019-08-01
Warning
- Prior to version 1.10.0 all cache files were created world readable (mode
644) leading to possible sensitive information disclosure on multi-user systems - It is recommended to restrict access permissions of already existing files
(
/tmp/.gallery-dl.cache) withchmod 600 - Windows users should not be affected
Additions
- Support for
vsco- https://vsco.co/ (#331)imgbb- https://imgbb.com/ (#361)adultempire- https://www.adultempire.com/ (#340)
restrict-filenamesoption to create Windows-compatible filenames on any platform (#348)forward-cookiesoption to control cookie forwarding to youtube-dl (#352)
Changes
- The default cache file location on non-Windows systems is now
$XDG_CACHE_HOME/gallery-dl/cache.sqlite3or~/.cache/gallery-dl/cache.sqlite3
- New cache files are created with mode
600 exhentaiextractors will always usee-hentai.orgas domain
Fixes
- Better handling of
exhentaiimage limits and errors (#356, #360) - Try to prevent ZIP file corruption (#355)
- Miscellaneous fixes for
behance,ngomik
1.9.0 - 2019-07-19
Additions
- Support for
erolord- http://erolord.com/ (#326)
- Add login support for
instagram(#195) - Add
--no-downloadandextractor.*.downloaddisable file downloads (#220) - Add
-A/--abortto specify the number of consecutive download skips before aborting - Interpret
-1as infinite retries (#300) - Implement custom log message formats per log-level (#304)
- Implement an
mtimepost-processor that sets file modification times according to metadata fields (#332) - Implement a
twitter.contentoption to enable tweet text extraction (#333, #338) - Enable
date-min/-max/-formatoptions fortumblr(#337)
Changes
- Set file modification times according to their
Last-Modifiedheader when downloading (#236, #277)- Use
--no-mtimeordownloader.*.mtimeto disable this behavior
- Use
- Duplicate download URLs are no longer silently ignored (controllable with
extractor.*.image-unique) - Deprecate
--abort-on-skip
Fixes
- Retry downloads on OpenSSL exceptions (#324)
- Ignore unavailable pins on
sexcominstead of raising an exception (#325) - Use Firefox's SSL/TLS ciphers to prevent Cloudflare CAPTCHAs (#342)
- Improve folder name matching on
deviantart(#343) - Forward cookies to
youtube-dlto allow downloading private videos - Miscellaneous fixes for
35photo,500px,newgrounds,simplyhentai
1.8.7 - 2019-06-28
Additions
- Support for
vanillarock- https://vanilla-rock.com/ (#254)nsfwalbum- https://nsfwalbum.com/ (#287)
artistandtagsmetadata forhentaicafe(#238)descriptionmetadata forinstagram(#310)- Format string option to replace a substring with another -
R<old>/<new>/(#318)
Changes
- Delete empty archives created by the
zippost-processor (#316)
Fixes
- Handle
hitomiGame CG galleries correctly (#321) - Miscellaneous fixes for
deviantart,hitomi,pururin,kissmanga,keenspot,mangoxo,imagefap
1.8.6 - 2019-06-14
Additions
- Support for
slickpic- https://www.slickpic.com/ (#249)xhamster- https://xhamster.com/ (#281)pornhub- https://www.pornhub.com/ (#282)8muses- https://www.8muses.com/ (#305)
extraoption fordeviantartto download Sta.sh content linked in description texts (#302)
Changes
- Detect
directlinkURLs with upper case filename extensions (#296)
Fixes
- Improved error handling for
tumblrAPI calls (#297) - Fixed extraction of
livedoorblogs (#301) - Fixed extraction of special
deviantartSta.sh items (#307) - Fixed pagination for specific
keenspotcomics
1.8.5 - 2019-06-01
Additions
- Support for
keenspot- http://keenspot.com/ (#223)sankakucomplex- https://www.sankakucomplex.com (#258)
foldersoption fordeviantartto add a list of containing folders to each file (#276)captchaoption forkissmangaandreadcomiconlineto control CAPTCHA handling (#279)filenamemetadata for files downloaded with youtube-dl (#291)
Changes
- Adjust
wallhavenextractors to new page layout:- use API and add
api-keyoption - removed traditional login support
- use API and add
- Provide original filenames for
patreondownloads (#268) - Use e-hentai.org or exhentai.org depending on input URL (#278)
Fixes
- Fix pagination over
sankakupopular listings (#265) - Fix folder and collection extraction on
deviantart(#271) - Detect "AreYouHuman" redirects on
readcomiconline(#279) - Miscellaneous fixes for
hentainexus,livedoor,ngomik
1.8.4 - 2019-05-17
Additions
- Support for
patreon- https://www.patreon.com/ (#226)hentainexus- https://hentainexus.com/ (#256)
datemetadata fields forpixiv(#248),instagram(#250),exhentai, andnewgrounds
Changes
- Improved
flickrmetadata and video extraction (#246)
Fixes
- Download original GIF animations from
deviantart(#242) - Ignore missing
edge_media_to_commentfields oninstagram(#250) - Fix serialization of
datetimeobjects for--write-metadata(#251, #252) - Allow multiple post-processor command-line options at once (#253)
- Prevent crash on
boorusites when no tags are available (#259) - Fix extraction on
instagramafterrhx_gisfield removal (#266) - Avoid Cloudflare CAPTCHAs for Python interpreters built against OpenSSL < 1.1.1
- Miscellaneous fixes for
luscious
1.8.3 - 2019-05-04
Additions
- Support for
plurk- https://www.plurk.com/ (#212)sexcom- https://www.sex.com/ (#147)
--clear-cachedatemetadata fields fordeviantart,twitter, andtumblr(#224, #232)
Changes
- Standalone executables are now built using PyInstaller:
- uses the latest CPython interpreter (Python 3.7.3)
- available on several platforms (Windows, Linux, macOS)
- includes the
certifiCA bundle,youtube-dl, andpyOpenSSLon Windows
Fixes
- Patch
urllib3's default list of SSL/TLS ciphers to prevent Cloudflare CAPTCHAs (#227) (Windows users need to installpyOpenSSLfor this to take effect) - Provide fallback URLs for
twitterimages (#237) - Send
Refererheaders when downloading fromhitomi(#239) - Updated login procedure on
mangoxo
1.8.2 - 2019-04-12
Additions
- Support for
pixnet- https://www.pixnet.net/ (#177)wikiart- https://www.wikiart.org/ (#179)mangoxo- https://www.mangoxo.com/ (#184)yaplog- https://yaplog.jp/ (#190)livedoor- http://blog.livedoor.jp/ (#190)
- Login support for
mangoxo(#184) andtwitter(#214)
Changes
- Increased required
Requestsversion to 2.11.0
Fixes
- Improved image quality on
reactorsites (#210) - Support
imagebamgalleries with more than 100 images (#219) - Updated Cloudflare bypass code
1.8.1 - 2019-03-29
Additions
- Support for:
35photo- https://35photo.pro/ (#162)500px- https://500px.com/ (#185)
instagramextractor for hashtags (#202)- Option to get more metadata on
deviantart(#189) - Man pages and bash completion (#150)
- Snap improvements (#197, #199, #207)
Changes
- Better FFmpeg arguments for
--ugoira-conv - Adjusted metadata for
lusciousalbums
Fixes
- Proper handling of
instagrammulti-image posts (#178, #201) - Fixed
tumblravatar URLs when not using OAuth1.0 (#193) - Miscellaneous fixes for
exhentai,komikcast
1.8.0 - 2019-03-15
Additions
- Support for:
weibo- https://www.weibo.com/pururin- https://pururin.io/ (#174)fashionnova- https://www.fashionnova.com/ (#175)shopifysites in general (#175)
- Snap packaging (#169, #170, #187, #188)
- Automatic Cloudflare DDoS protection bypass
- Extractor and Job information for logging format strings
dynastyscansimage and search extractors (#163)deviantartscraps extractor (#168)artstationextractor for artwork listings (#172)smugmugvideo support and improved image format selection (#183)
Changes
- More metadata for
nhentaigalleries - Combined
myportfolioextractors into one - Renamed
namemetadata field tofilenameand removed the originalfilenamefield - Simplified and improved internal data structures
- Optimized creation of child extractors
Fixes
- Filter empty
tumblrURLs (#165) - Filter ads and improve connection speed on
hentaifoundry - Show proper error messages if
lusciousgalleries are unavailable - Miscellaneous fixes for
mangahere,ngomik,simplyhentai,imgspice
Removals
seaotterscans
1.7.0 - 2019-02-05
- Added support for:
photobucket- http://photobucket.com/ (#117)hentaifox- https://hentaifox.com/ (#160)tsumino- https://www.tsumino.com/ (#161)
- Added the ability to dynamically generate extractors based on a user's config file for
- Added an extractor for
behancecollections (#157) - Added login support for
luscious(#159) andtsumino(#161) - Added an option to stop downloading if the
exhentaiimage limit is exceeded (#141) - Fixed extraction issues for
behanceandmangapark
1.6.3 - 2019-01-18
- Added
metadatapost-processor to write image metadata to an external file (#135) - Added option to reverse chapter order of manga extractors (#149)
- Added authentication support for
danbooru(#151) - Added tag metadata for
exhentaiandhbrowsegalleries - Improved
*reactorextractors (#148) - Fixed extraction issues for
nhentai(#156),pinterest,mangapark
1.6.2 - 2019-01-01
- Added support for:
instagram- https://www.instagram.com/ (#134)
- Added support for multiple items on sta.sh pages (#113)
- Added option to download
tumblravatars (#137) - Changed defaults for visited post types and inline media on
tumblr - Improved inline extraction of
tumblrposts (#133, #137) - Improved error handling and retry behavior of all API calls
- Improved handling of missing fields in format strings (#136)
- Fixed hash extraction for unusual
tumblrURLs (#129) - Fixed image subdomains for
hitomigalleries (#142) - Fixed and improved miscellaneous issues for
kissmanga(#20),luscious,mangapark,readcomiconline
1.6.1 - 2018-11-28
- Added support for:
joyreactor- http://joyreactor.cc/ (#114)pornreactor- http://pornreactor.cc/ (#114)newgrounds- https://www.newgrounds.com/ (#119)
- Added extractor for search results on
luscious(#127) - Fixed filenames of ZIP archives (#126)
- Fixed extraction issues for
gfycat,hentaifoundry(#125),mangafox
1.6.0 - 2018-11-17
- Added support for:
wallhaven- https://alpha.wallhaven.cc/yuki- https://yuki.la/
- Added youtube-dl integration and video downloads for
twitter(#99),behance,artstation - Added per-extractor options for network connections (
retries,timeout,verify) - Added a
--no-check-certificatecommand-line option - Added ability to specify the number of skipped downloads before aborting/exiting (#115)
- Added extractors for scraps, favorites, popular and recent images on
hentaifoundry(#110) - Improved login procedure for
pixivto avoid unwanted emails on each new login - Improved album metadata and error handling for
flickr(#109) - Updated default User-Agent string to Firefox 62 (#122)
- Fixed
twitterAPI response handling when logged in (#123) - Fixed issue when converting Ugoira using H.264
- Fixed miscellaneous issues for
2chan,deviantart,fallenangels,flickr,imagefap,pinterest,turboimagehost,warosu,yuki(#112)
1.5.3 - 2018-09-14
- Added support for:
hentaicafe- https://hentai.cafe/ (#101)bobx- http://www.bobx.com/dark/
- Added black-/whitelist options for post-processor modules
- Added support for
tumblrinline videos (#102) - Fixed extraction of
smugmugalbums without owner (#100) - Fixed issues when using default config values with
redditextractors (#104) - Fixed pagination for user favorites on
sankaku(#106) - Fixed a crash when processing
deviantartjournals (#108)
1.5.2 - 2018-08-31
- Added support for
twittertimelines (#96) - Added option to suppress FFmpeg output during ugoira conversions
- Improved filename formatter performance
- Improved inline image quality on
tumblr(#98) - Fixed image URLs for newly released
mangadexchapters - Fixed a smaller issue with
deviantartjournals - Replaced
subapicswithngomik
1.5.1 - 2018-08-17
- Added support for:
piczel- https://piczel.tv/
- Added support for related pins on
pinterest - Fixed accessing "offensive" galleries on
exhentai(#97) - Fixed extraction issues for
mangadex,komikcastandbehance - Removed original-image functionality from
tumblr, since "raw" images are no longer accessible
1.5.0 - 2018-08-03
- Added support for:
behance- https://www.behance.net/myportfolio- https://www.myportfolio.com/ (#95)
- Added custom format string options to handle long strings (#92, #94)
- Slicing:
"{field[10:40]}" - Replacement:
"{field:L40/too long/}"
- Slicing:
- Improved frame rate handling for ugoira conversions
- Improved private access token usage on
deviantart - Fixed metadata extraction for some images on
nijie - Fixed chapter extraction on
mangahere - Removed
whatisthisimnotgoodwithcomputers - Removed support for Python 3.3
1.4.2 - 2018-07-06
- Added image-pool extractors for
safebooruandrule34 - Added option for extended tag information on
boorusites (#92) - Added support for DeviantArt's new URL format
- Added support for
mangaparkmirrors - Changed
imagefapextractors to use HTTPS - Fixed crash when skipping downloads for files without known extension
1.4.1 - 2018-06-22
- Added an
ugoirapost-processor to convertpixivanimations to WebM - Added
--zipand--ugoira-convcommand-line options - Changed how ugoira frame information is handled
- instead of being written to a separate file, it is now made available as metadata field of the ZIP archive
- Fixed manga and chapter titles for
mangadex - Fixed file deletion by post-processors
1.4.0 - 2018-06-08
- Added support for:
simplyhentai- https://www.simply-hentai.com/ (#89)
- Added extractors for
pixivsearch results and followed usersdeviantartsearch results and popular listings
- Added post-processors to perform actions on downloaded files
- Added options to configure logging behavior
- Added OAuth support for
smugmug - Changed
pixivextractors to use the AppAPI- this breaks
favoritearchive IDs and changes some metadata fields
- this breaks
- Changed the default filename format for
tumblrand renamedoffsettonum - Fixed a possible UnicodeDecodeError during installation (#86)
- Fixed extraction of
mangadexmanga with more than 100 chapters (#84) - Fixed miscellaneous issues for
imgur,reddit,komikcast,mangafoxandimagebam
1.3.5 - 2018-05-04
- Added support for:
smugmug- https://www.smugmug.com/
- Added title information for
mangadexchapters - Improved the
pinterestAPI implementation (#83) - Improved error handling for
deviantartandtumblr - Removed
gomangaandpuremashiro
1.3.4 - 2018-04-20
- Added support for custom OAuth2 credentials for
pinterest - Improved rate limit handling for
tumblrextractors - Improved
hentaifoundryextractors - Improved
imgurURL patterns - Fixed miscellaneous extraction issues for
lusciousandkomikcast - Removed
loveisoverandspectrumnexus
1.3.3 - 2018-04-06
- Added extractors for
nhentaisearch resultsexhentaisearch results and favoritesnijiedoujins and favorites
- Improved metadata extraction for
exhentaiandnijie - Improved
tumblrextractors by avoiding unnecessary API calls - Fixed Cloudflare DDoS protection bypass
- Fixed errors when trying to print unencodable characters
1.3.2 - 2018-03-23
- Added extractors for
artstationalbums, challenges and search results - Improved URL and metadata extraction for
hitomiandnhentai - Fixed page transitions for
danbooruAPI results (#82)
1.3.1 - 2018-03-16
- Added support for:
mangadex- https://mangadex.org/artstation- https://www.artstation.com/
- Added Cloudflare DDoS protection bypass to
komikcastextractors - Changed archive ID formats for
deviantartfolders and collections - Improved error handling for
deviantartAPI calls - Removed
imgchiliand various smaller image hosts
1.3.0 - 2018-03-02
- Added
--proxyto explicitly specify a proxy server (#76) - Added options to customize archive ID formats and undefined replacement fields
- Changed various archive ID formats to improve their behavior for favorites / bookmarks / etc.
- Affected modules are
deviantart,flickr,tumblr,pixivand all …boorus
- Affected modules are
- Improved
sankakuandidolcomplexsupport by- respecting
pageandnextURL parameters (#79) - bypassing the page-limit for unauthenticated users
- respecting
- Improved
directlinkmetadata by properly unquoting it - Fixed
pixivugoira extraction (#78) - Fixed miscellaneous extraction issues for
mangastreamandtumblr - Removed
yeet,chronos,coreimg,hosturimage,imageontime,img4ever,imgmaid,imgupload
1.2.0 - 2018-02-16
- Added support for:
paheal- https://rule34.paheal.net/ (#69)komikcast- https://komikcast.com/ (#70)subapics- http://subapics.com/ (#70)
- Added
--download-archiveto record downloaded files in an archive file - Added
--write-logto write logging output to a file - Added a filetype check on download completion to fix incorrectly assigned filename extensions (#63)
- Added the
tumblr:...pseudo URI scheme to support custom domains for Tumblr blogs (#71) - Added fallback URLs for
tumblrimages (#64) - Added support for
reddit-hosted images (#68) - Improved the input file format by allowing comments and per-URL options
- Fixed OAuth 1.0 signature generation for Python 3.3 and 3.4 (#75)
- Fixed smaller issues for
luscious,hentai2read,hentaihereandimgur - Removed the
batotomodule
1.1.2 - 2018-01-12
- Added support for:
puremashiro- http://reader.puremashiro.moe/ (#66)idolcomplex- https://idol.sankakucomplex.com/
- Added an option to filter reblogs on
tumblr(#61) - Added OAuth user authentication for
tumblr(#65) - Added support for
slidesharemobile URLs (#67) - Improved pagination for various …booru sites to work around page limits
- Fixed chapter information parsing for certain manga on
kissmanga(#58) andbatoto(#60)
1.1.1 - 2017-12-22
- Added support for:
slideshare- https://www.slideshare.net/ (#54)
- Added pool- and post-extractors for
sankaku - Added OAuth user authentication for
deviantart - Updated
lusciousto supportmembers.luscious.netURLs (#55) - Updated
mangahereto use their new domain name (mangahere.cc) and support mobile URLs - Updated
gelbooruto not be restricted to the first 20,000 images (#56) - Fixed extraction issues for
nhentaiandkhinsider
1.1.0 - 2017-12-08
- Added the
-r/--limit-ratecommand-line option to set a maximum download rate - Added the
--sleepcommand-line option to specify the number of seconds to sleep before each download - Updated
gelbooruto no longer use their now disabled API - Fixed SWF extraction for
sankaku(#52) - Fixed extraction issues for
hentai2readandkhinsider - Removed the deprecated
--imagesand--chaptersoptions - Removed the
mangazukimodule
1.0.2 - 2017-11-24
- Added an option to set a custom user-agent string
- Improved retry behavior for failed HTTP requests
- Improved
seigaby providing better metadata and getting more than the latest 200 images - Improved
tumblrby adding support for all post types, scanning for inline images and following external links (#48) - Fixed extraction issues for
hbrowse,khinsiderandsenmanga
1.0.1 - 2017-11-10
- Added support for:
xvideos- https://www.xvideos.com/ (#45)
- Fixed exception handling during file downloads which could lead to a premature exit
- Fixed an issue with
tumblrwhere not all images would be downloaded when using tags (#48) - Fixed extraction issues for
imgbox(#47),mangastream(#49) andmangahere
1.0.0 - 2017-10-27
- Added support for:
warosu- https://warosu.org/b4k- https://arch.b4k.co/
- Added support for
pixivranking lists - Added support for
boorupopular lists (danbooru,e621,konachan,yandere,3dbooru) - Added the
--cookiescommand-line andcookiesconfig option to load additional cookies - Added the
--filterand--chapter-filtercommand-line options to select individual images or manga-chapters by their metadata using simple Python expressions (#43) - Added the
verifyconfig option to control certificate verification during file downloads - Added config options to overwrite internally used API credentials (API Tokens & IDs)
- Added
-Kas a shortcut for--list-keywords - Changed the
--imagesand--chapterscommand-line options to--rangeand--chapter-range - Changed keyword names for various modules to make them accessible by
--filter. In general minus signs have been replaced with underscores (e.g.gallery-id->gallery_id). - Changed default filename formats for manga extractors to optionally use volume and title information
- Improved the downloader modules to use
.partfiles and support resuming incomplete downloads (#29) - Improved
deviantartby distinguishing between users and groups (#26), always using HTTPS, and always downloading full-sized original images - Improved
sankakuby adding authentication support and fixing various other issues (#44) - Improved URL pattern for direct image links (#30)
- Fixed an issue with
lusciousnot getting original image URLs (#33) - Fixed various smaller issues for
batoto,hentai2read(#38),jaiminisbox,khinsider,kissmanga(#28, #46),mangahere,pawoo,twitter - Removed
kisscomicandyonkouprodmodules
0.9.1 - 2017-07-24
- Added support for:
2chan- https://www.2chan.net/4plebs- https://archive.4plebs.org/archivedmoe- https://archived.moe/archiveofsins- https://archiveofsins.com/desuarchive- https://desuarchive.org/fireden- https://boards.fireden.net/loveisover- https://archive.loveisover.me/nyafuu- https://archive.nyafuu.org/rbt- https://rbt.asia/thebarchive- https://thebarchive.com/mangazuki- https://mangazuki.co/
- Improved
redditto allow submission filtering by ID and human-readable dates - Improved
deviantartto support group galleries and gallery folders (#26) - Changed
deviantartto use better default path formats - Fixed extraction of larger
imguralbums - Fixed some smaller issues for
pixiv,batotoandfallenangels
0.9.0 - 2017-06-28
- Added support for:
reddit- https://www.reddit.com/ (#15)flickr- https://www.flickr.com/ (#16)gfycat- https://gfycat.com/
- Added support for direct image links
- Added user authentication via OAuth for
redditandflickr - Added support for user authentication data from
.netrcfiles (#22) - Added a simple progress indicator for multiple URLs (#19)
- Added the
--write-unsupportedcommand-line option to write unsupported URLs to a file - Added documentation for all available config options (configuration.rst)
- Improved
pixivto support tags for user downloads (#17) - Improved
pixivto support shortened and http://pixiv.me/... URLs (#23) - Improved
imgurto properly handle.gifvimages and provide better metadata - Fixed an issue with
kissmangawhere metadata parsing for some series failed (#20) - Fixed an issue with getting filename extensions from
Content-Typeresponse headers
0.8.4 - 2017-05-21
- Added the
--abort-on-skipoption to stop extraction if a download would be skipped - Improved the output format of the
--list-keywordsoption - Updated
deviantartto support all media types and journals - Updated
fallenangelsto support their Vietnamese version - Fixed an issue with multiple tags on ...booru sites
- Removed the
yomangamodule
0.8.3 - 2017-05-01
- Added support for https://pawoo.net/
- Added manga extractors for all FoOlSlide-based modules
- Added the
-q/--quietand-v/--verboseoptions to control output verbosity - Added the
-j/--dump-jsonoption to dump extractor results in JSON format - Added the
--ignore-configoption - Updated the
exhentaiextractor to fall back to using the e-hentai version if no username is given - Updated
deviantartto support sta.sh URLs - Fixed an issue with
kissmangawhich prevented image URLs from being decrypted properly (again) - Fixed an issue with
pixhostwhere for an image inside an album it would always download the first image of that album (#13) - Removed the
mangashareandreadcomicsmodules
0.8.2 - 2017-04-10
- Fixed an issue in
kissmangawhich prevented image URLs from being decrypted properly
0.8.1 - 2017-04-09
- Added new extractors:
kireicake- https://reader.kireicake.com/seaotterscans- https://reader.seaotterscans.com/
- Added a favourites extractor for
deviantart - Re-enabled the
kissmangamodule - Updated
nijieto support multi-page image listings - Updated
mangastreamto support readms.net URLs - Updated
exhentaito support e-hentai.org URLs - Updated
fallenangelsto support their new domain and site layout
0.8.0 - 2017-03-28
- Added logging support
- Added the
-R/--retriesoption to specify how often a download should be retried before giving up - Added the
--http-timeoutoption to set a timeout for HTTP connections - Improved error handling/tolerance during HTTP file downloads (#10)
- Improved option parsing and the help message from
-h/--help - Changed the way configuration values are used by prioritizing top-level values
- This allows for cmdline options like
-u/--usernameto overwrite values set in configuration files
- This allows for cmdline options like
- Fixed an issue with
imagefap.comwhere incorrectly reported gallery sizes would cause the extractor to fail (#9) - Fixed an issue with
seiga.nicovideo.jpwhere invalid characters in an API response caused the XML parser to fail - Fixed an issue with
seiga.nicovideo.jpwhere the filename extension for the first image would be used for all others - Removed support for old configuration paths on Windows
- Removed several modules:
mangamint: site is downwhentai: now requires account with VIP status for original imageskissmanga: encrypted image URLs (will be re-added later)
0.7.0 - 2017-03-06
- Added
--imagesand--chaptersoptions- Specifies which images (or chapters) to download through a comma-separated list of indices or index-ranges
- Example:
--images -2,4,6-8,10-will select images with index 1, 2, 4, 6, 7, 8 and 10 up to the last one
- Changed the
-g/--get-urlsoption- The amount of how often the -g option is given now determines up until which level URLs are resolved.
- See
3bca866185
- Changed several option keys:
directory_fmt->directoryfilename_fmt->filenamedownload-original->original
- Improved FoOlSlide-based extractors
- Fixed URL extraction for hentai2read
- Fixed an issue with deviantart, where the API access token wouldn't get refreshed
0.6.4 - 2017-02-13
- Added new extractors:
- fallenangels (famatg.com)
- Fixed url- and data-extraction for:
- nhentai
- mangamint
- imagetwist
- Disabled InsecureConnectionWarning when no certificates are available
0.6.3 - 2017-01-25
- Added new extractors:
- gomanga
- yomanga
- mangafox
- Fixed deviantart extractor failing - switched to using their API
- Fixed an issue with SQLite on Python 3.6
- Automated test builds via Travis CI
- Standalone executables for Windows
0.6.2 - 2017-01-05
- Added new extractors:
- kisscomic
- readcomics
- yonkouprod
- jaiminisbox
- Added manga extractor to batoto-module
- Added user extractor to seiga-module
- Added
-i/--input-fileargument to allow local files and stdin as input (like wget) - Added basic support for
file://URLs- this allows for the recursive extractor to be applied to local files:
$ gallery-dl r:file://[path to file]
- Added a utility extractor to run unit test URLs
- Updated luscious to deal with API changes
- Fixed twitter to provide the original image URL
- Minor fixes to hentaifoundry
- Removed imgclick extractor
0.6.1 - 2016-11-30
- Added new extractors:
- whentai
- readcomiconline
- sensescans, worldthree
- imgmaid, imagevenue, img4ever, imgspot, imgtrial, pixhost
- Added base class for extractors of FoOlSlide-based sites
- Changed default paths for configuration files on Windows
- old paths are still supported, but that will change in future versions
- Fixed aborting downloads if a single one failed (#5)
- Fixed cloudflare-bypass cache containing outdated cookies
- Fixed image URLs for hitomi and 8chan
- Updated deviantart to always provide the highest quality image
- Updated README.rst
- Removed doujinmode extractor
0.6.0 - 2016-10-08
- Added new extractors:
- hentaihere
- dokireader
- rapidimg, picmaniac
- Added support to find filename extensions by Content-Type response header
- Fixed filename/path issues on Windows (#4):
- Enable path names with more than 260 characters
- Remove trailing spaces in path segments
- Updated Job class to automatically set category/subcategory keywords
0.5.2 - 2016-09-23
- Added new extractors:
- rule34
- dynastyscans
- imagebam, coreimg, imgcandy, imgtrex
- Added login capabilities for batoto
- Added
--versioncmdline argument to print the current program version and exit - Added
--list-extractorscmdline argument to print names of all extractor classes together with descriptions and example URLs - Added proper error messages if an image/user does not exist
- Added unittests for every extractor
0.5.1 - 2016-08-22
- Added new extractors:
- luscious
- doujinmode
- hentaibox
- seiga
- imagefap
- Changed error output to use stderr instead of stdout
- Fixed broken pipes causing an exception-dump by catching BrokenPipeErrors
0.5.0 - 2016-07-25
0.4.1 - 2015-12-03
- New modules (imagetwist, turboimagehost)
- Manga-extractors: Download entire manga and not just single chapters
- Generic extractor (provisional)
- Better and configurable console output
- Windows support