github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
2ea0d1da4275e354d997ba4655378135d4ca3e27
gallery-dl/CHANGELOG.md
Mike Fährmann 16e014baaa [smugmug] added image and album extractor 
just some initial code that still requires a lot of work ...

TODO:
- folders
- old-style albums (which are nearly all of them ...)
- images from users
- OAuth

It could also happen that the API credentials used will become invalid
whenever my 14 day trial period ends (7 days remaining), but that
would just require users to supply their own.
2018-04-29 21:27:25 +02:00

19 KiB
Raw Blame History

Changelog

Unreleased

  • Added support for:
  • Added title information for mangadex chapters
  • Improved the pinterest API implementation (#83)
  • Removed gomanga and puremashiro

1.3.4 - 2018-04-20

  • Added support for custom OAuth2 credentials for pinterest
  • Improved rate limit handling for tumblr extractors
  • Improved hentaifoundry extractors
  • Improved imgur URL patterns
  • Fixed miscellaneous extraction issues for luscious and komikcast
  • Removed loveisover and spectrumnexus

1.3.3 - 2018-04-06

  • Added extractors for
    • nhentai search results
    • exhentai search results and favorites
    • nijie doujins and favorites
  • Improved metadata extraction for exhentai and nijie
  • Improved tumblr extractors by avoiding unnecessary API calls
  • Fixed Cloudflare DDoS protection bypass
  • Fixed errors when trying to print unencodable characters

1.3.2 - 2018-03-23

  • Added extractors for artstation albums, challenges and search results
  • Improved URL and metadata extraction for hitomiand nhentai
  • Fixed page transitions for danbooru API results (#82)

1.3.1 - 2018-03-16

  • Added support for:
  • Added Cloudflare DDoS protection bypass to komikcast extractors
  • Changed archive ID formats for deviantart folders and collections
  • Improved error handling for deviantart API calls
  • Removed imgchili and various smaller image hosts

1.3.0 - 2018-03-02

  • Added --proxy to explicitly specify a proxy server (#76)
  • Added options to customize archive ID formats and undefined replacement fields
  • Changed various archive ID formats to improve their behavior for favorites / bookmarks / etc.
    • Affected modules are deviantart, flickr, tumblr, pixiv and all …boorus
  • Improved sankaku and idolcomplex support by
    • respecting page and next URL parameters (#79)
    • bypassing the page-limit for unauthenticated users
  • Improved directlink metadata by properly unquoting it
  • Fixed pixiv ugoira extraction (#78)
  • Fixed miscellaneous extraction issues for mangastream and tumblr
  • Removed yeet, chronos, coreimg, hosturimage, imageontime, img4ever, imgmaid, imgupload

1.2.0 - 2018-02-16

  • Added support for:
  • Added --download-archive to record downloaded files in an archive file
  • Added --write-log to write logging output to a file
  • Added a filetype check on download completion to fix incorrectly assigned filename extensions (#63)
  • Added the tumblr:... pseudo URI scheme to support custom domains for Tumblr blogs (#71)
  • Added fallback URLs for tumblr images (#64)
  • Added support for reddit-hosted images (#68)
  • Improved the input file format by allowing comments and per-URL options
  • Fixed OAuth 1.0 signature generation for Python 3.3 and 3.4 (#75)
  • Fixed smaller issues for luscious, hentai2read, hentaihere and imgur
  • Removed the batoto module

1.1.2 - 2018-01-12

  • Added support for:
  • Added an option to filter reblogs on tumblr (#61)
  • Added OAuth user authentication for tumblr (#65)
  • Added support for slideshare mobile URLs (#67)
  • Improved pagination for various …booru sites to work around page limits
  • Fixed chapter information parsing for certain manga on kissmanga (#58) and batoto (#60)

1.1.1 - 2017-12-22

  • Added support for:
  • Added pool- and post-extractors for sankaku
  • Added OAuth user authentication for deviantart
  • Updated luscious to support members.luscious.net URLs (#55)
  • Updated mangahere to use their new domain name (mangahere.cc) and support mobile URLs
  • Updated gelbooru to not be restricted to the first 20,000 images (#56)
  • Fixed extraction issues for nhentai and khinsider

1.1.0 - 2017-12-08

  • Added the -r/--limit-rate command-line option to set a maximum download rate
  • Added the --sleep command-line option to specify the number of seconds to sleep before each download
  • Updated gelbooru to no longer use their now disabled API
  • Fixed SWF extraction for sankaku (#52)
  • Fixed extraction issues for hentai2read and khinsider
  • Removed the deprecated --images and --chapters options
  • Removed the mangazuki module

1.0.2 - 2017-11-24

  • Added an option to set a custom user-agent string
  • Improved retry behavior for failed HTTP requests
  • Improved seiga by providing better metadata and getting more than the latest 200 images
  • Improved tumblr by adding support for all post types, scanning for inline images and following external links (#48)
  • Fixed extraction issues for hbrowse, khinsider and senmanga

1.0.1 - 2017-11-10

  • Added support for:
  • Fixed exception handling during file downloads which could lead to a premature exit
  • Fixed an issue with tumblr where not all images would be downloaded when using tags (#48)
  • Fixed extraction issues for imgbox (#47), mangastream (#49) and mangahere

1.0.0 - 2017-10-27

  • Added support for:
  • Added support for pixiv ranking lists
  • Added support for booru popular lists (danbooru, e621, konachan, yandere, 3dbooru)
  • Added the --cookies command-line and cookies config option to load additional cookies
  • Added the --filter and --chapter-filter command-line options to select individual images or manga-chapters by their metadata using simple Python expressions (#43)
  • Added the verify config option to control certificate verification during file downloads
  • Added config options to overwrite internally used API credentials (API Tokens & IDs)
  • Added -K as a shortcut for --list-keywords
  • Changed the --images and --chapters command-line options to --range and --chapter-range
  • Changed keyword names for various modules to make them accessible by --filter. In general minus signs have been replaced with underscores (e.g. gallery-id -> gallery_id).
  • Changed default filename formats for manga extractors to optionally use volume and title information
  • Improved the downloader modules to use .part files and support resuming incomplete downloads (#29)
  • Improved deviantart by distinguishing between users and groups (#26), always using HTTPS, and always downloading full-sized original images
  • Improved sankaku by adding authentication support and fixing various other issues (#44)
  • Improved URL pattern for direct image links (#30)
  • Fixed an issue with luscious not getting original image URLs (#33)
  • Fixed various smaller issues for batoto, hentai2read (#38), jaiminisbox, khinsider, kissmanga (#28, #46), mangahere, pawoo, twitter
  • Removed kisscomic and yonkouprod modules

0.9.1 - 2017-07-24

0.9.0 - 2017-06-28

  • Added support for:
  • Added support for direct image links
  • Added user authentication via OAuth for reddit and flickr
  • Added support for user authentication data from .netrc files (#22)
  • Added a simple progress indicator for multiple URLs (#19)
  • Added the --write-unsupported command-line option to write unsupported URLs to a file
  • Added documentation for all available config options (configuration.rst)
  • Improved pixiv to support tags for user downloads (#17)
  • Improved pixiv to support shortened and http://pixiv.me/... URLs (#23)
  • Improved imgur to properly handle .gifv images and provide better metadata
  • Fixed an issue with kissmanga where metadata parsing for some series failed (#20)
  • Fixed an issue with getting filename extensions from Content-Type response headers

0.8.4 - 2017-05-21

  • Added the --abort-on-skip option to stop extraction if a download would be skipped
  • Improved the output format of the --list-keywords option
  • Updated deviantart to support all media types and journals
  • Updated fallenangels to support their Vietnamese version
  • Fixed an issue with multiple tags on ...booru sites
  • Removed the yomanga module

0.8.3 - 2017-05-01

  • Added support for https://pawoo.net/
  • Added manga extractors for all FoOlSlide-based modules
  • Added the -q/--quiet and -v/--verbose options to control output verbosity
  • Added the -j/--dump-json option to dump extractor results in JSON format
  • Added the --ignore-config option
  • Updated the exhentai extractor to fall back to using the e-hentai version if no username is given
  • Updated deviantart to support sta.sh URLs
  • Fixed an issue with kissmanga which prevented image URLs from being decrypted properly (again)
  • Fixed an issue with pixhost where for an image inside an album it would always download the first image of that album (#13)
  • Removed the mangashare and readcomics modules

0.8.2 - 2017-04-10

  • Fixed an issue in kissmanga which prevented image URLs from being decrypted properly

0.8.1 - 2017-04-09

  • Added new extractors:
  • Added a favourites extractor for deviantart
  • Re-enabled the kissmanga module
  • Updated nijie to support multi-page image listings
  • Updated mangastream to support readms.net URLs
  • Updated exhentai to support e-hentai.org URLs
  • Updated fallenangels to support their new domain and site layout

0.8.0 - 2017-03-28

  • Added logging support
  • Added the -R/--retries option to specify how often a download should be retried before giving up
  • Added the --http-timeout option to set a timeout for HTTP connections
  • Improved error handling/tolerance during HTTP file downloads (#10)
  • Improved option parsing and the help message from -h/--help
  • Changed the way configuration values are used by prioritizing top-level values
    • This allows for cmdline options like -u/--username to overwrite values set in configuration files
  • Fixed an issue with imagefap.com where incorrectly reported gallery sizes would cause the extractor to fail (#9)
  • Fixed an issue with seiga.nicovideo.jp where invalid characters in an API response caused the XML parser to fail
  • Fixed an issue with seiga.nicovideo.jp where the filename extension for the first image would be used for all others
  • Removed support for old configuration paths on Windows
  • Removed several modules:
    • mangamint: site is down
    • whentai: now requires account with VIP status for original images
    • kissmanga: encrypted image URLs (will be re-added later)

0.7.0 - 2017-03-06

  • Added --images and --chapters options
    • Specifies which images (or chapters) to download through a comma-separated list of indices or index-ranges
    • Example: --images -2,4,6-8,10- will select images with index 1, 2, 4, 6, 7, 8 and 10 up to the last one
  • Changed the -g/--get-urls option
    • The amount of how often the -g option is given now determines up until which level URLs are resolved.
    • See 3bca866185
  • Changed several option keys:
    • directory_fmt -> directory
    • filename_fmt -> filename
    • download-original -> original
  • Improved FoOlSlide-based extractors
  • Fixed URL extraction for hentai2read
  • Fixed an issue with deviantart, where the API access token wouldn't get refreshed

0.6.4 - 2017-02-13

  • Added new extractors:
    • fallenangels (famatg.com)
  • Fixed url- and data-extraction for:
    • nhentai
    • mangamint
    • twitter
    • imagetwist
  • Disabled InsecureConnectionWarning when no certificates are available

0.6.3 - 2017-01-25

  • Added new extractors:
    • gomanga
    • yomanga
    • mangafox
  • Fixed deviantart extractor failing - switched to using their API
  • Fixed an issue with SQLite on Python 3.6
  • Automated test builds via Travis CI
  • Standalone executables for Windows

0.6.2 - 2017-01-05

  • Added new extractors:
    • kisscomic
    • readcomics
    • yonkouprod
    • jaiminisbox
  • Added manga extractor to batoto-module
  • Added user extractor to seiga-module
  • Added -i/--input-file argument to allow local files and stdin as input (like wget)
  • Added basic support for file:// URLs
    • this allows for the recursive extractor to be applied to local files:
    • $ gallery-dl r:file://[path to file]
  • Added a utility extractor to run unit test URLs
  • Updated luscious to deal with API changes
  • Fixed twitter to provide the original image URL
  • Minor fixes to hentaifoundry
  • Removed imgclick extractor

0.6.1 - 2016-11-30

  • Added new extractors:
    • whentai
    • readcomiconline
    • sensescans, worldthree
    • imgmaid, imagevenue, img4ever, imgspot, imgtrial, pixhost
  • Added base class for extractors of FoOlSlide-based sites
  • Changed default paths for configuration files on Windows
    • old paths are still supported, but that will change in future versions
  • Fixed aborting downloads if a single one failed (#5)
  • Fixed cloudflare-bypass cache containing outdated cookies
  • Fixed image URLs for hitomi and 8chan
  • Updated deviantart to always provide the highest quality image
  • Updated README.rst
  • Removed doujinmode extractor

0.6.0 - 2016-10-08

  • Added new extractors:
    • hentaihere
    • dokireader
    • twitter
    • rapidimg, picmaniac
  • Added support to find filename extensions by Content-Type response header
  • Fixed filename/path issues on Windows (#4):
    • Enable path names with more than 260 characters
    • Remove trailing spaces in path segments
  • Updated Job class to automatically set category/subcategory keywords

0.5.2 - 2016-09-23

  • Added new extractors:
    • pinterest
    • rule34
    • dynastyscans
    • imagebam, coreimg, imgcandy, imgtrex
  • Added login capabilities for batoto
  • Added --version cmdline argument to print the current program version and exit
  • Added --list-extractors cmdline argument to print names of all extractor classes together with descriptions and example URLs
  • Added proper error messages if an image/user does not exist
  • Added unittests for every extractor

0.5.1 - 2016-08-22

  • Added new extractors:
    • luscious
    • doujinmode
    • hentaibox
    • seiga
    • imagefap
  • Changed error output to use stderr instead of stdout
  • Fixed broken pipes causing an exception-dump by catching BrokenPipeErrors

0.5.0 - 2016-07-25

0.4.1 - 2015-12-03

  • New modules (imagetwist, turboimagehost)
  • Manga-extractors: Download entire manga and not just single chapters
  • Generic extractor (provisional)
  • Better and configurable console output
  • Windows support

0.4.0 - 2015-11-26

0.3.3 - 2015-11-10

0.3.2 - 2015-11-04

0.3.1 - 2015-10-30

0.3.0 - 2015-10-05

0.2.0 - 2015-06-28

0.1.0 - 2015-05-27

Reference in New Issue View Git Blame Copy Permalink