github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,951 Commits 1 Branch 0 Tags
46ba173ded03127d1d0014d39b14fa460425613f
Commit Graph

1951 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
46ba173ded [reddit] fix documentation inconsistencies (closes #429) 
- Require 'reddit.comments' to be a number and convert it to an
  integer to be extra sure
- Link to the README's OAuth section were appropriate
 2019-09-27 17:34:10 +02:00
Mike Fährmann
20eb6c401f [nijie] improvements and fixes (#423) 
- ignore unavailable image pages
- more metadata fields: artist_name, date, tags
- rename 'index' to 'num'
- improved code structure
 2019-09-26 21:45:01 +02:00
Mike Fährmann
d1ea08c67d [weibo] fixes and improvements 
- ignore unavailable videos (fixes #427)
- handle empty 'geo' fields
- consistent metadata fields for images and videos
 2019-09-26 14:57:35 +02:00
Mike Fährmann
38d97f3da6 [deviantart] add debug message about API credentials (#424) 2019-09-25 21:20:55 +02:00
Mike Fährmann
80c2104fb5 [deviantart] fix 429 handling if 'fatal' is False (closes #424) 2019-09-25 21:16:35 +02:00
Mike Fährmann
913460240d [reddit] fix 'extractor.blacklist()' arguments 
The second argument must support 'append()'.
 2019-09-24 23:01:12 +02:00
Mike Fährmann
22bac14452 [pixiv] match '/artworks/' URLs 2019-09-24 21:53:14 +02:00
Mike Fährmann
66cac207ac [twitter] match and use 'i/web' status URLs 2019-09-24 21:18:05 +02:00
Mike Fährmann
5a1a0f5325 change text representation of user extractors to "User Profiles" 2019-09-22 22:21:48 +02:00
Mike Fährmann
946f2751e2 [reddit] add 'user' extractor (closes #350) 2019-09-22 22:18:17 +02:00
Mike Fährmann
c14abb9fb8 [reddit] improve URL parameter handling for subreddit links 2019-09-22 22:03:22 +02:00
Mike Fährmann
ee8b654464 [instagram] implement 'highlights' option (closes #329) 2019-09-21 23:38:20 +02:00
Mike Fährmann
f63c3097a9 [instagram] rework some code paths 
- combine fetching an HTML page and extracting its 'shared_data'
- move 'shared_data' and field access info out of '_extract_page()'
- introduce a '_request_graphql()' method
 2019-09-21 23:10:41 +02:00
Mike Fährmann
4330133114 [imgur] add 'favorite' extractor (closes #420) 
… and use a newer site-internal API endpoint for user posts
 2019-09-19 15:54:26 +02:00
Mike Fährmann
ee5e20221f [imgth] fix image URLs 2019-09-19 14:56:48 +02:00
Mike Fährmann
b63b126808 [hentaicafe] extend URL pattern 2019-09-18 19:08:45 +02:00
Mike Fährmann
d780f0357e [imgur] add user extractor 2019-09-17 22:58:18 +02:00
Mike Fährmann
11ea689013 [simplyhentai] fix image and video URLs 2019-09-16 21:37:16 +02:00
Mike Fährmann
15632a1570 [tsumino] fix extraction 2019-09-15 22:09:59 +02:00
Mike Fährmann
d92802fd37 [luscious] fix detection of unavailable galleries 2019-09-15 21:16:25 +02:00
Mike Fährmann
f99da2b866 [imgbb] detect invalid album and user profile links 
and update test results, since the old album got deleted
 2019-09-14 23:22:08 +02:00
Mike Fährmann
01bc7adadc [deviantart] improve journal detection (#419) 
Some journal-like posts are not reported to be journals (isJournal
is set to False), even though they have a textContent field.

https://www.deviantart.com/gliitchlord/art/brashstrokes-812942668
 2019-09-14 22:45:22 +02:00
Mike Fährmann
776e9e073f close archive on job completion (#417) 2019-09-10 22:43:51 +02:00
Mike Fährmann
5ac9732adc call 'sys.exit()' on Ctrl+c 2019-09-10 16:53:21 +02:00
Mike Fährmann
9178b54eae handle errors when opening download archive file (#417) 2019-09-10 16:44:47 +02:00
Mike Fährmann
6e12907de6 [deviantart] improve handling of private deviations (#414) 
- don't try to call '/deviation/metadata' with an empty list of
  deviation ids
- print a warning when detecting private deviations without having
  a 'refresh-token'
 2019-09-10 16:09:03 +02:00
Mike Fährmann
4203931d79 release version 1.10.4 2019-09-08 13:54:45 +02:00
Mike Fährmann
e7690ac694 [vsco] update URL pattern (closes #410) 2019-09-08 11:37:27 +02:00
Mike Fährmann
1848788970 update test results etc 2019-09-08 11:33:35 +02:00
Mike Fährmann
d5fbb2d9de [tumblr] ignore audio links from Spotify etc. 2019-09-07 18:18:12 +02:00
Mike Fährmann
b1cddce865 Revert "[simplyhentai] fix extraction; remove image+video extractors" 
This reverts commit d1db5180ab.
 2019-09-07 14:48:31 +02:00
Mike Fährmann
d23660c04d [hentaicafe] restore default 'request()' behavior 2019-09-07 14:35:00 +02:00
Mike Fährmann
9ae58a6b3e [exhentai] update image limit checks 
- adjust cost of original images
- delay limit initialization until gallery and first image page have
  been requested and all cookies are available
 2019-09-07 13:29:01 +02:00
Mike Fährmann
6fe9a134bf [lineblog] add blog and post extractors (closes #404) 2019-09-06 22:16:42 +02:00
Mike Fährmann
4e8a548a61 [livedoor] update metadata extraction 2019-09-06 21:44:25 +02:00
Mike Fährmann
f9285f99e6 [pixiv] fix authentication 2019-09-02 22:38:56 +02:00
Mike Fährmann
6f3df3999a [fuskator] add gallery and search extractor (closes #407) 2019-09-02 21:20:02 +02:00
Mike Fährmann
bc0ca66c99 [twitter] small improvements 
- handle reply tweets (#403)
- unset cookies in Tweet extractor to "force" the legacy interface
 2019-09-01 17:37:48 +02:00
Mike Fährmann
682105b8ee prevent crash when loading unavailable downloader (#405) 2019-08-31 21:58:33 +02:00
Mike Fährmann
5fcebb69c2 [postprocessor:ugoira] improve error messages (#406) 2019-08-31 21:55:42 +02:00
Mike Fährmann
f02a768b5c [danbooru] add 'ugoira' option (#406) 
to choose between ZIP archives or converted video files
for Ugoira posts
 2019-08-31 21:51:52 +02:00
Mike Fährmann
9646ccb320 release version 1.10.3 2019-08-30 19:41:16 +02:00
Mike Fährmann
dedea3b4db [deviantart] fix journal creation (#400) 2019-08-30 18:50:04 +02:00
Mike Fährmann
c6c5cb1898 improve 'deviantart.quality' description 2019-08-30 18:41:18 +02:00
Mike Fährmann
8eaae58045 [downloader:http] change log message level to 'debug' 2019-08-29 23:05:47 +02:00
Mike Fährmann
efb64ad031 [deviantart] generate filenames (#392, #400) 2019-08-29 10:09:21 +02:00
Mike Fährmann
0ce98169b8 improve path generation 
- fix 'abspath()' results for Python <3.7 (closes #402)
  - 'abspath()' in Python 3.7+ removes trailing path separators
  - in Python <3.7 it doesn't
- filter empty path segments
 2019-08-28 23:25:18 +02:00
Mike Fährmann
b2151f3928 [seiga] support mobile URLs (closes #401) 2019-08-28 22:56:43 +02:00
Mike Fährmann
20fd2d8450 [flickr] skip unavailable images/videos (fixes #398) 2019-08-27 23:26:49 +02:00
Mike Fährmann
c9b97dbca3 extend post processor tests 2019-08-26 23:10:12 +02:00