github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,670 Commits 1 Branch 0 Tags
84756982e9d96d33ee1f7239512ac2cf4f8a6d2e
Commit Graph

2671 Commits

Author SHA1 Message Date
Mike Fährmann
84756982e9 [pixiv] implement 'include' option 
- split 'user' extractor and its 'avatar' and 'background' options into
  separate extractors ('artworks', 'avatar', 'background')
- avatars can now be downloaded with
  https://www.pixiv.net/en/users/ID/avatar
  as URL and will use a proper archive key; similar for backgrounds
- options for the 'user' subcategory must be moved to 'artworks' to have
  the same effect as before
 2022-05-02 09:03:35 +02:00
Mike Fährmann
d11e2191ae [nijie] support /history_nuita.php listings (closes #2541) 2022-05-02 09:03:34 +02:00
Mike Fährmann
4aca29b7b4 [naverwebtoon] support (best)challenge comics (closes #2542) 
and update URL pattern to match URLs without '.nhn'
 2022-05-02 09:03:34 +02:00
Mike Fährmann
3e926bd465 [realbooru] fix extraction (fixes #2530) 2022-05-02 09:03:34 +02:00
Mike Fährmann
82eee72b39 [pixiv] update API interface 
- start all endpoints with '/'
- use extractor.wait() for rate limit
- retry with while loop instead of recursion
- in case of error, write entire response to debug log
 2022-05-02 09:03:34 +02:00
Mike Fährmann
1bc77efa02 [artstation] use "browser": "firefox" by default (#2527) 2022-05-02 09:03:13 +02:00
Mike Fährmann
a39e7b7366 [vk] handle photos without width/height info (fixes #2535) 2022-05-02 09:03:00 +02:00
Federico Ravasio
0381752575 [photovogue] switch to .com, update api endpoint (#2494) 2022-04-27 22:37:53 +02:00
Mike Fährmann
3f02e483c6 [e621] fix applying request_interval_min (#2533) 
Setting this property after calling Extractor.__init__() has no effect.
 2022-04-27 21:10:34 +02:00
Mike Fährmann
afde76269c [weibo] fix infinite retries for deleted accounts (fixes #2521) 2022-04-27 20:23:11 +02:00
Mike Fährmann
d85e66bcac [vk] fix extraction (#2512) 
Use a different API endpoint, since thumbnail URLs from the old one
cannot be transformed into URLs for "original" photos anymore.
 2022-04-21 14:01:50 +02:00
Mike Fährmann
9e6ff42a9d [pixiv] implement 'background' option (#623, #1124, #2495) 2022-04-21 13:53:02 +02:00
Mike Fährmann
4d1896830f [mangadex] download chapters with 'externalUrl' (fixes #2503) 
if the have pages hosted on mangadex
 2022-04-18 18:09:52 +02:00
Mike Fährmann
97e8a15295 [deviantart] implement 'pagination' option (#2488) 2022-04-18 18:08:01 +02:00
Mike Fährmann
1f9a0e2fd8 update extractor test results 2022-04-18 17:24:00 +02:00
Mike Fährmann
ad5a4b1756 [twitter] fix various syndication issues 
- handle retweets
- fix videos without dimensions in URL (3e942a58)
- fix '"retweets": "self"' filter (#2499)
 2022-04-15 20:49:26 +02:00
Mike Fährmann
12bd9ba33a [readcomiconline] add 'quality' option (#2467) 2022-04-15 18:10:37 +02:00
Mike Fährmann
60ad46ddcc [readcomiconline] unobfuscate image URLs (#2481) 2022-04-15 18:04:09 +02:00
Mike Fährmann
a6c4ff58fb [cyberdrop] match cyberdrop.to URLs (closes #2496) 2022-04-15 15:39:29 +02:00
Mike Fährmann
13ed18b9aa [lolisafe] fix typo 
LolisafelbumExtractor -> LolisafeAlbumExtractor
 2022-04-15 15:02:30 +02:00
Mike Fährmann
3e942a58be [twitter] improve syndication video selection (#2354) 
- ignore .m3u8 manifests
- always select largest format
 2022-04-11 17:06:10 +02:00
Mike Fährmann
0794027100 [issuu] fix extraction (#2483) 2022-04-10 14:23:10 +02:00
Mike Fährmann
5d5a08cc69 [sexcom] add fallback for empty files (#2485) 2022-04-10 14:22:07 +02:00
thatfuckingbird
4527a35aba [twitter] accept fxtwitter.com URLs (#2484) 2022-04-08 14:32:08 +02:00
Mike Fährmann
c1768972c2 [newgrounds] update and fix pagination (#2456) 2022-04-07 15:38:41 +02:00
Mike Fährmann
78e5d0c423 [kissgoddess] extract all images (closes #2473) 
and not only the first two per page
https://github.com/mikf/gallery-dl/issues/1052#issuecomment-1047367383
 2022-04-06 21:28:40 +02:00
Mike Fährmann
0b33435da5 [pinterest] support multiple files per pin (closes #1619, #2452) 2022-04-06 21:21:33 +02:00
Mike Fährmann
9c5d2d7af3 [pinterest] add extractor for created pins (#2452) 2022-04-01 16:59:58 +02:00
Mike Fährmann
1171911dc3 [twitter] add 'syndication' option (#2354) 
to fetch age-restricted content using Twitter's  syndication API
 2022-04-01 16:56:47 +02:00
Mike Fährmann
a53cfc845e [newgrounds] warn about age-restricted posts (#2456) 2022-03-30 16:18:33 +02:00
Mike Fährmann
ecee315bbf [mangasee] unescape manga names (fixes #2454) 2022-03-30 16:18:18 +02:00
loragja
7e545a3ae9 [gofile] add gofile.io extractor (#2364) 
* Add gofile extractor

* add gofile extractor to module list

* add support for tiny monitors and ancient python versions

* seriously, f-strings are not *that* new...

* i love flake8 :)

* add 'api-token' and 'recursive' options
* add tests
 2022-03-29 17:31:57 +02:00
Layerex
625f4d4cc4 [telegraph] Add telegra.ph extractor (#2312) 2022-03-28 19:18:13 +02:00
Mike Fährmann
48cc4853be [skeb] refactor 'sent-requests' and add tests 2022-03-28 11:26:24 +02:00
Mike Fährmann
37d584a9b2 [hitomi] update metadata extraction (fixes #2444) 
remove 'hitomi.metadata' option, as it is no longer necessary
to make additional HTTP requests to fetch all metadata.
 2022-03-26 12:46:18 +01:00
Mike Fährmann
b03ca7f10c [aryion] provide correct 'date' independent of dst 2022-03-24 22:57:18 +01:00
Mike Fährmann
ba69fb669d [kemonoparty] add 'duplicates' option (closes #2440) 2022-03-24 11:58:38 +01:00
Mike Fährmann
29db716a63 implement 'datetime_to_timestamp()' 
and rename 'to_timestamp()'
to the more descriptive 'datetime_to_timestamp_string()'
 2022-03-23 22:36:01 +01:00
Mike Fährmann
9313d4dc10 [pinterest] do not force 'm3u8_native' for video downloads (#2436) 2022-03-21 10:11:51 +01:00
Mike Fährmann
42f2fd2ed7 [twibooru] fix posts without 'name' (fixes #2434) 2022-03-21 10:08:37 +01:00
chinggg
6f1d5e8ab9 [unsplash] replace dash with space in search API queries (#2429) 2022-03-19 16:00:05 +01:00
Mike Fährmann
f8230dde43 [instagram] add 'previews' option (#2135) 2022-03-19 15:26:40 +01:00
Mike Fährmann
500a479026 fix a third(!) bug in _check_cookies() (#2372) 
turns out tests are worthless if you get em wrong ...
 2022-03-18 19:52:37 +01:00
Mike Fährmann
c4cc387f7d [furaffinity] fix search result pagination (fixes #2402) 2022-03-18 13:44:36 +01:00
Mike Fährmann
281a5b3b28 [newgrounds] fix video descriptions (#2328) 2022-03-14 08:38:20 +01:00
Mike Fährmann
b1b15d6cef [imagebam] add support for /view/ paths (closes #2378) 2022-03-14 08:38:20 +01:00
Mike Fährmann
e64c2b85d0 [fantia] apply patch (#2381) 
from @thatfuckingbird with small adjustments

https://github.com/mikf/gallery-dl/issues/2381#issuecomment-1063208696
 2022-03-11 18:02:31 +01:00
Mike Fährmann
f31ab0d2ec [fanbox] fetch data for each individual post (fixes #2388) 
Posts from 'https://api.fanbox.cc/post.listCreator'
do not  contain a 'body' with all images anymore.

https://github.com/mikf/gallery-dl/pull/1459#discussion_r614322881
 2022-03-11 17:36:05 +01:00
Mike Fährmann
fc277fa45f [seiga] require authentication with 'user_session' cookie (#2372) 
Login with username & password would now require entering a 2FA token.

see also 7b009cc893
 2022-03-11 02:10:15 +01:00
Mike Fährmann
47cf05c4ab refactor proxy handling code (#2357) 
- allow gallery-dl proxy settings to overwrite environment proxies
- allow specifying different proxies for data extraction and download
  - add 'downloader.proxy' option
  - '-o extractor.proxy=–PROXY_URL -o downloader.proxy=null'
    now has the same effect as youtube-dl's '--geo-verification-proxy'
 2022-03-10 23:55:35 +01:00