github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,957 Commits 1 Branch 0 Tags
c485d0a95604e5a422d40d2418607bc8436bdc59
Commit Graph

2957 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
c485d0a956 [philomena] add generalized extractors for philomena sites 
(closes #1379)
 2021-03-14 17:19:57 +01:00
Mike Fährmann
6be7df53da [hentaifox] improve metadata extraction (fixes #1378) 2021-03-14 17:19:56 +01:00
Mike Fährmann
72fe9ac0f3 [gelbooru_v01] support some more boorus by default 
- https://drawfriends.booru.org/
- https://vidyart.booru.org/
- https://tlb.booru.org/
 2021-03-14 17:19:56 +01:00
tux93
10c279f285 Weasyl: Drop the &feature=submit part of the favourite extractor URL (#1374) 
It's optional and requiring it forces users to escape those URLs because
of the ampersand
 2021-03-12 16:56:04 +01:00
Mike Fährmann
ec98b2c56f categorize sites in supportedsites.md by basecategory 2021-03-12 16:53:36 +01:00
Mike Fährmann
a67e002f40 update docs/supportedsites 
- use Markdown with inline HTML instead of reStructuredText
- move file from docs/supportedsites.rst to docs/supportedsites.md
- update Makefile, README, etc
 2021-03-12 03:03:48 +01:00
Mike Fährmann
df94182e11 implement 'parent-metadata' option (#1364) 
experimental, might not work as expected, etc.
 2021-03-11 01:10:34 +01:00
Mike Fährmann
4be27ff0fe [nozomi] support '/index-N.html' URLs (closes #1365) 
and '/index-Popular-N.html'
 2021-03-11 01:06:47 +01:00
Mike Fährmann
780bac4c8a [gelbooru] update video server (fixes #1368) 
from 'https://img2.gelbooru.com' to 'https://img3.gelbooru.com'
and provide fallback URLs
 2021-03-10 01:48:07 +01:00
Mike Fährmann
f8441e851a [hentaifox] improve image extraction (fixes #1366) 
build image URLs from embedded JSON data
instead 0f rewriting thumbnail URLs
 2021-03-10 01:38:32 +01:00
Mike Fährmann
c7c3fef0bc [exhentai] support '/tag/' URLs (closes #1363) 2021-03-08 22:40:51 +01:00
Mike Fährmann
90830daf85 [exhentai] improve 'favorites' extraction (closes #1360) 
add special cases for when the favorite count is 0 (Never) or 1 (Once)
 2021-03-07 22:40:25 +01:00
Mike Fährmann
b6719becf1 ensure '-s/--simulate' always prints filenames (#1360) 
by assuming a potentially wrong filename extension in cases where the
correct one would only get known after a download started
 2021-03-07 22:38:20 +01:00
Mike Fährmann
83f465faca [deviantart] refactor 'extra' (#1356) 
- change its expected type to string
- let users specify a list of sources (stash, posts) or 'all'
 2021-03-07 22:23:52 +01:00
Mike Fährmann
5c32a7bf58 [deviantart] allow selecting source for 'extra' (#1356) 
Setting 'extra' to "stash" or "deviations" will only download embedded
sta.sh content or deviations. 'true' still downloads both.
 2021-03-06 21:31:28 +01:00
Mike Fährmann
a677123abb [instagram] recognize 'reels' as option for 'include' (#1329) 2021-03-06 18:50:19 +01:00
Mike Fährmann
94faf8c85a add type check before applying 'browser' option (fixes #1358) 2021-03-06 18:15:32 +01:00
Mike Fährmann
5cf593a00a release version 1.17.0 2021-03-05 18:55:36 +01:00
Mike Fährmann
7440d1f112 [pixiv] add 'translated-tags' option (closes #1354) 
(a lot more straight forward than I thought ...)
 2021-03-05 17:18:51 +01:00
Ailothaen
2e8061091a Adding handling of several input files (#1353) 
* Adding handling of several input files

* Fixed flake8 error due to bad indenting
 2021-03-04 21:37:26 +01:00
林博仁(Buo-ren, Lin)
6e94491847 [snap] allow access user's .netrc for site authentication (#1352) 
The personal-files interface request is granted by the Snap Store.

Fixes #759.

Signed-off-by: 林博仁(Buo-ren Lin) <Buo.Ren.Lin@gmail.com>
 2021-03-04 21:36:49 +01:00
Mike Fährmann
106cdc37c0 [instagram] support '/user/reels/' URLs (closes #1329) 2021-03-04 21:31:18 +01:00
Mike Fährmann
524ebb133e [instagram] refactor reel handling 2021-03-04 20:30:28 +01:00
Mike Fährmann
9785c551bc [500px] skip unavailable photos (#1335) 
instead of crashing with a KeyError exception
 2021-03-04 20:26:26 +01:00
Mike Fährmann
6cfc9613fe update some code in Extractor constructor 
- combine '_init_headers' and '_emulate_browser' functionality
  into new '_init_session'
- add 'headers' and 'ciphers' options
 2021-03-03 23:13:29 +01:00
Mike Fährmann
f59e63669b [hentaicafe] add 'search' and 'tag' extractors (#1345) 2021-03-03 23:09:34 +01:00
Mike Fährmann
38e66940c1 [tumblrgallery] simplify 2021-03-03 15:37:56 +01:00
Seonghyeon Cho
665499924d Support naver webtoon (#1331) 
* Support naver webtoon (WIP)

* Apply patch

* Change filename format

* Fill test results

* Fill test result
 2021-03-03 15:21:13 +01:00
topozorra
a9119da4d4 support tumblrgallery.xyz (#1298) 
* support `tumblrgallery.xyz`

* fix format issues

* Refactor and add post and search page support

* Fix warnings

* Few improvments

* Better file names

* Fix linting errors

* move id closer to the begining of the file name

Co-authored-by: topozorra <none>
 2021-03-03 15:20:47 +01:00
Mike Fährmann
6a28b7045c update 'docs/gallery-dl.conf' 2021-03-03 03:11:48 +01:00
Mike Fährmann
c963741860 add '-E/--extractor-info' command-line option (#875) 2021-03-02 23:59:56 +01:00
Mike Fährmann
bff71cde80 implement 'util.unique_squence()' 2021-03-02 23:11:08 +01:00
Mike Fährmann
bae874f370 replace 'wait-min/-max' with 'sleep-request' 
on exhentai, idolcomplex, reactor
 2021-03-02 22:55:45 +01:00
Mike Fährmann
e165e6c265 [wallhaven] add 'collections' extractor (#1351) 2021-03-02 01:32:26 +01:00
Mike Fährmann
faf561b6ca [wallhaven] add 'collection' extractor (#1351) 2021-03-01 17:12:11 +01:00
Mike Fährmann
5d3d94ba14 [wallhaven] refactor 2021-03-01 17:06:24 +01:00
Mike Fährmann
1a38fae785 add option to use different youtube-dl modules (fixes #1330) 
by setting the 'downloader.ytdl.module' value. For example

{
    "downloader": {
        "ytdl": {
            "module": "yt_dlp"
        }
    }
}

or '-o module=yt_dlp'
 2021-03-01 03:10:42 +01:00
Mike Fährmann
5f1a6ff6fa remove unneeded 'TRAVIS_SKIP' from test_results.py 2021-03-01 01:38:18 +01:00
Mike Fährmann
8821dceb79 use __import__() to dynamically load modules 2021-03-01 01:27:02 +01:00
Mike Fährmann
69ea781d32 [mangadex] improve caching of manga results 
'manga_id' being a string or integer are treated as two different keys
 2021-02-28 01:34:58 +01:00
Mike Fährmann
e58039358d [mangadex] use 'api.mangadex.org' as default API server 
The caching issues seem to be gone.
(#1290, #1310)
 2021-02-28 01:31:50 +01:00
Mike Fährmann
fc15930266 [readcomiconline] download high quality image versions 
(fixes #1347)
 2021-02-28 01:11:32 +01:00
Mike Fährmann
f360778e60 [komikcast] fix extraction 2021-02-27 21:02:52 +01:00
Mike Fährmann
3df527ee2c update extractor test results 2021-02-27 21:01:29 +01:00
Mike Fährmann
1bd3d7cfb0 [postprocessor:metadata] call expand_path() on custom paths 
(#1299)
 2021-02-27 17:19:29 +01:00
Mike Fährmann
fe2ec9cf68 [patreon] reduce redirects when fetching campaign ID 2021-02-27 16:37:41 +01:00
Mike Fährmann
29ea54dc41 [patreon] use '"browser": "firefox"' by default (#1117) 2021-02-27 16:26:42 +01:00
Mike Fährmann
61fbbd2dae [exhentai] rename metadata fields to match API results (#1325) 
- gallery_id    -> gid
- gallery_token -> token
- title_jp      -> title_jpn
- visible       -> expunged
- gallery_size  -> filesize
- count         -> filecount

Also changes the function of the 'metadata' option.
It is now boolean and causes extra data fields from the API to be added
instead of completely replacing the data from HTML when activated.
 2021-02-26 18:21:04 +01:00
Mike Fährmann
996bfe4d4b [hentaicafe] fix manga extractor 
was broken since 993856b8
 2021-02-26 14:24:52 +01:00
Mike Fährmann
5d69e437d0 [twitter] add option to download all media from a conversation 
(fixes #1319)
 2021-02-26 13:50:46 +01:00