github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,374 Commits 1 Branch 0 Tags
e1df7f73b13226d8ee10f00dfdcaffe0514ff5eb
Commit Graph

4374 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
e1df7f73b1 [deviantart] add 'search' extractor 
(#538, #1264, #2954, #2970, #3577)

Requires login to fetch any results, since the API endpoint raises an
error for not logged in requests.

TODO: parse HTML search results
 2023-02-20 20:54:46 +01:00
Mike Fährmann
4f029ab38b [pornpics] support '/pornstar' and '/channels' listings 
- fix docstring (#3671)
- simplify code
 2023-02-18 22:38:21 +01:00
Mike Fährmann
cbe4769246 [danbooru] use gallery-dl UA (#3665) 
this removes the ability to set a custom UA via 'user-agent' option
for extractor requests
 2023-02-18 22:28:35 +01:00
Mike Fährmann
253ac08203 pre-define and use 'gallery-dö/<version>' UA string 2023-02-18 22:25:54 +01:00
Mike Fährmann
b4899c266f merge #3656: [deviantart] fix crash when handling deleted deviations in status updates 2023-02-18 13:11:47 +01:00
Mike Fährmann
bb11c2a576 merge #3662: [redgifs] add 'collection' extractors 2023-02-18 13:09:17 +01:00
Mike Fährmann
884f1848d6 [redgifs] fix syntax for older Python versions 
and update docs/supportedsites
 2023-02-18 13:07:40 +01:00
Mike Fährmann
725baedad3 [deviantart] use '/collections/all' endpoint for favorites 
(#3666 ,#3668)
 2023-02-17 23:11:35 +01:00
Mike Fährmann
2bd8f2f4bd [pornpics] add 'search' and 'tag' extractors 
(#263, #3544, #3654)
 2023-02-17 23:03:14 +01:00
Mike Fährmann
79bc82884c [pornpics] add 'gallery' extractor (#263, #3544, #3654) 2023-02-17 15:00:57 +01:00
Mike Fährmann
7bdc1d6d3d [manganelo] update and fix metadata extraction 2023-02-16 22:31:18 +01:00
Mike Fährmann
363bb76dff [manganelo] simplify URL pattern 2023-02-16 21:36:11 +01:00
enduser420
b28bd9789e [redgifs] add 'collection' extractors 2023-02-16 20:10:22 +05:30
ClosedPort22
f4e211356d [deviantart] slight refactor 2023-02-16 21:23:55 +08:00
Mike Fährmann
bd5d08abbc [catbox] add 'file' extractor (#3570) 2023-02-15 19:50:26 +01:00
Mike Fährmann
8e1e8a5bea [soundgasm] rewrite (#3578) 
use a more standard extractor structure to make -A work as expected
 2023-02-15 16:52:07 +01:00
Mike Fährmann
0b93420a81 [pinterest] unescape search terms (#3621) 2023-02-15 15:44:20 +01:00
Mike Fährmann
ad96e70546 [bunkr] fix extraction (#3636, #3655) 2023-02-15 15:42:32 +01:00
Mike Fährmann
9335d55bbc [manganelo] support mobile-only chapters 2023-02-15 00:02:28 +01:00
ClosedPort22
a74114ef7a [deviantart] fix crash when handling deleted deviations 
in status updates
 2023-02-15 00:17:11 +08:00
Mike Fährmann
75570ad3f1 [oauth] remove stray 'exit()' (#3628) 
- bug from 70ce45d9
- broke oauth:tumblr, oauth:flickr, and oauth:smugmug
 2023-02-13 15:58:34 +01:00
Mike Fährmann
d37e7f4898 add 'hooks' option 
Very much a work in progress.

At the moment, it allows to
- wait and restart an extractor (#3338)
- change the exit code (#3630)
- change the log level of a logging message
based on the contents of a logging message
 2023-02-13 13:33:42 +01:00
Mike Fährmann
8fb043e8ff [tumblr] raise more detailed errors for dashboard-only blogs 
(#3628)
 2023-02-12 19:38:14 +01:00
Mike Fährmann
d4232f3a8b implement restarting an extractor (#3338) 2023-02-11 21:06:14 +01:00
Mike Fährmann
ce996dd21b [poipiku] warn about incorrect passwords (#3646) 2023-02-11 15:10:49 +01:00
Mike Fährmann
70ce45d965 [oauth] use default name for browsers without 'name' attribute 
(#3645)

Seem to only be an issue for MacOSXOSAScript before Python 3.11.
d12bec6993
 2023-02-11 14:48:59 +01:00
Mike Fährmann
1aae72773f put argument init on separate lines 2023-02-10 17:05:20 +01:00
Mike Fährmann
2a53e6445c [bunkr] update domain (#3636) 2023-02-09 19:28:32 +01:00
Mike Fährmann
5503ac4d5e replace json.dumps with direct calls to JSONEncoder.encode 2023-02-09 15:51:40 +01:00
Mike Fährmann
dd884b02ee replace json.loads with direct calls to JSONDecoder.decode 2023-02-09 15:22:00 +01:00
Mike Fährmann
b7337d810e [postprocessor:metadata] add 'sort' and 'separators' options 2023-02-07 18:28:14 +01:00
Mike Fährmann
8805bd38ab merge #3622: [imagetwist] add phun.imagetwist.com and imagehaha.com support 2023-02-06 14:52:45 +01:00
Mike Fährmann
706ec70e89 [imagetwist] simplify pattern and add tests 2023-02-06 14:51:57 +01:00
Mike Fährmann
f2e91732ae [instagram] add 'user' metadata field (#3107) 
at the moment only for URLs that need to translate user name to ID
 2023-02-06 14:43:35 +01:00
Mike Fährmann
3436c6b117 [postprocessor:metadata] speed up JSON encoding 2023-02-06 12:35:28 +01:00
Prinz23
29f0830b53 [imagetwist] add phun.imagetwist.com and imagehaha.com alias to imagetwist extractor 2023-02-05 21:13:39 +01:00
Mike Fährmann
762a68996b implement 'archive-pragma' option 2023-02-05 17:00:31 +01:00
Mike Fährmann
bbf0911a46 [e621] implement 'notes' and 'pools' metadata extraction 
(#3425)
 2023-02-04 21:20:38 +01:00
Mike Fährmann
925b467496 split e621 from danbooru module (#3425) 2023-02-03 19:24:31 +01:00
Mike Fährmann
1ae48a54f8 [twitter] add 'transform' option 2023-02-02 22:01:36 +01:00
Mike Fährmann
78d3960a31 [postprocessor:exec] implement archive options (#3584) 2023-02-01 13:57:16 +01:00
Mike Fährmann
489c51cecc [telegraph] fix extraction when images not in <figure> (#3590) 2023-01-31 22:14:44 +01:00
Mike Fährmann
0f7e6c422a merge #3596: [shopify] support ohpolly.com 2023-01-31 20:13:51 +01:00
enduser420
fcf7030b85 [shopify] support ohpolly.com 2023-02-01 00:31:12 +05:30
Mike Fährmann
a6a631f992 merge #3589: [redgifs] support v3 URLs 2023-01-31 19:28:08 +01:00
Mike Fährmann
137a395ae0 [imagefap] fix infinite pagination loop (#3594) 2023-01-31 19:21:43 +01:00
Mike Fährmann
3c708ade8f [imagefap] fix metadata extraction 2023-01-31 15:38:55 +01:00
Mike Fährmann
17e24eacf0 [imagefap] update 'gallery' URLs (#3595) 2023-01-31 15:33:35 +01:00
Mike Fährmann
d16873941c [downloader:http] use 'time.monotonic()' 2023-01-31 15:32:12 +01:00
Mike Fährmann
4572c122d8 document 'extractor.module-sources' 2023-01-30 23:32:36 +01:00