github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,614 Commits 1 Branch 0 Tags
e7b30866d0ad63c2c536ee07a22cb446dbb904e6
Commit Graph

3614 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
e7b30866d0 [postprocessor:mtime] fix timestamps from datetime objects (#2307) 
'datetime.timestamp()', which got used to convert datetime objects to
POSIX timestamps, assumes naive datetimes represent LOCAL time, while
datetimes in 'date' metadata fields represent UTC time.

Ref: https://docs.python.org/3/library/datetime.html#datetime.datetime.timestamp
> Naive datetime instances are assumed to represent local time
> you can obtain the POSIX timestamp by … calculating the timestamp directly
 2022-03-23 23:05:14 +01:00
Mike Fährmann
29db716a63 implement 'datetime_to_timestamp()' 
and rename 'to_timestamp()'
to the more descriptive 'datetime_to_timestamp_string()'
 2022-03-23 22:36:01 +01:00
Mike Fährmann
c0c1277c5f [downloader:http] support sending POST data (#2433) 
by setting the '_http_data' metadata field for a file

needed in addition to be3492776b
to download files with POST requests
 2022-03-23 21:48:38 +01:00
Mike Fährmann
9313d4dc10 [pinterest] do not force 'm3u8_native' for video downloads (#2436) 2022-03-21 10:11:51 +01:00
Mike Fährmann
42f2fd2ed7 [twibooru] fix posts without 'name' (fixes #2434) 2022-03-21 10:08:37 +01:00
Mike Fährmann
40ce505420 [postprocessor:ugoira] add 'mtime' option (#2307) 2022-03-21 10:02:29 +01:00
Mike Fährmann
9bd27b1b8d [postprocessor:metadata] implement archive options (#2421) 
'archive', 'archive-format', and 'archive-prefix'
 2022-03-20 21:16:46 +01:00
Mike Fährmann
be3492776b [downloader:http] support using a different method than GET (#2433) 
by setting the '_http_method' metadata field for a file
 2022-03-20 10:09:05 +01:00
chinggg
6f1d5e8ab9 [unsplash] replace dash with space in search API queries (#2429) 2022-03-19 16:00:05 +01:00
Mike Fährmann
f8230dde43 [instagram] add 'previews' option (#2135) 2022-03-19 15:26:40 +01:00
Mike Fährmann
8295bc6d97 fix loading/storing cookies without domain 2022-03-19 15:14:55 +01:00
Mike Fährmann
500a479026 fix a third(!) bug in _check_cookies() (#2372) 
turns out tests are worthless if you get em wrong ...
 2022-03-18 19:52:37 +01:00
Mike Fährmann
c4cc387f7d [furaffinity] fix search result pagination (fixes #2402) 2022-03-18 13:44:36 +01:00
Mike Fährmann
cf44aba333 [formatter] allow evaluating f-string literals 
by starting a format string with '\fF'.

This was technically already possible with '\fE',
but this makes it a bit more convenient.
 2022-03-18 13:31:01 +01:00
Mike Fährmann
58e0b17211 add note about using '\f' in shells to docs/formatting.md 
(closes #2398, closes #2406)
 2022-03-17 23:09:25 +01:00
Mike Fährmann
d04e07d93b build executables on windows-2019 
windows-2016 gets removed on 2022.03.15
 2022-03-14 18:06:36 +01:00
Mike Fährmann
3acfe683ea release version 1.21.0 2022-03-14 15:42:43 +01:00
Mike Fährmann
a53ec6d5fa do not add '## Unreleased' to chANGELOG 
never gets used anyway
 2022-03-14 15:35:47 +01:00
Mike Fährmann
281a5b3b28 [newgrounds] fix video descriptions (#2328) 2022-03-14 08:38:20 +01:00
Mike Fährmann
b1b15d6cef [imagebam] add support for /view/ paths (closes #2378) 2022-03-14 08:38:20 +01:00
lingegrino
b3d8b40690 Rename meme.museum (#2393) 2022-03-14 08:00:35 +01:00
Mike Fährmann
94452761ed fix cookies tests 2022-03-11 18:16:00 +01:00
Mike Fährmann
e64c2b85d0 [fantia] apply patch (#2381) 
from @thatfuckingbird with small adjustments

https://github.com/mikf/gallery-dl/issues/2381#issuecomment-1063208696
 2022-03-11 18:02:31 +01:00
Mike Fährmann
f31ab0d2ec [fanbox] fetch data for each individual post (fixes #2388) 
Posts from 'https://api.fanbox.cc/post.listCreator'
do not  contain a 'body' with all images anymore.

https://github.com/mikf/gallery-dl/pull/1459#discussion_r614322881
 2022-03-11 17:36:05 +01:00
Mike Fährmann
187fb9b257 remove '$' signs from code blocks 2022-03-11 02:48:10 +01:00
Mike Fährmann
fc277fa45f [seiga] require authentication with 'user_session' cookie (#2372) 
Login with username & password would now require entering a 2FA token.

see also 7b009cc893
 2022-03-11 02:10:15 +01:00
Mike Fährmann
47cf05c4ab refactor proxy handling code (#2357) 
- allow gallery-dl proxy settings to overwrite environment proxies
- allow specifying different proxies for data extraction and download
  - add 'downloader.proxy' option
  - '-o extractor.proxy=–PROXY_URL -o downloader.proxy=null'
    now has the same effect as youtube-dl's '--geo-verification-proxy'
 2022-03-10 23:55:35 +01:00
Mike Fährmann
d50a1ec2cc [subscribestar] unescape attachment URLs (fixes #2370) 2022-03-09 19:06:04 +01:00
Mike Fährmann
3ddc620ef6 [skeb] fix post extractor (#2330) 2022-03-09 18:45:07 +01:00
Hoang Nguyen
6df2fd694d add fish shell completion (#2363) 2022-03-09 18:33:06 +01:00
Orkun Koçyiğit
eb2bb7d998 [fantia] add 'num' enumeration index (#2377) 
* Adding numerical ordering to fantia

* Fixed line to fit PEP8 line size limit
 2022-03-08 22:06:41 +01:00
Mike Fährmann
fac8047899 [kemonoparty] limit default filename length (#2373) 2022-03-08 21:14:47 +01:00
Mike Fährmann
acbb0f5a57 clarify 'metadata.mtime' usage and shortcomings (#2307) 2022-03-08 21:11:06 +01:00
Mike Fährmann
bfa5e61900 [patreon] add explicit 'image_large' file type (#2257) 
to allow more control over when and if to download 'large_url' images

4fee3a0e52 forced them to be downloaded
instead of regular images, even though 'large_url' images are most likely
an upscaled version of the original.
 2022-03-06 17:07:13 +01:00
Mike Fährmann
6ea3ff5173 [tumblr] notify users about registering an oauth application 
if they hit the daily rate limit and are using default API credentials
 2022-03-06 16:28:53 +01:00
Mike Fährmann
b5236656d5 [deviantart] notify users about registering an oauth application 
if they get repeated 429 errors and are using default API credentials
 2022-03-06 16:24:39 +01:00
Mike Fährmann
2aa47e8382 [twitter] handle Tweets with "softIntervention" entries 
or other such things where the actual Tweet data is one level deeper
than usual
 2022-03-03 02:06:54 +01:00
Mike Fährmann
64bbc7969d [twitter] warn about age-restricted Tweets (#2354) 2022-03-03 02:03:27 +01:00
Mike Fährmann
e778be52bc [twitter] update query hashes 2022-03-02 23:05:31 +01:00
Mike Fährmann
bddcec49f1 implement 'text.root_from_url()' 
use domain from input URL for kemono
 2022-03-01 03:09:57 +01:00
Mike Fährmann
92c492dc09 [kemonoparty] match beta.kemono.party URLs (#2348) 2022-03-01 03:02:30 +01:00
Mike Fährmann
4ea9157d51 [mangadex] fix chapters without 'translatedLanguage' (#2352) 2022-03-01 02:04:25 +01:00
Alice
f1cab23724 [skeb] add 'sent-requests' option (#2322) (#2330) 
* Update skeb.py

* Update configuration.rst

* flake8
 2022-02-28 22:42:15 +01:00
dragobit
781fdfa212 [hentaicosplays] add Referer to headers (#2317) 2022-02-28 22:19:32 +01:00
Mike Fährmann
4385a34e05 [twitter] fix handling of 429 responses (fixes #2339) 
Twitter doesn't return a valid JSON response for 429 errors anymore.
 2022-02-28 16:42:55 +01:00
Mike Fährmann
5a50569360 [toyhouse] support 'art' listings (#1546, #2331) 2022-02-27 16:22:50 +01:00
Mike Fährmann
1c79044433 [imagebam] set 'nsfw_inter' cookie (fixes #2334) 2022-02-27 16:12:28 +01:00
Mike Fährmann
d71c173150 [newgrounds] strip incomplete HTML tag from '_comment' (#2328) 2022-02-23 21:42:28 +01:00
Mike Fährmann
00fbc942e5 add 'timedelta' class to the global namespace in filter expressions 
(https://github.com/mikf/gallery-dl/issues/2308#issuecomment-1046135924)
 2022-02-23 00:02:10 +01:00
Mike Fährmann
cf58048bd4 [newgrounds] add 'post_url' metadata field (#2328) 2022-02-23 00:00:23 +01:00