github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,820 Commits 1 Branch 0 Tags
5ed245317df5e3edb644d0aab4bb35a759d5eaee
Commit Graph

86 Commits

Author SHA1 Message Date
Mike Fährmann
d97b8c2fba consistent cookie-related names 
- rename every cookie variable or method to 'cookies_*'
- simplify '.session.cookies' to just '.cookies'
- more consistent 'login()' structure
 2023-07-22 01:20:50 +02:00
Mike Fährmann
c6b31a2169 [reddit] set default 0.6s delay between requests (#4292) 
to limit API requests to 100 per minute
https://www.reddit.com/r/redditdev/comments/14nbw6g/
 2023-07-14 14:41:16 +02:00
Mike Fährmann
f079d9a703 [reddit] notify users about registering an oauth application 
(#4292, #4253, #3943)
 2023-07-12 21:43:00 +02:00
Mike Fährmann
94b6a67666 [reddit] fix crash with empty 'crosspost_parent_lists' (#4120) 2023-06-01 14:51:58 +02:00
Mike Fährmann
f8c4c5eef9 [reddit] simplify and add tests 2023-05-25 13:15:11 +02:00
Alexandru Vasilescu
d4f8b2fe22 fix: linter issues 2023-04-28 13:45:23 +03:00
Alexandru Vasilescu
1b918bd937 fix(extractor): fix extraction for cross-posted reddit videos and galleries 2023-04-28 13:13:25 +03:00
Mike Fährmann
3fc2223893 merge #3935: [reddit] match 'preview.redd.it' URLs 2023-04-21 20:09:20 +02:00
Mike Fährmann
202f5d86a7 [reddit] ignore 'id-max' value "zik0zj"/2147483647 
(#3939, #3862, #3697, #3606, #3546, #3521, #3412)
 2023-04-21 15:08:50 +02:00
ClosedPort22
cd4bfb0dd1 [reddit] match 'preview.redd.it' URLs 2023-04-20 15:54:09 +08:00
Mike Fährmann
da9840a39d [reddit] update 'videos' option (#3712) 
- add 'dash' to directly extract DASH manifest URLs
  (was default behavior since a7c79531)
- change default strategy back to before a7c79531
- disable 'Falling back on generic information extractor' warning
 2023-03-06 12:18:25 +01:00
Mike Fährmann
2952add4a8 [reddit] increase 'id-max' default value (#3397) 
to float("inf")
 2022-12-12 12:10:06 +01:00
Steven Docherty
a7c7953107 [reddit] use 'dash_url' for videos (#3258) (#3306) 
* use fallback_url for reddit_video to fix issue 3258

* changed to dash_url to include audio

* update

- use [] instead of .get
- catch TypeErrors in case one of the elements is not a dict

Co-authored-by: InterruptSpeed <steven@docherty.ca>
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2022-11-27 14:09:55 +01:00
Mike Fährmann
35eddaa94e [reddit] prevent exception with empty submission URLs (#2913) 2022-09-14 16:14:42 +02:00
Mike Fährmann
d4e9d51760 [reddit] add 'home' extractor (#2614) 2022-05-26 15:28:33 +02:00
Ailothaen
203a04a4a3 [reddit] Support of standalone submissions on personal pages of users (#2301) 
* [reddit] Support of submissions on personal pages of users

* [reddit] Design improvement for user submissions

* [reddit] Removed functions declared twice
 2022-02-13 23:03:46 +01:00
Mike Fährmann
2d34d8ff8b [reddit] allow downloading from quarantined subreddits (#2180) 2022-01-14 21:55:59 +01:00
Mike Fährmann
1fac74b14d [reddit] prevent crash for galleries with no 'media_metadata' 
(fixes #2001)
 2021-11-03 17:55:40 +01:00
Mike Fährmann
e93360e45d [reddit] extend subcategory depending on input URL (closes #1836) 
- https://www.reddit.com/r/lavaporn/
  -> 'subreddit'

- https://www.reddit.com/r/lavaporn/new/
  -> 'subreddit-new'

- https://www.reddit.com/user/username/
  -> 'user'

- https://www.reddit.com/user/username/gilded/
  -> 'user-gilded'
 2021-09-10 20:44:17 +02:00
Mike Fährmann
8cd7759682 [reddit] cleanup ReddeitAPI.__init__ (#1813) 
- remove warning about 'client-id'/'user-agent' mismatch
- only use 'user-agent' from config for custom 'client-id'
 2021-08-31 17:08:02 +02:00
Mike Fährmann
0a94fe5774 [reddit] delay RedditAPI initialization (#1813) 
Move it outside the constructor so that eventual exceptions can get
caught in the expected places.
 2021-08-30 22:39:40 +02:00
Mike Fährmann
bd08ee2859 remove most 'yield Message.Version' statements 
only leave them in oauth.py as noop results
 2021-08-16 03:10:48 +02:00
Mike Fährmann
102c482f5e [reddit] skip invalid/failed gallery items (fixes #1127) 2020-11-21 17:34:38 +01:00
Mike Fährmann
968d3e8465 remove '&' from URL patterns 
'/?&#' -> '/?#' and '?&#' -> '?#'

According to https://www.ietf.org/rfc/rfc3986.txt, URLs are
"organized hierarchically" by using "the slash ("/"), question
mark ("?"), and number sign ("#") characters to delimit components"
 2020-10-22 23:31:25 +02:00
Mike Fährmann
76dfa11a65 [reddit] add 'date' metadata field (closes #1068) 2020-10-16 15:48:04 +02:00
Mike Fährmann
d4ff767291 [reddit] improve gallery extraction (fixes #955) 2020-08-23 22:06:06 +02:00
Mike Fährmann
a57b6b3c3a [reddit] handle deleted galleries (fixes #953) 2020-08-20 20:14:07 +02:00
Mike Fährmann
60ba3cb946 [reddit] support gallery posts (closes #920) 2020-08-03 22:06:15 +02:00
Mike Fährmann
5a6e750704 [reddit] fix AttributeError when using 'recursion' (fixes #879) 2020-07-09 19:19:05 +02:00
Mike Fährmann
94a08f0bcb [reddit] limit title length in default filenames (#873) 2020-07-09 18:19:33 +02:00
Mike Fährmann
be04e44e2c [reddit] catch JSON decode errors (#765) 2020-06-11 18:32:52 +02:00
Mike Fährmann
dfcf2a2c91 write OAuth token to cache by default (#616) 2020-05-25 22:35:45 +02:00
Mike Fährmann
0bf0146bfe [reddit] don't send OAuth headers for file downloads (fixes #729) 2020-05-08 21:42:52 +02:00
Mike Fährmann
d02f7c1118 improve Extractor.wait() 
- allow 'until' to be a datetime object
- do "time calculations" with UTC timestamps
- set a default 'reason'
 2020-04-05 21:23:05 +02:00
Mike Fährmann
dff33b260c [reddit] add 'videos' option 2020-01-31 23:45:02 +01:00
Mike Fährmann
d086f30b42 [reddit] restore archive keys for i.redd.it images 2020-01-29 22:12:55 +01:00
Mike Fährmann
56f1c96168 implement 'parent-directory' option (#551) 2020-01-29 18:32:37 +01:00
Mike Fährmann
ae07f92f7e [reddit] rewrite extractor logic (closes #551) 
Handle images and videos hosted on Reddit "natively",
allowing them to use reddit-specific metadata to build directory
and file names.
 2020-01-29 17:57:25 +01:00
Mike Fährmann
569747a78d implement extractor.wait() 2020-01-04 23:42:07 +01:00
Mike Fährmann
ce54b8c04c let extractors opt-out of cookie option usage 
useful to avoid sending unnecessary cookies when all authentication
is done through OAuth tokens
 2020-01-01 21:12:37 +01:00
Mike Fährmann
48e42e73fb [reddit] change default value for 'comments' to '0' 2019-12-20 16:54:59 +01:00
Mike Fährmann
9c0928457a [reddit] fix errors with 't1_…' submissions 2019-12-20 16:49:44 +01:00
Mike Fährmann
df2b3c6888 restore OAuth2 authentication error messages 2019-10-13 22:48:01 +02:00
Mike Fährmann
6d0a533d68 [reddit] respect 'comments:0' for single submissions (#429) 2019-09-27 23:11:28 +02:00
Mike Fährmann
46ba173ded [reddit] fix documentation inconsistencies (closes #429) 
- Require 'reddit.comments' to be a number and convert it to an
  integer to be extra sure
- Link to the README's OAuth section were appropriate
 2019-09-27 17:34:10 +02:00
Mike Fährmann
913460240d [reddit] fix 'extractor.blacklist()' arguments 
The second argument must support 'append()'.
 2019-09-24 23:01:12 +02:00
Mike Fährmann
946f2751e2 [reddit] add 'user' extractor (closes #350) 2019-09-22 22:18:17 +02:00
Mike Fährmann
c14abb9fb8 [reddit] improve URL parameter handling for subreddit links 2019-09-22 22:03:22 +02:00
Mike Fährmann
f4bc75e854 fix rate limit handling for OAuth APIs (#368) 2019-08-03 13:43:00 +02:00
Mike Fährmann
09f37fde39 [reddit] move date-min/-max handling into Extractor class 2019-07-16 22:54:39 +02:00