Commit Graph

70 Commits

Author SHA1 Message Date
Mike Fährmann
085616e0a8 [dt] replace 'text.parse_datetime()' & 'text.parse_timestamp()' 2025-10-17 17:43:06 +02:00
Mike Fährmann
af0b68d533 [weibo:feed] send 'page' parameter only when passing cookies (#8357) 2025-10-09 11:22:04 +02:00
Mike Fährmann
de5fe0eea3 [weibo] overhaul cookie initialization (#8357)
detect user-provided 'SUB' & 'SUBP' cookies
2025-10-09 11:18:44 +02:00
Mike Fährmann
d67bc12ea0 [weibo] ignore ongoing live streams (#8339)
https://github.com/mikf/gallery-dl/issues/8339#issuecomment-3368824472
2025-10-06 15:30:31 +02:00
Mike Fährmann
9f7aa0d467 [weibo] use 'page' parameter for 'feed' results (#7523 #8128 #8357) 2025-10-06 08:00:26 +02:00
Mike Fährmann
96c0e9e5c8 [weibo] use f-strings 2025-10-06 07:49:27 +02:00
Mike Fährmann
7990d04fcc [weibo] load user cookies after sina_visitor_system() cookies
allow user cookies to overwrite sina cookies
and not the other way round

(#6447 #7939 #8063 #8354)
2025-10-05 22:11:52 +02:00
Mike Fährmann
7b338edf63 [weibo] resolve 'wblive-out.api.weibo.com' URLs (#8339) 2025-10-03 17:21:31 +02:00
Mike Fährmann
faeec7e67f [weibo] try 'replay_hd' URLs as video fallback (#8339) 2025-10-03 11:19:14 +02:00
Mike Fährmann
008a871ccb [weibo] download 'm3u8' manifests with ytdl (#8339) 2025-10-03 11:18:52 +02:00
Mike Fährmann
a097a373a9 simplify if statements by using walrus operators (#7671) 2025-07-22 20:57:54 +02:00
Mike Fährmann
d8ef1d693f rename 'StopExtraction' to 'AbortExtraction'
for cases where StopExtraction was used to report errors
2025-07-09 21:07:28 +02:00
Mike Fährmann
3810555bbd do not use 'append = list.append' 2025-06-30 11:42:44 +02:00
Mike Fährmann
f2a72d8d1e replace 'request(…).json()' with 'request_json(…)' 2025-06-29 17:50:19 +02:00
Mike Fährmann
9dbe33b6de replace old %-formatted and .format(…) strings with f-strings (#7671)
mostly using flynt
https://github.com/ikamensh/flynt
2025-06-29 17:50:19 +02:00
Mike Fährmann
e08ec7e083 update copyright notices 2025-06-13 00:03:41 +02:00
Mike Fährmann
e199396872 [common] simplify 'user' extractors by using 'Dispatch' mixin 2025-05-24 18:04:53 +02:00
Mike Fährmann
51f978e027 [weibo] add 'movies' option (#6988)
disable 'movie' downloads by default
2025-02-13 18:01:20 +01:00
Mike Fährmann
f7246f025f [weibo] simplify 'livephoto' extraction (#6471)
continuation of 396b52aef7

fixes wrong 'filename' and 'extension' values
when 'ssig' query parameter contains "%2F"
2024-11-16 08:19:02 +01:00
Mike Fährmann
396b52aef7 [weibo] fix livephoto 'filename' & 'extension' (#6471) 2024-11-14 18:56:18 +01:00
Mike Fährmann
7916c8bf77 allow passing cookies to OAuth extractors
partially revert ce54b8c04c
2024-11-09 18:06:27 +01:00
Mike Fährmann
5158cbb4c1 [weibo] rework pagination logic (#4168)
don't automatically stop when receiving an empty status list

shouldn't improve 'tabtype=feed' results, but at least 'tabtype=album'
ones and others using cursors won't end prematurely
2024-03-14 00:06:25 +01:00
Mike Fährmann
ace16f00f5 [weibo] fix retweets (#2825, #3874, #5263)
- handle 快转 retweets
- disable 'retweets' by default
- skip all retweet media when 'retweets' are disabled
- extract all retweet media when 'retweets' is set to "original"
2024-03-06 19:36:53 +01:00
Mike Fährmann
0676a9d6ec [weibo] fix 'livephoto' filename extensions (#5287) 2024-03-06 19:36:32 +01:00
Mike Fährmann
c83d0a1596 [weibo] add 'gifs' option (#5183) 2024-02-10 18:17:07 +01:00
Mike Fährmann
b4bcf40278 [weibo] fix AttributeError in 'user' extractor (#5022)
yet another bug caused by a383eca7
2024-01-05 17:18:33 +01:00
Mike Fährmann
e8b5e59a08 [weibo] detect redirects to login page (#4773) 2023-11-10 19:35:29 +01:00
Mike Fährmann
56cd9d408d [weibo] fix Sina Visitor request 2023-10-30 22:14:52 +01:00
Mike Fährmann
3ecb512722 send Referer headers by default 2023-09-19 00:02:04 +02:00
Mike Fährmann
a453335a9f remove test results in extractor modules
and add generic example URLs
2023-09-11 16:30:55 +02:00
Mike Fährmann
a383eca7f6 decouple extractor initialization
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().

This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
2023-07-25 22:16:16 +02:00
Mike Fährmann
d97b8c2fba consistent cookie-related names
- rename every cookie variable or method to 'cookies_*'
- simplify '.session.cookies' to just '.cookies'
- more consistent 'login()' structure
2023-07-22 01:20:50 +02:00
Mike Fährmann
1d4db83d49 [weibo] fix end of cursor based pagination 2023-07-04 17:41:22 +02:00
Mike Fährmann
654267a335 [weibo] fix 'json' extension for some videos 2023-06-15 13:49:17 +02:00
Mike Fährmann
0a9aaa7a8d [weibo] prevent fatal exception due to missing video (#4150) 2023-06-08 22:22:43 +02:00
Mike Fährmann
6b6bb4be73 [weibo] require numeric IDs to have length >= 10 (#4059) 2023-05-14 18:45:37 +02:00
Mike Fährmann
72f1f16eb2 [weibo] support 'mix_media_info' entries (#3793) 2023-03-18 15:19:25 +01:00
Mike Fährmann
dd884b02ee replace json.loads with direct calls to JSONDecoder.decode 2023-02-09 15:22:00 +01:00
Mike Fährmann
7e277d0f7d [weibo] add 'count' metadata field (#3305)
or '{status[count]}', as most metadata for weibo is inside 'status'
2022-11-30 11:36:46 +01:00
Mike Fährmann
c25905641e [weibo] fix bug with empty 'playback_list' (#3301) 2022-11-26 12:00:17 +01:00
Mike Fährmann
e3abab8629 [weibo] send 'Referer' headers (#3188) 2022-11-10 17:11:57 +01:00
Mike Fährmann
b0cb4a1b9c replace 'text.extract()' with 'text.extr()' where possible 2022-11-05 01:14:09 +01:00
Mike Fährmann
1c89ccb27d [weibo] prevent errors when paginating over album entries (#2817) 2022-08-11 12:22:14 +02:00
Mike Fährmann
0f5826e884 [weibo] prevent exception for missing 'playback_list' (#2792) 2022-07-30 16:49:08 +02:00
Mike Fährmann
c6a9bab019 update extractor test results 2022-07-12 15:49:22 +02:00
Mike Fährmann
539e3bbed9 [weibo] handle invalid/broken status objects 2022-07-12 15:49:09 +02:00
Mike Fährmann
6db77d4656 [weibo] support '?tabtype=video' listings (#2601) 2022-06-12 17:55:23 +02:00
Mike Fährmann
45c980daf0 [weibo] fix retweets (#2601) 2022-06-11 15:30:26 +02:00
Mike Fährmann
61cbf8318c [weibo] fix URLs generated by 'user' extractor (#2601) 2022-06-05 21:37:57 +02:00
Mike Fährmann
e59bcb8437 [weibo] ensure media URLs use https:// 2022-06-03 17:37:57 +02:00