Commit Graph

415 Commits

Author SHA1 Message Date
Mike Fährmann
614e1a514a [twitter] implement 'metadata-user' option (#8984) 2026-02-03 20:14:34 +01:00
Mike Fährmann
153e589dd0 [twitter] implement '"search-pagination": "date"' 2026-02-02 16:19:48 +01:00
Mike Fährmann
a95cf92d61 [twitter] add & use '_tweetid_to_datetime' method
use 'dt' functions directly
2026-02-02 16:11:59 +01:00
Mike Fährmann
7692d31a57 [twitter] move transaction_id.py 2026-02-01 18:48:30 +01:00
Mike Fährmann
e93cfa3348 [twitter] implement '"ratelimit": "abort:N"' (#5251 #8864) 2026-01-23 19:54:28 +01:00
Mike Fährmann
8e855bd810 replace '// 1000' with '/ 1000' for timestamp conversions
regular division is slightly faster than floor division
and a float timestamp value is treated the same as an integer one
2026-01-04 16:51:31 +01:00
Mike Fährmann
daf6cc2c78 [twitter] add 'notifications' extractor (#7974) 2025-12-26 18:06:00 +01:00
Mike Fährmann
00c6821a3f replace 2-element f-strings with simple '+' concatenations
Python's 'ast' module and its 'NodeVisitor' class
were incredibly helpful in identifying these
2025-12-22 11:26:04 +01:00
Mike Fährmann
d0f06be0d2 use 'operator +' when building 'pattern' 2025-12-20 22:07:44 +01:00
Mike Fährmann
e006d26c8e Revert "use f-strings when building 'pattern'"
revert d7c97d5a97.
2025-12-20 22:07:37 +01:00
Mike Fährmann
85b7f63971 [twitter] fix avatar & background downloads with "expand": true (#8698) 2025-12-14 09:07:04 +01:00
Mike Fährmann
7516537630 [twitter] implement workarounds for empty 'core' data (#8613)
https://github.com/mikf/gallery-dl/issues/8613#issuecomment-3626389269
2025-12-08 22:34:32 +01:00
Mike Fährmann
a35e20077d [twitter] fix "UnboundLocalError: 'last_tweet'" (#8613)
https://github.com/mikf/gallery-dl/issues/8613#issuecomment-3628782844
2025-12-08 21:18:07 +01:00
Mike Fährmann
ef9c472f94 [twitter] always use '3' as 'search-stop' default (#8613)
https://github.com/mikf/gallery-dl/issues/8613#issuecomment-3626474518
2025-12-08 20:46:59 +01:00
Mike Fährmann
968597a302 yield 3-tuples for Message.Directory
adapt tuples to the same length and semantics as other messages
2025-12-05 21:39:52 +01:00
Mike Fährmann
80878c1501 [twitter] support '"search-results": "media"' results (#8613 #8635)
https://github.com/mikf/gallery-dl/issues/8635#issuecomment-3615267040
2025-12-05 17:49:39 +01:00
Mike Fährmann
b2e377b650 [twitter] fix TypeError when '_user_obj' is None (#8648)
fixes regression introduced in 406a74cfaa
2025-12-04 18:51:11 +01:00
Mike Fährmann
c6b2041c43 [twitter] fix 'AttributeError' for "search-pagination": "max_id" (#8613)
when using it with the regular 'Search' extractor

https://github.com/mikf/gallery-dl/issues/8613#issuecomment-3603946848
2025-12-02 22:37:57 +01:00
Mike Fährmann
d15b3d4eae [twitter] add 'limit' option (#8173)
- reduce default number of requested items to 50
- allow using "fallback" values like with 'search-limit'

https://github.com/mikf/gallery-dl/issues/8173#issuecomment-3303015837
2025-12-02 22:34:53 +01:00
Mike Fährmann
0ebb74dfeb [twitter] implement using multiple values for 'search-limit' (#8173)
https://github.com/mikf/gallery-dl/issues/8173#issuecomment-3302713173
2025-12-02 19:51:59 +01:00
Mike Fährmann
406a74cfaa [twitter] update/fix 'pinned' Tweet extraction (#8500)
- handle pins from 'pinned_tweet_ids_str'
- provide 'pinned' metadata
2025-12-02 11:44:04 +01:00
Mike Fährmann
5f38d8ab25 [twitter] increase 'retries-api' default to '9' (#8317) 2025-11-30 16:52:26 +01:00
Mike Fährmann
bb16e036e4 [twitter] reset 'api_tries' after successful API call (#8317) 2025-11-28 16:48:59 +01:00
Mike Fährmann
acf281a46a [twitter] implement 'retries-api' option (#8317)
retry API requests when encountering server-related errors
2025-11-27 19:23:27 +01:00
Mike Fährmann
b3aefd4a99 [twitter] restore better user NotFoundError messages (#8621)
fixes regression introduced in 5747dbf00c
2025-11-27 11:39:32 +01:00
Mike Fährmann
36fa543715 [twitter] add 'search-results' option (#8613) 2025-11-27 11:31:07 +01:00
Mike Fährmann
d7c97d5a97 use f-strings when building 'pattern' 2025-10-20 21:23:11 +02:00
Mike Fährmann
9bf76c1352 replace 'util.re()' with 'text.re()'
remove unnecessary 'util' imports
2025-10-20 17:44:58 +02:00
Mike Fährmann
c8fc790028 merge branch 'dt': move datetime utils into separate module
- use 'datetime.fromisoformat()' when possible (#7671)
- return a datetime-compatible object for invalid datetimes
  (instead of a 'str' value)
2025-10-20 09:30:05 +02:00
Mike Fährmann
238d0973f7 [twitter] fix "KeyError - 'source_id'" with disabled 'transform' (#8429) 2025-10-18 19:39:24 +02:00
Mike Fährmann
085616e0a8 [dt] replace 'text.parse_datetime()' & 'text.parse_timestamp()' 2025-10-17 17:43:06 +02:00
Mike Fährmann
e42030a3a6 [twitter] fix 'KeyError' for "temporarily unavailable" users (#8423) 2025-10-16 15:50:48 +02:00
Mike Fährmann
8c62be343e [output] add 'Logger.traceback()' helper 2025-10-14 18:44:29 +02:00
Mike Fährmann
c1d21e8cb9 [twitter] remove login support (#4202 #6029 #6040 #8362)
broken feature
2025-10-07 08:32:40 +02:00
24xyz
92be341711 [twitter] fix 'quote_id' of individual Tweets (#8284)
Fix 'quoted_by_id_str' to use parent tweet id
2025-09-24 19:50:12 +02:00
Mike Fährmann
5aa2124736 [twitter] fix all quoted Tweets being marked as 'deleted' (#8225)
due to "KeyError: 'screen_name'"
when trying to access the author's name

fixes regression introduced in 5747dbf00c
2025-09-16 10:08:32 +02:00
Mike Fährmann
05128ccf49 [twitter] add 'search-limit' option (#8173)
reduce default limit from 100 to 20
2025-09-13 10:30:58 +02:00
Mike Fährmann
f6fcba4040 [twitter] add 'search-stop' option (#8173)
and rename 'pagination-search' to 'search-pagination'
2025-09-09 10:14:43 +02:00
Mike Fährmann
d182749f45 [twitter] implement 'pagination-search' option (#8173) 2025-09-07 21:03:29 +02:00
Mike Fährmann
f94eedbe1d [twitter] continue searches on empty response (#8173)
stop when receiving more than 3 empty responses in a row
2025-09-07 17:42:56 +02:00
Mike Fährmann
52c932add6 [twitter] prevent "KeyError: 'name'" in '_transform_user()' (#8154)
fixes regression introduced in 5747dbf00c
2025-09-01 20:52:05 +02:00
Mike Fährmann
8650a6bf39 [twitter] fix "KeyError: 'core'" when processing communities (#8141)
fixes regression introduced in 8252980264
2025-08-29 19:42:37 +02:00
Mike Fährmann
d251996d8e [twitter] prevent exceptions in '_transform_community()' (#8134)
fixes regression introduced in 8252980264
2025-08-28 11:24:45 +02:00
Mike Fährmann
9bfde2f535 [twitter] simplify URL patterns with USER_PATTERN 2025-08-22 19:41:16 +02:00
Mike Fährmann
ff94f1dec5 [twitter:avatar] fix "KeyError: 'profile_image_url_https'" (#8087)
fixes regression introduced in 5747dbf00c
2025-08-21 05:58:33 +02:00
Mike Fährmann
a8b334e866 [twitter] add 'home' extractor (#7974) 2025-08-19 23:03:24 +02:00
Mike Fährmann
47150f3e8a [twitter] add 'highlights' extractor (#7826) 2025-08-19 09:14:39 +02:00
Mike Fährmann
8252980264 [twitter] extract 'community' metadata (#7424)
update default download directories and archive IDs
for community extractors
2025-08-19 08:56:04 +02:00
Mike Fährmann
5747dbf00c [twitter] update API endpoint query hashes & parameters 2025-08-18 21:50:10 +02:00
Mike Fährmann
c1abcb99de [twitter] handle "KeyError: 'result'" for retweets (#8072) 2025-08-18 10:18:03 +02:00