69 Commits

Author SHA1 Message Date
Mike Fährmann
53cdfaac37 [common] add reference to 'exception' module to Extractor class
- remove 'exception' imports
- replace with 'self.exc'
2026-02-15 10:57:22 +01:00
Mike Fährmann
690b3ba200 [civitai:user-posts] fix pagination (#8955)
fix '400 Bad Request' errors when retrieving
more than the first batch of posts.
2026-01-29 18:53:08 +01:00
Mike Fährmann
239de3f092 [civitai] update 'quality-videos' default (#8787)
from "quality=100" to "original=true,quality=100"
to prevent a server timeout / error
2025-12-31 09:56:39 +01:00
Mike Fährmann
00c6821a3f replace 2-element f-strings with simple '+' concatenations
Python's 'ast' module and its 'NodeVisitor' class
were incredibly helpful in identifying these
2025-12-22 11:26:04 +01:00
Mike Fährmann
e006d26c8e Revert "use f-strings when building 'pattern'"
revert d7c97d5a97.
2025-12-20 22:07:37 +01:00
Mike Fährmann
968597a302 yield 3-tuples for Message.Directory
adapt tuples to the same length and semantics as other messages
2025-12-05 21:39:52 +01:00
Mike Fährmann
9bf52ab8c5 [civitai] implement extracting 'tags' metadata (#8626) 2025-11-29 18:37:57 +01:00
Mike Fährmann
d7c97d5a97 use f-strings when building 'pattern' 2025-10-20 21:23:11 +02:00
Mike Fährmann
c8fc790028 merge branch 'dt': move datetime utils into separate module
- use 'datetime.fromisoformat()' when possible (#7671)
- return a datetime-compatible object for invalid datetimes
  (instead of a 'str' value)
2025-10-20 09:30:05 +02:00
Mike Fährmann
c38856bd3f [dt] use 'parse_datetime_iso()' for ISO formats 2025-10-19 21:52:05 +02:00
Mike Fährmann
555ac2dcfa [civitai] add 'sort' & 'period' options (#8426) 2025-10-17 20:29:10 +02:00
Mike Fährmann
085616e0a8 [dt] replace 'text.parse_datetime()' & 'text.parse_timestamp()' 2025-10-17 17:43:06 +02:00
Mike Fährmann
8c62be343e [output] add 'Logger.traceback()' helper 2025-10-14 18:44:29 +02:00
Mike Fährmann
3a35a4aee4 [civitai] prevent downloading random posts from deleted users (#8299) 2025-10-11 09:09:48 +02:00
Mike Fährmann
a41e3c90f4 [civitai:search] add 'token' option (#8093) 2025-08-22 17:21:00 +02:00
Mike Fährmann
e599e3f0d6 [civitai] add 'videos' extractor (#6644) 2025-08-16 11:08:37 +02:00
Mike Fährmann
c2b11dd475 [civitai] do not restrict file types by default (#8053) 2025-08-16 10:17:51 +02:00
Mike Fährmann
d1a9fec2a8 [civitai] fix '403 Forbidden' errors for searches 2025-08-16 09:44:07 +02:00
Mike Fährmann
e92538624e [civitai] add 'user-collections' extractor (#8005) 2025-08-10 21:33:23 +02:00
Mike Fährmann
2b03843092 [civitai] add 'collection' extractor (#8005) 2025-08-10 21:33:23 +02:00
Mike Fährmann
8ada5b8eb6 [exception] improve AuthRequired messages 2025-08-08 16:01:19 +02:00
Mike Fährmann
2c85f4a32d [civitai] change default includes to 'user-images,user-videos' (#7874)
less metadata by default, but grabs *all* user files
2025-07-24 18:10:45 +02:00
Mike Fährmann
a097a373a9 simplify if statements by using walrus operators (#7671) 2025-07-22 20:57:54 +02:00
Mike Fährmann
f0de034889 [exception] rename 'LoginRequired' to 'AuthRequired' 2025-07-22 20:57:54 +02:00
Mike Fährmann
e0599d35dc [civitai] fix 'AttributeError' when a file's post was deleted (#7860) 2025-07-20 20:02:09 +02:00
Mike Fährmann
923e27f4fd [civitai] fix 'extension' for videos without 'name' and 'mimeType'
use _video_ext instead of _image_ext
2025-07-19 18:30:29 +02:00
Mike Fährmann
0a245e8d80 [civitai] improve '_extract_version_id()'
also check for 'modelVersionIdsManual'
2025-07-19 18:30:29 +02:00
Mike Fährmann
272df323f3 [civitai] ensure 'file' & 'post' data has a 'date' value (#7548)
https://github.com/mikf/gallery-dl/issues/7548#issuecomment-3091492518
2025-07-19 18:30:29 +02:00
Mike Fährmann
0b991148a1 [civitai] rename 'generate' to 'generated' (#7796) 2025-07-19 18:30:29 +02:00
Mike Fährmann
67a4472bc2 [civitai] add 'generate' extractor (#7796) 2025-07-18 18:34:17 +02:00
Mike Fährmann
ad84e72fda [civitai] implement retrieving 'post' metadata (#7548) 2025-07-07 11:48:21 +02:00
Mike Fährmann
d25b1f22f3 [civitai] always provide 'file[…]' metadata (#7548)
wrap most top-level values of (single) image results into a 'file' object
2025-07-07 11:45:49 +02:00
Mike Fährmann
8452a018ac [civitai] fix '403 Forbidden' errors for searches
update Authorization header
2025-07-07 10:20:19 +02:00
Mike Fährmann
f2a72d8d1e replace 'request(…).json()' with 'request_json(…)' 2025-06-29 17:50:19 +02:00
Mike Fährmann
9dbe33b6de replace old %-formatted and .format(…) strings with f-strings (#7671)
mostly using flynt
https://github.com/ikamensh/flynt
2025-06-29 17:50:19 +02:00
Mike Fährmann
e08ec7e083 update copyright notices 2025-06-13 00:03:41 +02:00
Mike Fährmann
8eb707e9b7 [civitai] use tuples instead of lists for API parameter constants 2025-06-04 07:45:21 +02:00
Mike Fährmann
9ed31cf992 [civitai] fix & update 'search' extractor (#7609)
- rename to 'search-models'
- use SearchAPI
2025-06-01 10:30:09 +02:00
Mike Fährmann
dc467c7790 [civitai] add 'search-images' extractor (#7609) 2025-06-01 10:06:18 +02:00
Mike Fährmann
55f26a558a [civitai] implement 'CivitaiSearchAPI' class (#7609) 2025-06-01 09:56:10 +02:00
Mike Fährmann
02b34e6680 [civitai] support "My Reactions" results for videos (#7608) 2025-05-31 21:30:39 +02:00
Mike Fährmann
f6f31af660 [civitai] add 'posts' extractor (#7609) 2025-05-31 19:20:39 +02:00
Mike Fährmann
e199396872 [common] simplify 'user' extractors by using 'Dispatch' mixin 2025-05-24 18:04:53 +02:00
Mike Fährmann
b9f077a1c5 [civitai] make metadata extraction non-fatal (#7562) 2025-05-22 19:18:53 +02:00
Mike Fährmann
a6de87d00e [civitai] fix exception for images without modelVersionId (#7432) 2025-05-17 20:17:57 +02:00
Mike Fährmann
f343c8c0b6 [civitai] fix/improve video downloads (#7502)
- add 'quality-videos' option
- fix downloading static .webp files instead of video
2025-05-10 16:13:48 +02:00
Mike Fährmann
3799369248 [civitai] provide proper 'extension' for model files (#7432) 2025-05-04 17:34:06 +02:00
Mike Fährmann
6746e38670 [civitai] fix typo 2025-05-03 21:15:26 +02:00
Mike Fährmann
7a67348fc2 [civitai] implement retrieving 'version' metadata (#7432) 2025-05-03 20:39:35 +02:00
Mike Fährmann
518865c7de [civitai] fix/improve query parameter handling (#7138) 2025-03-10 20:18:57 +01:00