github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,357 Commits 1 Branch 0 Tags
36fc510d3acaf4b17e083bc9045f310b014fc790
Commit Graph

5357 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
36fc510d3a [docker] update workflow 
- run on every push to master
- build images from GitHub source instead of PyPI package
- build arm64 image (#5227)
- include more tags
  - build date as 'YYYYMMDD'
  - 'dev' for most recent build from master
  - 'latest' for most recent release build
 2024-03-05 03:15:20 +01:00
Mike Fährmann
96af12cec2 [docker] update Dockerfile 
- add LANG=C.UTF-8
  (better utf-8 support or so I heard)
- restructure RUN commands to be more easily extendable and have
  simpler git diffs
- swap 'apk' and 'pip' since 'apk' results are more likely to be stable
  and therefore cacheable
- disable Python bytecode caching with -B
  - reduces image size by 10Mb
  - bytecode for explicitly installed packages (gallery-dl, yt-dlp,
    dependencies) is still cached
- add some (hopefully) helpful command-line arguments to pip
 2024-03-05 03:14:33 +01:00
Mike Fährmann
461b55da4b [docs] deploy pages in both repositories 
mikf/galleryx-dl and gdl-org/docs
 2024-03-05 00:11:19 +01:00
Mike Fährmann
a767832332 [deviantart:avatar] ignore default avatars (#5276) 2024-03-04 23:11:30 +01:00
Mike Fährmann
0cbc910905 [deviantart:avatar] fix 'index' for avatars without '?' (#5276) 2024-03-04 22:31:35 +01:00
Mike Fährmann
40af26f68b [docs] link to documentation files in index.md 2024-03-03 22:50:09 +01:00
Mike Fährmann
a97e39d94a [docs] automatically trigger pages build on gdl-org/docs 2024-03-03 22:49:55 +01:00
Mike Fährmann
6482bbc525 [bluesky] handle different 'embed' structure 2024-03-03 20:41:01 +01:00
Mike Fährmann
1115dccd0d [bluesky] fix feeds and lists 
bug introduced in 495c9ee1
 2024-03-03 20:22:34 +01:00
Mike Fährmann
f3bc048ff7 allow workflows to be triggered manually 2024-03-03 18:10:55 +01:00
Mike Fährmann
1a9b9aa310 [artstation] support video clips (#2566, #3309, #3911) 
- add 'videos' and 'previews' options
- fix 403 errors for video previews
 2024-03-03 18:00:45 +01:00
Mike Fährmann
982880615d [deviantart] prevent unnecessary API requests (#4995) 
… when using 'comments-avatars'

This also has the added benefit of making it possible to download
comment avatars from users without a valid user profile entry,
like deleted users.
 2024-03-02 21:59:16 +01:00
Mike Fährmann
25d2854272 [deviantart] add 'comments-avatars' option (#4995) 2024-03-02 21:59:16 +01:00
Mike Fährmann
218ec1a9ee [instagram] raise proper error for missing 'reels_media' (#5257) 2024-03-02 21:58:59 +01:00
Mike Fährmann
82c73c77b0 [redgifs] make 'date' available for directories (#5262) 
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1973975415
 2024-03-01 23:39:16 +01:00
Mike Fährmann
cf9e99c07b [artstation] support collections (#146) 
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1972101003
 2024-03-01 20:21:21 +01:00
Mike Fährmann
32ec695195 merge #5256: [wikimedia] add azurlane.koumakan.jp 2024-02-29 21:50:24 +01:00
Mike Fährmann
5d9ec91896 [azurlanewiki] supportedsites + test 2024-02-29 21:49:13 +01:00
thatfuckingbird
88a06df165 [wikimedia] add azurlane.koumakan.jp to presets 2024-02-29 19:28:50 +01:00
Mike Fährmann
1db0a587f3 [nitter] ignore invalid Tweets (#5253) 
like "Load newest"
 2024-02-29 16:31:37 +01:00
Mike Fährmann
76581c13f7 handle URLs without '/' after their TLD (#5252) 2024-02-29 15:05:46 +01:00
Mike Fährmann
c006f9c949 [docs] add ability to specify more than one 'event' 
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1969407203
 2024-02-29 14:40:18 +01:00
Mike Fährmann
a00b171d4e [bluesky] wait unitl 'RateLimit-Reset' on 429 responses 2024-02-28 18:13:16 +01:00
Mike Fährmann
7d874e2497 [bluesky] improve API error messages 2024-02-28 14:45:36 +01:00
Mike Fährmann
d921d860f1 automatically create directory path for logging files (#5249) 2024-02-28 02:11:20 +01:00
Mike Fährmann
24106d9994 exclude scripts/pyprint.py from linting for Python<3.8 2024-02-27 19:07:52 +01:00
Mike Fährmann
495c9ee126 [bluesky] add 'reposts' option (#4438, #5248) 2024-02-27 18:42:29 +01:00
Mike Fährmann
c8b591303f [paheal] cleanup 2024-02-27 02:27:20 +01:00
Mike Fährmann
ba062712ad [tests] '__main__' -> "__main__" 2024-02-27 02:10:05 +01:00
Mike Fährmann
2501adeda0 move 'pprint()' into its own module 
to reuse its code in create_test_data.py later

rename to 'pyprint' since 'pprint' is already used by stdlib module
 2024-02-27 02:01:55 +01:00
Mike Fährmann
8a11b72253 remove extractor/test.py (#4504) 2024-02-27 01:37:57 +01:00
Mike Fährmann
fde9e25c9f [tests:kemonoparty] '.party' -> '.su' 2024-02-26 22:25:04 +01:00
Mike Fährmann
311a21bfb2 [bluesky] fix '/follows' not spawning child extractors (#5246) 2024-02-26 15:38:31 +01:00
Mike Fährmann
d3dca68225 [xvideos] fix galleries with more than 500 images (#5244) 2024-02-26 15:36:41 +01:00
Mike Fährmann
13443f40a3 [xvideos] support '/channels/' URLs (#5244) 2024-02-26 00:08:37 +01:00
Mike Fährmann
c60ebc6519 [deviantart] improve fetching extended metadata (#5175) 
use multiple metadata API calls per chunk of deviations if necessary
 2024-02-25 03:36:00 +01:00
Mike Fährmann
cc6b9e4c18 [zerochan] use API by default (#3669) 
add 'pagination' option
 2024-02-25 00:36:14 +01:00
Mike Fährmann
efccd3d3d1 merge #5097: update Dockerfile 
- remove a layer and reduce image size
- update pip and apk
 2024-02-24 02:06:35 +01:00
Mike Fährmann
a2b55d5dde [skeb] retry 429 responses containing a 'request_key' cookie (#5210) 2024-02-24 00:54:15 +01:00
Mike Fährmann
e51ee6b132 fix HttpError.status value 
'response' with error status code evaluates to False
 2024-02-24 00:04:24 +01:00
Mike Fährmann
b4c46de4b8 merge #5224: [artstation] update URL patterns to recognize usernames with dashes 2024-02-21 14:41:02 +01:00
blankie
962f55cc68 [artstation] fix handling usernames with dashes 2024-02-21 17:39:37 +11:00
Mike Fährmann
fe7e2281ac [nijie] increase default delay between requests (#5221) 
1-2s is not enough
 2024-02-20 18:19:49 +01:00
Mike Fährmann
a34312e3ac [instagram] make accessing 'like_count' non-fatal (#5218) 2024-02-19 19:24:51 +01:00
Mike Fährmann
741fd00cec [deviantart] extend 'metadata' option (#5175) 
alloe fetching extended metadata in addition to the usual
'description', 'tags', etc by setting 'metadata' to a list of
'camera', 'stats', 'submission', 'collection', and 'gallery'

for example "metadata": "stats,submission"
 2024-02-18 23:14:14 +01:00
Mike Fährmann
fc46177578 release version 1.26.8 2024-02-17 21:03:19 +01:00
Mike Fährmann
8a63801311 [vsco] add 'spaces' extractor (#5202) 
for spaces listed on a user page
 2024-02-17 18:20:48 +01:00
Mike Fährmann
ccb413df71 [wikimedia] support 'pidgi.net' and 'bulbapedia.bulbagarden.net' (#5205, #5206) 2024-02-17 17:35:10 +01:00
Mike Fährmann
7033cc14e9 [vsco] add 'space' extractor (#5202) 2024-02-17 01:54:05 +01:00
Mike Fährmann
770aec922d [fapachi] ignore empty entries 2024-02-16 22:43:37 +01:00