* [iwara] Add initial support
* [iwara] Add search support
* [iwara] Code cleanup
* [iwara] Small fixes and additions
* [iwara] Add tag support
* [iwara] Add mime-type to metadata
* [iwara] Refactor patterns/matching using urllib
* [iwara] Add unit tests
* [iwara] Update docs
* [iwara] Fix linting on older Python versions
* [iwara] update 'IwaraAPI' interface class
- define endpoints inside methods
- implement and use _call() and _pagination()
- cache auth tokens
* [iwara] split and rename 'profile' extractor
TODO:
- update test results
- simplify code
* [iwara] simplify '_user_params()' usage
* [iwara] update 'video' extractor
and move user data extraction into 'yield_video'
* [iwara] update 'image' extractor
and move user info extraction into 'yield_image()'
* [iwara] update 'playlist' extractor
* [iwara] update 'search' extractor
* [iwara] update 'tag' extractor
* [iwara] simplify 'yield_image' usage
perform API calls to get full 'files' list inside the function
* [iwara] add video "image" test
* [iwara] provide 'date' metadata
* [iwara] simplify 'source()'
remove urllib.parse usage
* [iwara] small optimizations
* get("key", {}) -> get("key") or {}
* split("…", 1) -> partition("…")
* use f-strings for all patterns
* [iwara] add missing 'keyarg=1' to profile() memcache decorator
* [tests/iwara] update results
* [iwara] extract more 'user' metadata
* [iwara] update default format strings
include 'date' in filenames to order them chronologically
* [iwara] restructure image/video handling
- use less generators
- make processing individual media items non-fatal
* [iwara] fix login and token handling
* [iwara] add 'favorite' extractor
* [iwara] add 'following' and 'followers' extractors
---------
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
- init.py:
- generate initial extractor module code and test result file
- insert new entries into modules list and site names
- generate_test_result.py:
- generate test result for a given URL
- insert it into the test result file generated by init.py
(or an already existing one)
category changes:
- kemonoparty -> kemono
- coomerparty -> coomer
- koharu -> schalenetwork
also wanted to rename '2chan' -> 'sturdychan',
but the site's main page is still titled '2chen'
* Add TikTok photo support
#3061#4177
* Address linting errors
* Fix more test failures
* Forgot to update category names in tests
* Looking into re issue
* Follow default yt-dlp output template
* Fix format string error on 3.5
* Support downloading videos and audio
Respond to comments
Improve archiving and file naming
* Forgot to update supportedsites.md
* Support user profiles
* Fix indentation
* Prevent matching with more than one TikTok extractor
* Fix TikTok regex
* Support TikTok profile avatars
* Fix supportedsites.md
* TikTok: Ignore no formats error
In my limited experience, this doesn't mean that gallery-dl can't download the photo post (but this could mean that you can't download the audio)
* Fix error reporting message
* TikTok: Support more URL formats
vt.tiktok.com
www.tiktok.com/t/
* TikTok: Only download avatar when extracting user profile
* TikTok: Document profile avatar limitation
* TikTok: Add support for www.tiktokv.com/share links
* Address Share -> Sharepost issue
* TikTok: Export post's creation date in JSON (ISO 8601)
* [tiktok] update
* [tiktok] update 'vmpost' handling
just perform a HEAD request and handle its response
* [tiktok] build URLs from post IDs
instead of reusing unchanged input URLs
* [tiktok] combine 'post' and 'sharepost' extractors
* [tiktok] update default filenames
put 'id' and 'num' first to ensure better file order
* [tiktok] improve ytdl usage
- speed up extraction by passing '"extract_flat": True'
- pass more user options and cookies
- pre-define 'TikTokUser' extractor usage
* [tiktok] Add _COOKIES entry to AUTH_MAP
* [tiktok] Always download user avatars
* [tiktok] Add more documentation to supportedsites.md
* [tiktok] Address review comments
---------
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
* first commit
* add --
* skip video embeds
* fix typo
* removed ambiguity
* add category support
* code tweaks
* more reliable embed extraction
* handle 403 errors (testing done)
* added "parent_id" keyword
* added "parent", "parent_type" keywords
the extractor should be now ready to merge!
* removed unnecessary dict unpacking
* added empty text messages extraction
* added "channel_topic"
* even more metadata extraction
can now extract all embeds images & text, as well as server banners. also code is much better.
* added user avatar and banner
* better pagination
* fix regression
* minor tweaks
* Made requested changes
and rename the former Python 3.8 version to 'gallery-dl_x86.exe'.
Currently building with PyInstaller, as I wasn't able to get py2exe to
work in this environment, but the startup times are noticeably longer.
Considering switching to nuitka, maybe even for all standalone builds.