github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,891 Commits 1 Branch 0 Tags
master
Commit Graph

49 Commits

Author SHA1 Message Date
Mike Fährmann
53cdfaac37 [common] add reference to 'exception' module to Extractor class 
- remove 'exception' imports
- replace with 'self.exc'
 2026-02-15 10:57:22 +01:00
Mike Fährmann
12f5e24ab5 use sets for ' in { ... }' checks 2026-02-11 22:55:01 +01:00
Mike Fährmann
7e513f35f2 [wikimedia] use 'gallery-dl/<version>' User-Agent (#8770 #8861) 2026-01-10 18:08:13 +01:00
Mike Fährmann
00c6821a3f replace 2-element f-strings with simple '+' concatenations 
Python's 'ast' module and its 'NodeVisitor' class
were incredibly helpful in identifying these
 2025-12-22 11:26:04 +01:00
Mike Fährmann
e006d26c8e Revert "use f-strings when building 'pattern'" 
revert d7c97d5a97.
 2025-12-20 22:07:37 +01:00
Mike Fährmann
968597a302 yield 3-tuples for Message.Directory 
adapt tuples to the same length and semantics as other messages
 2025-12-05 21:39:52 +01:00
Mike Fährmann
68909724e7 [wikimedia] restrict default 'format' to fandom/wikigg (#5512) 
eefd8f9c00 (commitcomment-168635597)
 2025-10-23 20:56:34 +02:00
Mike Fährmann
5e1862871e [wikimedia] provide 'lang' metadata (#7283) 2025-10-23 20:42:45 +02:00
Mike Fährmann
da4b8c1e83 [wikimedia] fix 'limit' config lookup 
rework config handling in general
 2025-10-23 20:16:46 +02:00
Mike Fährmann
98d3354575 [wikimedia] implement config lookup for fandom/wikigg sites (#7283) 
{
    "extractor": {
        "fandom": {
            "filename": "..."
        }
    }
}
 2025-10-23 20:14:56 +02:00
Mike Fährmann
eefd8f9c00 [wikimedia] add 'format=original' to file URLs (#5512) 
add 'format' option
 2025-10-22 20:16:21 +02:00
Mike Fährmann
d7c97d5a97 use f-strings when building 'pattern' 2025-10-20 21:23:11 +02:00
Mike Fährmann
c38856bd3f [dt] use 'parse_datetime_iso()' for ISO formats 2025-10-19 21:52:05 +02:00
Mike Fährmann
085616e0a8 [dt] replace 'text.parse_datetime()' & 'text.parse_timestamp()' 2025-10-17 17:43:06 +02:00
Mike Fährmann
65feed5b64 [wikimedia] ignore missing files (#8388) 
Co-authored-by: ClosedPort22 <44864697+ClosedPort22@users.noreply.github.com>
 2025-10-12 09:37:15 +02:00
ClosedPort22
5e33f9981f [wikimedia] fix name of files without extension 2025-10-04 15:41:55 +08:00
Mike Fährmann
a005dbbac0 [wikimedia] update 
- add entry to docs/gallery-dl.conf
- extend test results
- reword argument name
 2025-10-03 10:17:40 +02:00
ClosedPort22
47857b447b [wikimedia] add ability to change directory before downloading revisions 2025-10-02 21:45:58 +08:00
ClosedPort22
55742c6a2c [wikimedia] add ability to fetch image revisions 
as long as the number of revisions of a single image does not exceed 500
 2025-10-02 21:45:43 +08:00
Mike Fährmann
206d3954f5 [wikimedia:wiki] fix "AttributeError: 'subcategories'" (#7931) 2025-07-30 08:13:33 +02:00
Mike Fährmann
64d6e8c8ff [azurelanewiki] prevent Anubis challenge 2025-07-17 16:37:30 +02:00
Mike Fährmann
87cf635f6e [wikimedia] add missing 'self' argument when calling 'prepare()' (#7835) 
fixes regression introduced in 811b665e33
 2025-07-17 16:30:36 +02:00
Mike Fährmann
d8ef1d693f rename 'StopExtraction' to 'AbortExtraction' 
for cases where StopExtraction was used to report errors
 2025-07-09 21:07:28 +02:00
Mike Fährmann
f2a72d8d1e replace 'request(…).json()' with 'request_json(…)' 2025-06-29 17:50:19 +02:00
Mike Fährmann
9dbe33b6de replace old %-formatted and .format(…) strings with f-strings (#7671) 
mostly using flynt
https://github.com/ikamensh/flynt
 2025-06-29 17:50:19 +02:00
Mike Fährmann
e08ec7e083 update copyright notices 2025-06-13 00:03:41 +02:00
Mike Fährmann
811b665e33 remove @staticmethod decorators 
There might have been a time when calling a static method was faster
than a regular method, but that is no longer the case. According to
micro-benchmarks, it is 70% slower in CPython 3.13 and it also makes
executing the code of a class definition slower.
 2025-06-12 22:50:52 +02:00
Mike Fährmann
cd1ddb0a67 [wikimedia] add 'subcategories' option (#2340) 
https://github.com/mikf/gallery-dl/pull/2340#issuecomment-2707177295
 2025-03-12 22:05:44 +01:00
Mike Fährmann
8f0b0b0735 [wikimedia] fix non-English Fandom/wiki.gg articles (#6370) 2024-10-24 13:00:02 +02:00
Mike Fährmann
4b04ccb3a1 [wikimedia] probe possible API endpoints when none is defined 
instead of hardcoding it to '/api.php'
 2024-09-07 20:11:44 +02:00
ClosedPort22
968c04a27c [wikimedia] raise default value for 'limit' from 10 to 50 2024-08-18 16:33:13 +08:00
ClosedPort22
5704024662 [wikimedia] improve handling of warnings and errors 2024-08-18 16:31:49 +08:00
ClosedPort22
33fe1b68b7 [wikimedia] add 'limit' option 2024-08-18 13:39:48 +08:00
ClosedPort22
33d2ddd9fb [wikimedia] add 'wiki' extractor 2024-08-18 13:20:59 +08:00
ClosedPort22
a3b2c88fbe [wikimedia] refactor 2024-08-18 12:59:58 +08:00
Mike Fährmann
b57051719f [wikimedia] support wiki.gg wikis 2024-04-09 19:24:01 +02:00
Mike Fährmann
40c1a8e471 [wikimedia] fix exception for files with empty 'metadata' 2024-04-09 19:12:15 +02:00
Mike Fährmann
ef0c90414c [wikimedia] suppress exception for entries without 'imageinfo' (#5384) 2024-03-26 15:33:26 +01:00
thatfuckingbird
88a06df165 [wikimedia] add azurlane.koumakan.jp to presets 2024-02-29 19:28:50 +01:00
Mike Fährmann
ccb413df71 [wikimedia] support 'pidgi.net' and 'bulbapedia.bulbagarden.net' (#5205, #5206) 2024-02-17 17:35:10 +01:00
Mike Fährmann
af61d2b037 [wikimedia] combine most wikimedia.org sites (#1443) 
add wikidata.org and wikivoyage.org
 2024-02-10 03:00:58 +01:00
Mike Fährmann
90ac6d7375 [wikimedia] use '/api.php' as default API path 2024-02-06 00:36:51 +01:00
Mike Fährmann
c7a42880ab [wikimedia] support fandom wikis (#1443, #2677, #3378) 
Wikis hosted on fandom.com are just wikimedia instances
and support its API.
 2024-01-21 00:52:02 +01:00
Mike Fährmann
fc4e737f67 [wikimedia] include 'sha1' in default filenames 2024-01-19 03:08:43 +01:00
Mike Fährmann
44f2c15a04 [wikimedia] handle 'File:' paths 2024-01-19 03:05:45 +01:00
Mike Fährmann
ea553a1d55 [wikimedia] generalize (#1443) 
- support mediawiki.org
- support mariowiki.com (#3660)

- combine code into a single extractor
  (use prefix as subcategory)
- handle non-wiki instances
- unescape titles
 2024-01-18 15:36:16 +01:00
Mike Fährmann
c3c1635ef3 [wikimedia] update 
- rewrite using BaseExtractor
- support most Wiki* domains
- update docs/supportedsites
- add tests
 2024-01-17 00:08:06 +01:00
Ailothaen
221f54309c [wikimedia] Improved archive identifiers 2024-01-16 02:32:32 +01:00
Ailothaen
e33056adcd [wikimedia] Add Wikipedia/Wikimedia extractor 2024-01-16 02:32:25 +01:00