Commit Graph

331 Commits

Author SHA1 Message Date
loragja
7b5ee922b7 cyberdrop extractor (#1328)
* create cyberdrop extractor

* add cyberdrop to list of extractors

* fix formatting

* change class name from CyberdropExtractor to CyberdropAlbumExtractor

* add cyberdrop to list of supported sites

* attempt to clean up diff of supportedsites.rst

* replace regex with functions from text library
2021-02-21 20:42:45 +01:00
Mike Fährmann
595bdaa4be add extractors for gelbooru v0.1 sites
- support https://illusioncards.booru.org/  (closes #426)
- support https://the-collection.booru.org/ (closes #767)
- support https://allgirl.booru.org/
- closes #234, closes #473, closes #1238

To get gallery-dl to recognize other sites running Gelbooru v0.1
(most sites on booru.org), add one or more entries to the
'gelbooru_v01' block in your config file. For example:

{
    "extractor": {
        "gelbooru_v01": {
            "rozenmaidenbooru": {"root": "http://rm.booru.org"},
            "drawfriendsbooru": {"root": "http://drawfriends.booru.org"}
        }
    }
}
2021-02-17 02:36:27 +01:00
Mike Fährmann
08d7934c6e move extractors from booru.py into their own gelbooru_v02 module 2021-02-17 00:26:24 +01:00
Mike Fährmann
ae530f6365 [erome] add extractors for albums, users, searches (closes #409) 2021-02-07 22:58:19 +01:00
Mike Fährmann
7ca3bf7cb0 [pillowfort] add 'user' and 'post' extractors (#846) 2021-01-25 15:03:22 +01:00
Federico Ravasio
25297815bc [photovogue] added portfolio extractor (#1253) 2021-01-22 19:36:13 +01:00
Mike Fährmann
534194bf92 [unsplash] add extractors (#1197)
for
- single photos  (/photos/ID)
- user profiles  (/@USER)
- user likes     (/@USER/likes)
- search results (/s/photos/SEARCH)
2021-01-19 02:23:39 +01:00
Mike Fährmann
e07dfc4fe5 [kemonoparty] add 'user' and 'post' extractors (#1216) 2021-01-11 22:17:08 +01:00
Mike Fährmann
fa8ee6eac4 [derpibooru] add search and gallery extractors (#862) 2021-01-07 18:05:32 +01:00
Mike Fährmann
212ae0c399 [mangapanda] remove module
site now redirects to mangareader.net
2020-12-20 17:42:15 +01:00
Mike Fährmann
a3a863fc13 [booru] add generalized extractors for *booru sites
similar to cc15fbe7
2020-12-08 18:34:30 +01:00
Mike Fährmann
cc15fbe71a [moebooru] add generalized extractors for moebooru sites
- add support for sakugabooru.com (closes #1136)
- add support for lolibooru.moe   (closes #1050)

This allows users to dynamically add support for moebooru/myimouto
based sites by adding an entry to their config file
(like for foolslide, foolfuuka, etc)

For example:
{
    "extractor": {
        "moebooru": {
            "new-site-1": {"root": "https://site1.net"},
            "new-site-2": {"root": "https://www.site2.moe"}
        }
    }
}
2020-12-01 22:27:18 +01:00
Mike Fährmann
350b1afe1c speed up _list_classes() after iterating over all modules once 2020-10-26 22:18:15 +01:00
Mike Fährmann
c874071f5a [kissmanga] remove module 2020-10-04 22:46:41 +02:00
Zanny
ebb7737b9b Weasyl Extractor (#977)
* weasyl extractor

* @kattjevfel suggested changes

* @mikf changes
2020-09-25 15:18:21 +02:00
choeronline
05b9ac8d37 [myhentaigallery] add extractor (#1001)
* adds support for myhentaigallery

* fixes linting issues in myhentaigallery extractor
2020-09-17 17:32:54 +02:00
Mike Fährmann
3918b69677 remove 'extractor.blacklist' context manager 2020-09-11 13:17:35 +02:00
Mike Fährmann
8dbf827649 [bobx] remove module 2020-07-24 17:00:43 +02:00
Mike Fährmann
87202b8d74 [inkbunny] add 'user' and 'post' extractors (#283) 2020-07-22 22:21:30 +02:00
jakem72360
7dfdcc3fbf [mangakakalot] Added extractors for MangaKakalot (#876) 2020-07-13 21:20:09 +02:00
Mike Fährmann
821524e4ee [subscribestar] add 'user' and 'post' extractors (#852) 2020-07-03 21:08:47 +02:00
Leonardo Taccari
39cd389679 [webtoons] Add a new extractor for webtoons.com (#761)
The webtoons extractor can extract episode and entire comic (all
episodes) from webtoons.com.

All the logic of the extractors should be trivial except for a couple
of kludges needed:

 - `ageGatePass' cookie is always set to avoid possible redirect and stop of
    extraction, especially in the comic extractor
 - The image URLs returned by the episode extractor could not be fetched
   directly and the `Referer:' HTTP header needs to be passed to fetch them

Close #593.
2020-05-18 19:04:20 +02:00
Bepis
7b5711ee04 [imagechest] Add new extractor for ImageChest (#750)
* [imagechest] Add new extractor for ImageChest

* [imagechest] Fix flake8 compliance issues
2020-05-18 19:02:56 +02:00
Mike Fährmann
f557cac074 [redgifs] add image extractor (#724) 2020-05-10 00:31:42 +02:00
Leonardo Taccari
b47cfc5ac9 [speakerdeck] Add a new extractor for speakerdeck.com (#726) 2020-05-01 22:32:22 +02:00
Mike Fährmann
6143050980 [aryion] add gallery and post extractors (#390, #673) 2020-04-08 21:52:51 +02:00
Mike Fährmann
fdd2dd5136 [kabeuchi] add 'user' extractor (closes #561) 2020-03-13 16:45:42 +01:00
Mike Fährmann
cc5079c844 [hiperdex] add chapter and manga extractors (closes #606) 2020-02-22 03:09:29 +01:00
Mike Fährmann
765b2a0527 [hentaihand] add extractors (closes #605) 2020-02-19 21:55:47 +01:00
Mike Fährmann
138135c190 [furaffinity] add extractors (#284) 2020-02-11 19:51:24 +01:00
Mike Fährmann
719b63d0ca [bcy] add user and post extractors (#592) 2020-02-09 02:37:14 +01:00
Mike Fährmann
1f4c9c5f9d [8kun] add thread and board extractors (closes #582) 2020-02-04 22:50:31 +01:00
Mike Fährmann
cf7a67d67f [yaplog] remove module
Yaplog! ended its service on 2020-01-31
2020-01-31 12:56:54 +01:00
Mike Fährmann
5cac79c3d9 [erolord] remove extractor 2020-01-10 14:40:30 +01:00
The Oddball
9a4ce20b8e [realbooru] Add Realbooru extractor (#514) 2019-12-16 15:49:30 +01:00
Mike Fährmann
557e2c018b [8chan] remove module 2019-11-02 20:06:47 +01:00
Mike Fährmann
702f2fbd1f [issuu] add publication and user extractors (#413) 2019-10-31 16:52:57 +01:00
Mike Fährmann
109718a5e3 [blogger] add blog and post extractors (closes #364) 2019-10-26 14:15:55 +02:00
Mike Fährmann
2057c6ba29 [naver] add blog and post extractors (closes #447) 2019-10-21 16:59:15 +02:00
Mike Fährmann
6779512fc7 [nozomi] add post and tag extractors (#388) 2019-10-13 22:16:03 +02:00
Mike Fährmann
6fe9a134bf [lineblog] add blog and post extractors (closes #404) 2019-09-06 22:16:42 +02:00
Mike Fährmann
6f3df3999a [fuskator] add gallery and search extractor (closes #407) 2019-09-02 21:20:02 +02:00
Mike Fährmann
2153206093 [imgbb] add album extractor (#361) 2019-07-30 23:11:19 +02:00
Mike Fährmann
60cf40380a [vsco] add user extractor (#331) 2019-07-23 16:23:11 +02:00
Mike Fährmann
3fe5ccdfa6 [adultempire] add gallery extractor (closes #340) 2019-07-21 22:29:57 +02:00
Mike Fährmann
2ff73873f0 [erolord] add gallery extractor (closes #326) 2019-07-04 20:28:04 +02:00
Mike Fährmann
18a1f8c6cd [vanillarock] add post and tag extractors (closes #254) 2019-06-23 22:45:36 +02:00
Mike Fährmann
f0c5093812 [nsfwalbum] add album extractor (closes #287) 2019-06-23 22:45:07 +02:00
Mike Fährmann
d997c10320 [8muses] add album extractor (#305) 2019-06-10 22:17:46 +02:00
Mike Fährmann
2184e3a86b [slickpic] add album extractor (#249) 2019-06-09 21:59:22 +02:00