Commit Graph

32 Commits

Author SHA1 Message Date
Mike Fährmann
a383eca7f6 decouple extractor initialization
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().

This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
2023-07-25 22:16:16 +02:00
enduser420
12cd85658b [redgifs] add 'niches' extractor 2023-07-16 21:22:06 +05:30
Mike Fährmann
bab13402df [redgifs] update 'search' URL pattern (#4115) 2023-05-30 15:42:31 +02:00
Mike Fährmann
5a6fd8027d [redgifs] support galleries (#4021) 2023-05-30 15:02:18 +02:00
Mike Fährmann
884f1848d6 [redgifs] fix syntax for older Python versions
and update docs/supportedsites
2023-02-18 13:07:40 +01:00
enduser420
b28bd9789e [redgifs] add 'collection' extractors 2023-02-16 20:10:22 +05:30
enduser420
a18f627bfc [redgifs] support v3 URLs 2023-01-30 20:06:43 +05:30
Mike Fährmann
cd931e1139 update extractor test results 2022-12-08 18:58:29 +01:00
Mike Fährmann
04d3ebdfb4 [redgifs] fix 'token' extraction (#3080, #3081) 2022-10-21 13:27:16 +02:00
Mike Fährmann
ed55bd3a5c [redgifs] extract Bearer token (#3037) 2022-10-13 18:56:11 +02:00
Mike Fährmann
e974c75083 [redgifs] fix extraction (#3037)
send public Bearer token as 'authorization' header
2022-10-12 11:17:05 +02:00
Mike Fährmann
7f764ebee6 [redgifs] "fix" download URLs (#2884) 2022-09-02 23:25:38 +02:00
Mike Fährmann
806bc62379 [redgifs] support 'i.redgifs.com' URLs (closes #2300) 2022-02-13 23:00:50 +01:00
Mike Fährmann
7cb303d745 [redgifs] improve URL extraction
Fields inside 'urls' can be None, which would have caused an exception
with the old method.
2021-11-05 20:02:43 +01:00
Mike Fährmann
2befed1a96 [redgifs] update search URL pattern (#1984) 2021-11-05 20:00:06 +01:00
Mike Fährmann
b315a0ecef [redgifs] update to API v2 (#1984) 2021-11-04 21:31:20 +01:00
Mike Fährmann
06b414c9a3 [redgifs] 'gfyId' -> 'id' (#1984) 2021-10-29 02:05:39 +02:00
Mike Fährmann
6434ccf9e8 [redgifs] split from 'gfycat' (#1984)
Update API endpoints and metadata names - mostly 'gfycat' -> 'gif' -
and remove some obsolete checks.
2021-10-28 19:22:41 +02:00
Mike Fährmann
e436a2607b [gfycat] consistent 'userName' values for 'user' downloads (#1962)
by using the name from the input URL and not relying on possibly faulty
or incomplete API results.

'userData[username]', if available, will still have the original name.
2021-10-26 19:15:30 +02:00
Mike Fährmann
fb98b3fdaf [redgifs][gfycat] remove webtoken code (fixes #1907) 2021-10-01 17:08:33 +02:00
Mike Fährmann
cac0110d8b [redgifs] update API server address (fixes #1632)
napi.redgifs.com -> api.redgifs.com
2021-06-16 23:07:25 +02:00
Mike Fährmann
b3bc646236 [redgifs] match embedded URLs
https://redgifs.com/ifr/<ID>
2021-01-08 16:01:01 +01:00
Mike Fährmann
3759d0cb42 [redgifs] fix search results
The metadata for Redgifs search results got stripped down to a bare
minimum, including download URLs. (Clicking on search results on the
website itself is broken as well)

As a workaround, we make an extra call to '/v1/gfycats/<ID>'
for each search result entry to fetch the missing data.
2021-01-06 18:16:06 +01:00
Mike Fährmann
968d3e8465 remove '&' from URL patterns
'/?&#' -> '/?#' and '?&#' -> '?#'

According to https://www.ietf.org/rfc/rfc3986.txt, URLs are
"organized hierarchically" by using "the slash ("/"), question
mark ("?"), and number sign ("#") characters to delimit components"
2020-10-22 23:31:25 +02:00
Mike Fährmann
7cd383c0f9 update extractor test results 2020-09-20 21:54:39 +02:00
Mike Fährmann
d50f3b333a update extractor test results 2020-08-30 20:55:22 +02:00
Mike Fährmann
cf44571fe0 [gfycat] add 'user' and 'search' extractors 2020-07-16 15:00:32 +02:00
Mike Fährmann
3424fb96c3 [redgifs] support gifsdeliverynetwork.com URLs (#874) 2020-07-09 18:04:30 +02:00
Mike Fährmann
cf863f60b3 [redgifs] add 'user' and 'search' extractors (closes #724) 2020-06-10 22:03:52 +02:00
Mike Fährmann
3bad1579ee update extractor test results 2020-05-31 17:42:07 +02:00
Mike Fährmann
275cceeb6a [redgifs] fix extraction (#724)
… and prepare for more potential extractors
2020-05-28 02:18:42 +02:00
Mike Fährmann
f557cac074 [redgifs] add image extractor (#724) 2020-05-10 00:31:42 +02:00