← Back to Forum

scraping REST API

cayce • Nov 06, 2021 at 15:31
Hi, is there a REST API for searching/retrieving information from the database? I'm using RetroPie with skyscraper, but even the best-filled scrapers (screenscraper.fr & mobygames) are missing a lot of software that gen-msx does have. I'd like to create a scraping module in skyscraper for generation-msx.nl - if there is a REST API, and if scraping would be allowed, of course. (E.g., screenscraper.fr requires bandwith restrictions, which are dutifully implemented in skyscraper. So that could be an option, if there are bandwidth concerns.) Ideally, the REST API would be queryable by sha1 hash - is that information available in generation-msx.nl's database? Regards, Cayce

Replies (2)

sylvester • Nov 08, 2021 at 21:51
Hi, at the moment there is no rest api for retrieving data from the database. Also we don't have any sha1 hash information about games in the database, which only should work for roms since there are a lot of disk games that saving on the disk itself. Sylvester
cayce • Nov 09, 2021 at 08:41
Sylvester, aw, that's too bad. Any chance of that being added any time soon? I could be persuaded to code it myself, if the gen-msx site's code is available, that is.. My PHP is a bit rusty (~20yrs back) but I'm assuming there is a scaffolding library for exposing read-only data via REST? W.r.t. sha1: true - it would be ideal only for roms. The search index of gen-msx is much better that screenscraper, for instance, so that more than compensates ;) Regards, Cayce

Please login to reply to this thread.

Last Viewed