Comments
thread: The Site
ValhallaKohru2 years ago

There's clearly some misunderstanding going on, the API already has a throttling system to limit traffic and prevent abuse, this is what should be tweaked if needed.

The bug doesn't prevent us from requesting more than 10k results at once since that was always impossible, requests are limited to a maximum of 200 results. What it prevents is accessing results with an offset of >=10k.

This means that if I want to do something as simple as graph the number of runs submitted over time of a popular game I can't because there's no straightforward way to obtain every run of that game (even if I request 200 runs every 30 minutes).

If the database is somehow actually dying from reading past 10k rows for the rate-limitted API users then enable cursor-based pagination (which every framework supports) instead of silently breaking the API

adrianus, FernandaE047 and 8 others like this
thread: The Site
ValhallaKohru2 years ago

The recent "performance improvement" changes to the site have broken the API and nobody seems to care. I'm posting here since the issue on the GitHub repo is being ignored https://github.com/speedruncomorg/api/issues/125

Due to this bug it's impossible to obtain every run from the most popular games the intended way rendering many projects/tools/bots unusable. Trying to work around this bug by, for example, requesting runs per category results in lost runs from deleted categories, slower results, hitting the request limit faster and won't help once categories grow past 10000 runs.

I understand that the API doesn't give ad revenue but it's an important tool for many communities and needs to be kept alive.

ZiRO2264, klbyte and 6 others like this
thread: The Site
ValhallaKohru2 years ago

Currently the API only returns "verify-date" on approved runs and there's no "rejection-date" equivalent for rejected runs. This date is already being tracked since it's visible on the run's page https://i.imgur.com/qU0tHpa.png

Without this date it's impossible to calculate stuff like how many runs a verifier has verified over the last 30 days or the length of the verification queue at any point of the leaderboard's history. Seems like an easy to fix oversight that requires little effort and no breaking changes for the API response schema

Bob-chicken, chilsie and 3 others like this
About Kohru
Joined
3 years ago
Online
2 years ago
Runs
0