Summary Statistics, maybe on copies of the database?

[jdittrich]

I would like to calculate summary statistics, similar to what Josh Bressers did about contributor counts distribution. However, the only way to do it that I currently see is hitting the API repeatedly, storing all the single information in a local database and then doing the calculations.
Is there a way to SQL-query the database directly or to download a copy of the database to query it locally?

(Wikimedia offers both options for Wikipedia, for example)

[BenJam]

hey @jdittrich thanks for getting in touch. We do offer downloads over at https://packages.ecosyste.ms/open-data but I am not sure you'll find what you need in that data set.

We're currently rethinking how we distribute data and support others to set up instances of ecosyste.ms for their own use, there are literally terabytes of data in those tables that might need to be stored in RAM depending on your query. Either way we'll have news on this in the coming weeks. Keep an eye on blog.ecosyste.ms for that.

For the moment we continue to operate the service free of rate limits, so 'fill your boots' as they say. That said please be aware the data is provided under a CC-BY-SA licence.

Thanks