Website Database Size Cap

Connect with other users about what to run on your webhosting (and how to run it) here.
Post Reply
dustinandband
A semi-regular
A semi-regular
Posts: 22
https://www.youtube.com/channel/UC40BgXanDqOYoVCYFDSTfHA
Joined: Mon Oct 05, 2015 7:38 pm

Website Database Size Cap

Post by dustinandband »

Do the SQL database(s) that comes with the 'lite' website plan have a limit on how much info each individual database can log before it stops storing stuff? Say, if a database where to reach 127 MB?

~Some context~

https://i.imgur.com/Cz2irUr.png

I have some Left 4 Dead 2 servers that logs a bunch of data for survivalism mode, to a central database. The 'survival_leaderboards' database collects round statistics such as end time, SI kill stats, player stats, etc..

The 'heatmaps' database table logs the location of each SI killed, each survivor's position (every 12 seconds), and the name of the attacker - all in association with the roundID of the survival_leaderboards table, so it can be a bit spammy. I exported the database in it's current state and it said it ended up being 127 MB. You can see where the database cuts off in the image (there's more rows past 41818 but they're all blank).

Project information can be found at:
http://fixedsurvival.site.nfoservers.com/
http://steamcommunity.com/groups/fixedsurvival


The heatmap project was something else we where going to eventually add to the website - to each logged leaderboard time. The end result would've ended up looking similar to this (scroll all the way down to see all toggleable options):
http://noca.site.nfoservers.com/heatmaps/rooftop-block/
http://noca.site.nfoservers.com/heatmaps/port/

I checked and there's no error logs for the heatmaps plugin. For some reason it just stopped logging into the database, so I'm thinking it must be a size limit issue reached with this particular database. Since the rows keep continuing, but they're blank, perhaps it's a feature to keep databases from getting too big.
User avatar
Spray
Former staff
Former staff
Posts: 630
Joined: Wed Dec 28, 2011 10:41 pm
Location: Oregon

Re: Website Database Size Cap

Post by Spray »

We don't set any artificial limits on table size. As long as the SSD for the machine has space available, you can continue to grow your database. If you attempt to execute a query manually to add information into the database, does this correctly add a row with all data present?
dustinandband
A semi-regular
A semi-regular
Posts: 22
Joined: Mon Oct 05, 2015 7:38 pm

Re: Website Database Size Cap

Post by dustinandband »

hmm well it looks like the heatmap plugin is still logging the info correctly, it's just there's a lot of extra blank pages for whatever reason that extend beyond the last recorded official heatmap log. I came back to check and sure enough there where recorded heatmap logs from the latest round id associated with the survival_leaderboards table - done just today. After that though there's tons of blank pages.

I believe the heatmap plugin compares two keys upon survival round start - incase the server shut down unexpectedly or something like that mid round - and if they're different then the plugin will wipe all the heatmap logs from the previously interrupted survival round, so it doesn't get logged to the new round. It sounds confusing and it's a hacky method, but it was one of the easiest ways for the plugin author to come up with accounting for heatmap round_ids potentially overlapping with each other. Perhaps that's why there's so many blank pages?
User avatar
Spray
Former staff
Former staff
Posts: 630
Joined: Wed Dec 28, 2011 10:41 pm
Location: Oregon

Re: Website Database Size Cap

Post by Spray »

This is a possibility, but I couldn't say with certainty. Typically, those rows would want to be deleted completely, not just emptied. I would perhaps try recreating this manually by unexpectedly stopping the server, to see if this occurs again.
Post Reply