We had the issue resolved. The little lag spikes were fixed by switching from linux to a windows machine. At first the slower windows machine gave us micro spikes, but that was taken care of with the faster machine. Also this was the reply from creating a ticket on this issue which resolved the so called "crashing" (it wasn't really a crash but a remote restart as explained below). Thanks to everyone who helped out with this.
Also to add we did add the host_info_show to 1 before and it still crashed so all 3 of those values needed to be changed (or at least that wasn't the only one needed to be changed)."It appears you're running the CEVO match config which includes the following lines:
host_name_store 0 //Can be set to either 0/1 for official matches
host_info_show 0 //Can be set to either 0/1 for official matches
host_players_show 0 //Can be set to either 0/1
Please set these to 1. With them set to 0, our systems can no longer scan the server and detect it as down, causing the server to be restarted. "