Topic: MySQL stress test this (week/) weekend!

[Bonk]

When GW4 is over Saturday midnight, I will launch a MySQL stress test. Stock files and settings will be used to eliminate errors from those sources.

This is a test build that includes some minor but potentially significant changes to the SQL code. If I see any improvement I'll continue editing the SQL code along the same lines... if not I'll look at extending the error reporting.

This will be the first in a series of a few systematic tests, do not expect immediate results, but I am feeling optimistic.

The test will be run on Thor initially (I'm working on getting a stable test environment there), If I have problems there that I believe may be due to Thor, I'll move it to my server but I hestiate because my cable connection is only 600kbit up.

Your participation is required of course and is much appreciated.

[drb]

Hoi Bonk,

Your continuing efforts are a major asset to this community. Count on me to be there.

Take care

drb

[FPF-DieHard]

Bonk, you want to just use the whole Setup from GW4 so nobody has to Download anything?

Also, any chance we can do "War Cruiser Hell" as an SQL server with you assistance?

[Green]

Bonk, you want to just use the whole Setup from GW4 so nobody has to Download anything.

Would help.  If not, then what about just using the OP+ list?

[KBF-Crim]

cool beans...

[drb]

Hoi Folks,

If it is a stock setup, then there would be no downloads. Just a matter of uninstalling GW4 and OP+, or am I missing something here?

Take care

drb

[Bonk]

Correct Watson, running on stock settings is part of this test, and as an added benefit requires no downloads at all! 

[Bonk]

Bonk, you want to just use the whole Setup from GW4 so nobody has to Download anything?

Also, any chance we can do "War Cruiser Hell" as an SQL server with you assistance?

As drb pointed out, no download is required for a stock test (part of my systematic approach - if successfull, I'll move on to the standard gf edits, then OP+...) But I'd be happy to try a test of "War Cruiser Hell" on SQL on the condition the shiplist and settings are in line with my testing strategy.

[Bonk]

  el bumpo! 

[Bonk]

I'll give thor three strikes tonight before moving it to my server, three more on mine and back to work... but I hope to see improvement.

[Bonk]

Under protest I have upped the initial PP to to 10K, it was running smooth with 8 on when I killed it. Back to the test! 

stock files are available here:
shiplist: http://www.dynaverse.net/v2/downloads.php?id=21&game=SFC2%20OP#download
fighterlist: http://www.dynaverse.net/v2/downloads.php?id=20&game=SFC2%20OP#download

if necessary I can make an installer...

[Bonk]

stock missions can be found in the current serverkit:
http://www.dynaverse.net/v2/downloads.php?id=25&game=SFC2%20OP#download

[Bonk]

Stock files installer: here

(edit: does not include stock strings files yet - I'll update it later...)

[Bonk]

So far so good, no crashes in over 3 hours (only 8 players max tho...) - no crashes at all. I'll check in on it in the am (process sentinel is not on).

I hope to hit it again at 4 and 8 pm AST* today if everyone's willing to try and crash it, please login then!

(* edit - see below)

[Soreyes]

Will be there with bells on   

[KAT Chuut-Ritt]

Will be there with bells on   

Any one wanna ring Soreyes' bell?



<Snicker>

[Bonk]

Wow its still up!    (don't anybody touch anything on thor...just login on the test!) Have I done it? (This build is 3.00MB bang on, odd I thought, a good omen?). Looks like the kit is stable on thor, but is it stable under a full player load?

Again, I want to hit it at 4 PM and 8 PM AST* today, the server will stay up till it crashes at least once, (three strikes on thor then on my server).

(*edit - see below)

[benbean]

Ok whats ADT and whats the time difference to GMT? (Greenwich Mean Time)

[Bonk]

<...checks phone book>

Atlantic Standard Time (AST) = GMT-4
Atlantic Daylight Time (ADT) = GMT-3

edit - corrected - lol, I had to look here to be sure. (the time displayed there is the correct time for me, but the definitions below it should read GMT-x)

So the test times are actually 4 and 8 PM AST today, but feel free to login and check it out anytime while its up. (I intend to spend most of the day there but have to help a friend with a job search today too.)

[benbean]

1 hour 45 mins from the time on this post.

I'll be there Bonk.

[Bonk]

That's it, great stuff! We'll try again at 8 PM AST. (over 14 hours uptime now!).

[Dizzy]

Stock files installer: here

(edit: does not include stock strings files yet - I'll update it later...)

This sh*t makes it easy. I'll be on. When? And btw, if this is a test and its a fun server, I want 500k pretige. If I am only gonna be on a lil while, I dont want to have pretige be a worry or a concern.

[Bonk]

I have already upped the starting PP to 10000 against my better judgement (stock settings are part of the test). Hopefully that will do, if you find yourself short (ships are cheap - remember, almost all stock sttings), I don't want to reboot it just for that now, (already did once at 1:15 AM AST this morning 10 minutes into the test) I want to see that it will stay up for long periods too (stability).  I can give you some more PP if you run out. Hope to see you there!

Oh yeah be on in 8 minutes! (from this edit), - 4PM AST and again at 8PM AST - I'll leave it up till it crashes at least once or twice (if it does - going on 15 hours uptime now...).

[Lepton]

That's 3 PM Eastern, 12 PM Pacific and 7 PM Eastern, 4 PM Pacific.

[Bonk]

Thanks Lepton, next test is at 8 PM AST (2 hours 10 minutes from now).

So far it still has not crashed, but it seems the default late map and default DV shift settings have the undesired effect of preventing some hexes from being boosted to their max (say from DV 1 to 6 in a hex that maxes at 5 - with the DV shifing by 5 - DV wont boost...duh! - note for to account for this in defaults - upcoming poll on server gf default settings...)

Had some troubles connecting with deadman, need to test co-op with another player to seee where the problem is. I'll be back on at 8 (in 130 minutes)

Other than that, I'm pleased that the server has not crashed at all in over 16 hours now - so get on there people! Again, I'll leave it up till it crashes or survives a crowd of over 25.

[KAT Chuut-Ritt]

I dont want to have pretige be a worry or a concern.

Avoid P v P then.....

<Snicker>

[SkyFlyer]

woot sounds great

[GDA-S'Cipio]

By the way, the server was stable for several hours last night, with no burps and no mission wonkiness.  Even held up to a long, classic Rom vs. Gorn plasma ballet I had with Kroma, and reported correctly after the mission.

I suspect we should set up a time to crowd 30 people into one hex.......

-S'Cipio

[Bonk]

The server has been up on thor without a crash or reboot for 23 hours straight now, Max players on at once so far was 12, I want to see at least 25. As, I said, I'll leave it up till it crashes or survives a load of at least 25 players logged on at once.

(we got eight into one hex - drafted six and one dropped from the mission which eventually crashed - server survived, a 2 on 2 shortly after started OK)

Please report here of you see more than 12 players on or any weirdness (bear in mind its mostly stock settings and the max DV issue mentioned above) of course, report a server crash here as well.

Thanks to all who helped test tonight, and I hope to see more of you tomorrow night! 

[Bonk]

So we'll try and hit 25 players again tomorrow night at 6 PM and 9 PM AST, and same everyday till it crashes or survives - I'll leave the server up.

(P.S just got promoted to Lt.  )

[FPF-SCM_TraceyG_XC]

What we really need is to get as many people on at once, and then have them all dogpile into one hex. Thats usually when the server has problems.

[Bonk]

What we really need is to get as many people on at once, and then have them all dogpile into one hex. Thats usually when the server has problems.

You got it, so hit it at 6 PM and 9 PM AST, and same everyday till it crashes or survives 25 - sound like a plan? (I want to leave it up to test for long term stability and memory leaks)

[Bonk]

χτυπώ - and pass the souvlaki! 

[GDA-S'Cipio]

Please report here of you see more than 12 players on or any weirdness (bear in mind its mostly stock settings and the max DV issue mentioned above) of course, report a server crash here as well.

Thanks to all who helped test tonight, and I hope to see more of you tomorrow night! 

I had one weird thing happen last night, though I can't say what it was related to.

In a 3 on 2 match, while being chased by a few fast drones, I hit "W" to pop a weasel and emergency decel.  I stopped dead, but the weasel did not launch.  I was struck by the drones.

Oh well, these things happen.  So I waited out the emergency decel period and started accelerating again.  As soon as I got up to full speed, I suddenly stopped dead again for no reason and the weasel launched on its own.

I've never seen anything like that happen before.

We had a lot of disconnects because we were trying to draft 3 on 3.  This bug might be more related to a botched mission start than to your SQL server.  But since you asked for reports of any weirdness...... 

-S'Cipio

[FPF-SCM_TraceyG_XC]

Were you the host, Scipio?

[GDA-S'Cipio]

Were you the host, Scipio?

Yes, I believe I was.

I drafted the first few missions, and drb drafted the last few.  And I still had the King Eagle, which died early in the night, and........  Oh, shoot.  I guess I can't be positive.  But I think I was the host.

If it ever happens again, I'll take notes.

-S'Cipio

[Bonk]

Thanks Scipio,

That probably is the usual buggyness of dyna 3vs3 missions (Tracey and I were just discussing exactly that). The 2vs2s I was in last night went well though.

That is weird about the weasel, sounds like the mission bugged (double fire style - like when the AI takes your ship and you haven't been captured... there is missions code that periodically takes control of your ship I think (Karnak used it for the "dis dev" prototype?), and it seems to get stuck occassionally.

Thanks for the report, hopefully we'll get over 25 on sometime this week. (6PM and 9PM AST everyday till it dies or survives 25!)

(note to self: default gf settings for pirate tensions still need to be adjusted - too even - odd mission alliances result)

[FPF-SCM_TraceyG_XC]

It sounds to me as though Scipio wasnt the host, when he launched his ww, his client program executed a deceleration, but the host is needed to 'create' a new ship (the ww). A glitch in the connection somehow delayed that from reaching the host and it took the scenic route. A short while later, the host registered the launch of the ww, and then acted accordingly, accounting for why Scipio all of a sudden slowed down again, and the ww was launched.

[Bonk]

Stock installer updated to include strings, shipnames and sounds text files.

20 minutes till the 6 PM AST stress time (D.net servers seem slow now too - would be a good time to hit it, and again at 9 PM AST too...)

[Soreyes]

OK Bonk I found these little problems last night. I believe it may have to do with the Cartel set up.

1. While rampaging through ISC space...... Got nothing but Rom AI?

2. Umm None of the hexes in the ISC Border row (far right) will not drop in DV after being attacked

3. I found Nemo....... But could not catch him

[Dizzy]

What r sounds text files?

[Bonk]

What r sounds text files?

Assets\Sound\sounds.txt

controls voices etc. (was modified for KCW, mods may remain uninstalled or were uninstalled manually incompletely)

[Dizzy]

ok, well I didnt D/L any KCW stuff. So your stuff  is stock then?

[Bonk]

This MySQL test server is pure stock - no downloads - stock files and settings is a large part of the point of this test. (the server has been up on thor with no crashes or reboots for over 41 hours straight now...). Almost all of the server settings are stock too.

Edit: This does not mean I want all servers to run stock, that's the last thing I want (look at my mods). We just need to establish a baseline, if this server will hold 25 then I'll modify the missionlist, DV shift settings, and missions probabilites for the next test. (some map and politics tweaks too?) Then on to testing on OP+, custom scripts, more advanced settings, webmaps, etc... (Psst: SFB-OP has been running just as stably on this build on MySQL too.. , but I want to load the stock test server on thor to see if it will crash on stock settings and with the edits I've made to the serverkit's SQL code.)

[RazalYllib]

mmm, where to begin..

I have unfortunately been detained last couple days or I would have been more active. Next couple are good though. Thursday is no-go same for friday.

Very nice to see you have gotten your paws on sql source...and have hopefully tweaked, I will endeaver to rally the troops, we need a REAL stress.

Has access to source shed any illumanation on the remaining undecypherable blobs?

Post stress...

If things go well, we get a chunk of warm bodies to log on and hit a single hex and is does not go "Poof" it will be a good thing.
I hope other optimization is occuring with elements of the server kit, to increase stability and perhaps player load.

I would like to see a stress of a Enormous Map as well, combined with large AI Player count.  That has not been done in some time if I recall since David and Mags did some additional work on the server kit many many many moons ago.  IIRC, one of the problems with HUGE maps was corruption of the flatfile db due to the size of the map, but I may be wrong, it was a while ago.


 

[Bonk]

Very nice to see you have gotten your paws on sql source...and have hopefully tweaked, I will endeaver to rally the troops, we need a REAL stress.

I wish, I hope, I pray that 25 people will eventually show up...    (Castrin had found the same - the SQL kit works perfectly - nobody will play on it unless its on a mangled mod and guaranteed to crash so they can say "We told you so..")

Has access to source shed any illumanation on the remaining undecypherable blobs?

Somewhat, but I have not had time to dig into it yet, as I went right for the SQL code to try and remove some of the absurdness.

Big maps are gonna make this kit barf, that's the way it is written.  There is a possible complete overhaul in the works, new db, new code... patience it will be a very slow process... if we're gonna do it we'll take the time to do it right.

[Bonk]

A bump for the info.

[Bonk]

Bump for tonight!

Yes, 5:00 PM Pacific or 6:00 PM Mountain or 7:00PM Central or 8:00PM Eastern or 9:00PM Atlantic, any of these will do!

[Bonk]

Another bump for tonight!

Yes, 5:00 PM Pacific or 6:00 PM Mountain or 7:00PM Central or 8:00PM Eastern or 9:00PM Atlantic, any of these will do!

[benbean]

How did last nights test go?

[Bonk]

Good, I got some good info, but we still did not get 25 on. (brief report here) I have a new build that I want to test tonight. (sleep, what sleep?  ) If I have time for tonight I will reset it with some settings changes and some missions pulled.

[benbean]

Well, the kids are going to Grandma's and the wife has her works Christmas party this Saturday. I'm at your disposal bonk.

Edit: well Mrs bean just told me that she aint going now  I'll be online still, just not as much as I thought 

[Bonk]

Thanks, even a short visit to add to the numbers is a help.

Server has been reset on a new build, some settings modified and some missions missions pulled. (yay!) Hopefully we'll be able to get 25 on sometime over the weekend to see what we get this time.

[KBF-Crim]

I'll try and make it tonight....

[Bonk]

The test server will have to wait. I just took it down (though I'm dying to see what happens on this build). The D.net test server is busy until further notice. I will move the test server to my server (Duron1.3-256MB) shortly and take SFB-OP down.

[KBFLordKrueg]

Ah, well, that answers my question I posted in the SFB thread.
That's what I get for not looking here forst...
Are you going to put at least the SFB server back up anytime soon?

[Bonk]

Sorry bout that Kreug.  I took it down so I can run the MySQL test on it instead. (machine can't afford to run both for testing conditions). When I get 25 or more on the test, I'll put SFB-OP back up (hopefully sunday night or monday).

The test server is back up! So get on the test people, so we can get back to SFB-OP!  And War Cruiser Hell, and SG4, and GW5... (maybe we'll get to have em on SQL?)

[Bonk]

Here's a Webmap so we can see who's on when, to help get a crowd on. (shipyard disabled so the webmap will not write to the db so as not to disturb the test).

[KBF-Kurok]

there  were 6 of a  a while ago and the server  seemed stable