PC software QA

[Zarcath]

Has anyone here had experience with PC video game QA? I may be doing some on a side contract and need to know what sort of technical certifications (if any) it's required to pass. I only need to know about technical requirements like installer or drivers, maybe save game files and changing users? I don't need help with gameplay issues.

I don't have the hardware to test different video configs, but the game is using the PlayFirst engine (DinerDash etc), it's not graphically demanding.

Does QA help determine the minimum recommend specs or is that something the lead programmer/tech director would know?

[Linbog]

Well the Microsoft Games for Windows verification testing uses these requirements, there is also a technical doc on MSDN right next to this one in the list: Games for Windows: Test Cases

[Zarcath]

thanks, will read over it

[AladainAF]

Wow, those test cases are beyond horrible. I'd be fired if I wrote test cases that bad. /shrug

[Froofy-D]

Originally Posted by AladainAF

Wow, those test cases are beyond horrible. I'd be fired if I wrote test cases that bad. /shrug

What's wrong with them? Seems like all of that stuff should be verified.

[AladainAF]

Originally Posted by Froofy-D

What's wrong with them? Seems like all of that stuff should be verified.

It's lacking a tremendous amount of verification. For example, theres nothing power management (it shouldn't kick in while game is up). Theres no testing like screen savers kicking in (those shouldn't either though they should if a game can be minimized). If user selects a GL screensaver, and is running a game and has it minimized, does the GL screensaver affect graphics of game? No processor affinity checks to see how that would affect the game (remember how EQ used to run ultra fast if you changed it?). Aspect ratios and shit are tested, but no refresh rates are tested.

There isn't a single "negative testing" test case.

Basically, what it looks like is a 2-3 hour attended time "test to pass" smoke test to be run by low paid techs in China or India.

When I write test cases for a piece of software, writing the "stuff that should be verified" is about 10% of the suite at most. The expectation from the three companies I've written test plans for is that you write your test cases with a "test to fail" scenario and not a "test to pass". You also are expected to write in a lot of negative testing - ya know, try to break it, etc.

[Linbog]

You entirly missed the intent of the test cases so I'll copy paste from the technical doc:

Summary of Games Requirements
Customer Benefits

Computer games are a key entertainment experience on Windows, but ease-of-use concerns have caused customer frustration over the years. Traditionally, games are installed like applications, but they are utilized more like entertainment media (movies or songs, for example), as demonstrated by the gaming experience on Xbox 360 consoles. Innovations, such as Games Explorer, expose games in a consistent manner that is different from standard applications. These innovations also and give games first-class citizen status in Windows, together with Music and Pictures. The following requirements help ensure that Windows Vista provides an improved, more accessible, and unified gaming experience. At the same time, they ensure compatibility with Windows XP.

They were not written with the intent that the software makers use them to test their software and they are test to pass because its certification requirements.

[Zarcath]

Has anyone gone through the process for having a title approved as Games for Windows Live?

[Hachima]

Does anyone have any resources they would recommend for Software QA, in particular from a QA developer standpoint. Not necessary something as in depth as the CMMI What is CMMI? but any type of must read material.

[AladainAF]

I went through the whole IIST certification programs here: International Institute for Software Testing (IIST) CSTP & CTM Informational Home Page

They often times offer "free" seminars that are extremely helpful and informational. I attended one at the Crowne Plaza in San Antonio earlier this year that was absolutely FANTASTIC. Additionally, they do not hound you at all to pay for the service they are offering like I thought they would. They do ask for your email and you are put on an emailing list, but its very useful to my job. They also provide a free continental breakfast.

[Ayeshala]

GFW-Live basically exists so *some kind of standard* is in place. It's mostly used to filter out undesirable products (Hentai Tentacle Rape game huh?... No.) and avoid PR Storms than to ensure the next random FPS is going to offer a truly quality, stable experience.

[Valaden]

Originally Posted by Zarcath

Has anyone here had experience with PC video game QA? I may be doing some on a side contract and need to know what sort of technical certifications (if any) it's required to pass. I only need to know about technical requirements like installer or drivers, maybe save game files and changing users? I don't need help with gameplay issues.

I don't have the hardware to test different video configs, but the game is using the PlayFirst engine (DinerDash etc), it's not graphically demanding.

Does QA help determine the minimum recommend specs or is that something the lead programmer/tech director would know?

G4W testing has less to do with standard QA than it has with making sure the software is going to interface well with Windows XP/Vista and its features.

Basically the G4W seal only ensures the game will support all resolution ratios, the XBox 360 Controller, Parental control ratings set in Vista etc.

Doesn't change whether you will crash anytime you pick up a gold coin in Mario Bros or not - thats left to standard QA.