Web Presence Working Group: Testing Guide: Difference between revisions

From GO Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 21: Line 21:
== How to Test ==
== How to Test ==


=== Installation script (Ben) ===
=== Installation script ===


Basically, successfully install AmiGO on a machine and check to see if the installation script lies.
Basically, successfully install AmiGO on a machine and check to see if the installation script lies.


=== AmiGO software page (???) ===
=== AmiGO software page ===


Should contain proper links to all features not included in the menu bar.
Should contain proper links to all features not included in the menu bar.
Line 31: Line 31:
=== IEAs ===
=== IEAs ===


==== Term Enrichment (???) ====
==== Term Enrichment ====


Check and make sure that term enrichment is properly using the IEAs.
Check and make sure that term enrichment is properly using the IEAs.


==== General Check (Everybody) ====
==== General Check ====


Check and make sure that the new database build is working as expected. While we were trying to get it to work we had issues with gene product count, species, and the graph. While these seem to be working now, browse around and make sure that everything is in working order.
Check and make sure that the new database build is working as expected. While we were trying to get it to work we had issues with gene product count, species, and the graph. While these seem to be working now, browse around and make sure that everything is in working order.
Line 43: Line 43:
We need to test the unified graphing backend.
We need to test the unified graphing backend.


==== Term Enrichment (???) ====
==== Term Enrichment ====


Make sure that the visualization feature of TE works properly.
Make sure that the visualization feature of TE works properly.


==== Browser (???) ====
==== Browser ====


When browsing the ontology, check to make sure that the "Graphical View" link works as expected.
When browsing the ontology, check to make sure that the "Graphical View" link works as expected.


==== Homolset (???) ====
==== Homolset ====


Make sure that the homolset graphs appear as expected.
Make sure that the homolset graphs appear as expected.


==== Standalone Client (???) ====
==== Standalone Client ====


Make sure that standard input and advanced input give the proper results with both SVG and PNG.
Make sure that standard input and advanced input give the proper results with both SVG and PNG.
= Testers =
* Installation script (simulate.pl)
* AmiGO software page
* IEAs (problem areas)
** Term enrichment
** Gene product count
** Species
* Visualize
** Term enrichment
** Browser
** Homolset
** Standalone client


= Things to Remember =
= Things to Remember =

Revision as of 13:29, 12 August 2009

New Things to Test

I pulled these assignments from the WPWG mailing list and chose people more or less based on how much I heard from them (hoping that would be an indicator of their availability).

If you have problems, please contact Seth or the WPWG list. Feel free to trade assignments as long as the wiki is updated.

Testable new features

  • Installation script (simulate.pl)
  • AmiGO software page
  • IEAs (problem areas)
    • Term enrichment
    • Gene product count
    • Species
  • Visualize
    • Term enrichment
    • Browser
    • Homolset
    • Standalone client

How to Test

Installation script

Basically, successfully install AmiGO on a machine and check to see if the installation script lies.

AmiGO software page

Should contain proper links to all features not included in the menu bar.

IEAs

Term Enrichment

Check and make sure that term enrichment is properly using the IEAs.

General Check

Check and make sure that the new database build is working as expected. While we were trying to get it to work we had issues with gene product count, species, and the graph. While these seem to be working now, browse around and make sure that everything is in working order.

Visualize

We need to test the unified graphing backend.

Term Enrichment

Make sure that the visualization feature of TE works properly.

Browser

When browsing the ontology, check to make sure that the "Graphical View" link works as expected.

Homolset

Make sure that the homolset graphs appear as expected.

Standalone Client

Make sure that standard input and advanced input give the proper results with both SVG and PNG.

Testers

  • Installation script (simulate.pl)
  • AmiGO software page
  • IEAs (problem areas)
    • Term enrichment
    • Gene product count
    • Species
  • Visualize
    • Term enrichment
    • Browser
    • Homolset
    • Standalone client

Things to Remember

Beyond checking functionality and correctness of the results, here are some other things to keep in mind while testing:

  • Please check for consistency in terminology (i.e. "ref genome" vs. "homolog" vs. "equivalog").
  • Travel paths that are less travelled and use inputs that you might not normally use
  • Do things quicker/more carelessly than usual
  • Opening multiple sessions or windows and juggling between them
  • Clicking multiple controls and backtracking
  • How do things work in other web browsers; is it accessible

Another thing to try is fuzz testing. Basically trying random inputs in an effort to break the program. This would be random things in the URL and inputs. Usually this is automated, but we probably won't have something like that until more of the new AmiGO framework is written.

Along a similar vein is actively trying to break the system given that some of the internal structure is known. This can include things like entering MySQL statements (the bottom layer of AmiGO) in order to try and trick AmiGO into executing an inappropriate statement. Errors found along these lines are very important for the developers to fix quickly.

Finally, there is load testing; where you might try and overload the system. This probably won't be very useful or informative while running on the toy server.

Sites to Test

AmiGO