QATR 4.0
27 Apr 1997

Test of Final Build (Completed April 27, 1997)

Testing Methodology: Each new web page link [in this case, the new bibliography, "Lessons Learned," and "unique materials" (term papers) web sections, as well as new navigation buttons at the top of each page of the web site] has been subjected to the following tests: connectivity (can it connect to the indicated URL?); readability (can I read the page once connection is established?); and operation /download capability (once linked, can I manipulate the functionality at the "linked" site. If it has document download capability, can I download a readable copy of the document?). Download is marked "N/A" if the site has no download capability (other than saving display as an HTML file).

The final build phase test also served as the customer acceptance test. For acceptance purposes, all internal and (primary) external web site links were rechecked for correct functionality. (Secondary and tertiary linkages were spot checked; download capabilities were not checked.) In addition, another complete bulletin board functionality check was accomplished. A fuller description of test methodology is provided in paragraph 4.0 of QATR.FINAL.

Test Results: With one exception, the existing web page meets minimum SRS Final Build and acceptance test requirements. All defects noted during Build 3 testing have been corrected. All external links functioned properly, allowing test team to connect and correctly navigate within external sites. All primary internal site links functioned properly, allowing test team to connect and correctly navigate between site pages. Bulletin board functionality was satisfactorily demonstrated by posting an initial test message, followed by two nested responses. In each case, the reader could access and read the selected message, and post a response to same; the bulletin board then correctly posted the message or response.

The exception: a Build 3 error, concerning the ability to link to an internal web subpage, continued to manifest itself during acceptance test. The problem: when navigating to a subsection of the page, while the correct subsection URL is displayed, the browser takes you to the top of the selected page. The reader can scroll down to the correct section, and all other functionality is not impacted (ie, can download from the section, can navigate to other links, etc). Further testing showed that the problem occurs only with the test browser (MS Internet Explorer V3.01a), and that the problem is intermittent (no particular preconditions have been identified to cause either consistent successful or unsuccessful linkage to the targeted section). (This error was confirmed by a test using the same browser version on a different test platform, thus ruling out possible platform or platform configuration induced errors). This error does not occur with those Netscape browser versions available to the team. Other browsers are not available to determine their sublink navigation behavior.

Program Manager will have to confer with customer to ascertain product suitabiltiy with this known discrepancy.

Test Results Summary Table

ITEMConnect Readable Ops/Dnld SublinkSublink SublinkRisk
ConnectReadable Ops/Dnld Related
Site Cover Page (C1)
Y
Y
Y/NA
Y
Y
Y/NA
Y
*** Intro Risk Mgmt (4.6.4.)
Y
Y
Y
Y
Y
Y
Y
*** Team Project Documents (R1)
1. Team Member Roles
Y
Y
Y
N/A
N/A
N/A
N/A
2. Requirements Management Plan
2a. REQM 21.Apr.97
Y
Y
Y
Y
Y
Y
N/A
2b. RQMP.FINAL
Y
Y
Y
Y
Y
Y
N/A
2c. RQMP 1.1
Y
Y
Y
Y
Y
Y
N/A
2d. RQMP 1.0
Y
Y
Y
Y
Y
Y
N/A
3. SW Reqmnts Spec
3a. SRS.FINAL
Y
Y
Y/Y
N/A
N/A
N/A
N/A
3b. SRS 3.0
Y
Y
Y/Y
N/A
N/A
N/A
N/A
3c. SRS 2.0
Y
Y
Y/Y
N/A
N/A
N/A
N/A
3d. SRS 1.0
Y
Y
Y/Y
Y
Y
Y
N/A
3e. SRS 0.0
Y
Y
Y/Y
Y
Y
Y
4. Risk/Risk Mgmt Plan
4a. RSKP.FINAL
Y
Y
Y/NA
N/A
N/A
N/A
NA/
4b. RSKP 2.0
Y
Y
Y/NA
N/A
N/A
N/A
NA/
4c. RSKP 1.3
Y
Y
Y/NA
N/A
N/A
N/A
N/A
4d. RSKP 1.2
Y
Y
Y/NA
N/A
N/A
N/A
N/A
4e. RSKP 1.1
Y
Y
Y/NA
N/A
N/A
N/A
N/A
4f. RSKP 1.0
Y
Y
Y/NA
Y
Y
Y/NA
N/A
4f. RSKP 0.0
Y
Y
Y/NA
Y
Y
Y/NA
N/A
5. Work Breakdown Structure
Y
Y
Y/NA
N/A
N/A
N/A
N/A
5a. WBS.28.APR.97.2
Y
Y
Y/NA
N/A
N/A
N/A
N/A
5b. WBS.28.APR.97.1
Y
Y
Y/NA
N/A
N/A
N/A
N/A
5c. WBS 21.APR.97.3
Y
Y
Y/NA
N/A
N/A
N/A
N/A
5d. WBS 21 APR.97.2
Y
Y
Y/NA
N/A
N/A
N/A
N/A
5e. WBS 21.APR.97.1
Y
Y
Y/NA
N/A
N/A
N/A
N/A
5f. WBS 31.MAR.97
Y
Y
Y/NA
N/A
N/A
N/A
N/A
5g. WBS 25 FEB 97
Y
Y
Y/NA
N/A
N/A
N/A
N/A
5h. WBS 24 FEB 97
Y
Y
Y/NA
N/A
N/A
N/A
N/A
5i. WBS 22 FEB 97
Y
Y
NA
N/A
N/A
N/A
N/A
5j. WBS 19 FEB 97
5k. WBS 14 FEB 97
5l. WBS 11 FEB 97
Y
Y
NA
N/A
N/A
N/A
N/A
6. SW Proj Mgmt Plan
6a. SPMP.FINAL
Y
Y
Y/NA
Y
Y
Y/NA
NA
6b. SPMP 1.0
Y
Y
Y/NA
Y
Y
Y/NA
NA
6c. SPMP 0.0
Y
Y
Y/NA
Y
Y
Y/NA
NA
7. S/W Design Doc
7a. SWD.FINAL
Y
Y
Y/NA
N/A
N/A
N/A
N/A
7b. SWD 2.0
Y
Y
Y/NA
N/A
N/A
N/A
N/A
7c. SWD 1.0
Y
Y
Y/NA
N/A
N/A
N/A
N/A
7d. SWD 0.0
Y
Y
Y/NA
N/A
N/A
N/A
N/A
8. QA / Test Plan
8a. QATR 3.0
Y
Y
Y/NA
N/A
N/A
N/A
N/A
8a. QATR 2.0
Y
Y
Y/NA
N/A
N/A
N/A
N/A
8b. QATR 1.0
Y
Y
Y/NA
N/A
N/A
N/A
N/A
8c. QATP 1.0
Y
Y
Y/NA
N/A
N/A
N/A
N/A
9. Config Mgmt Plan
9a. CMP.FINAL
Y
Y
Y/NA
Y
Y
Y/NA
N/A
9b. CMP 1.1
Y
Y
Y/NA
Y
Y
Y/NA
N/A
9c. CMP 1.0
Y
Y
Y/NA
Y
Y
Y/NA
N/A
10. Status Report
10a. RSR 31.MAR.97
Y
Y
Y/NA
N/A
N/A
N/A
10b. PSR 24 MAR 97
Y
Y
Y/NA
Y/NA
Y/NA
Y/NA
10c. RSR 3 MAR 97
Y
Y
Y/NA
N/A
N/A
N/A
*** Risk Mgmt Bulletin Board (4.6.2.)
Y
Y
Y/NA
Y
Y
Y/NA
Y
*** Bibliography (4.8.2.) - Final Build
Y
Y
Y/NA
Y
Y
Y/NA
Y
*** Levity Section (4.7.2.)
Y
Y
Y/NA
Y
Y
NA
*** Lessons Learned Section (4.8.3.) -- Final Build
Y
Y
Y/NA
Y
Y
NA
*** Final (Term) Papers (4.8.1.) -- Final Build
Y
Y
Jordan
Y
Y
Y/NA
Y
Y
NA
May
Y
Y
Y/NA
Y
Y
NA
McNeese
Y
Y
Y/NA
Y
Y
NA
Miller
Y
Y
Y/NA
Y
Y
NA
Mirantes
Y
Y
Y/NA
Y
Y
NA
Mundell
Y
Y
Y/NA
Y
Y
NA
Young
Y
Y
Y/NA
Y
Y
NA
*** Related Sites (4.6.3.)Connect ReadableOps/Dnld Sublink Sublink SublinkRisk
ConnectReadable Ops/Dwd Related
Risk Relate Sites
1. Managing Stds V3.5 Risk Mgmt
Y
Y
Y/NA
Y
Y
Y/NA
Y
2. ProjectNet
Y
Y
Y/NA
Y
Y
Y/NA
Y
3. SW Engr Institute
Y
Y
Y/Y
Y
Y
Y/NA
Y
3a. Featured Publications of SEI (R3)
Y
Y
Y/NA
Y
Y
Y/NA
3b. SEI Risk Program
Y
Y
Y/NA
Y
Y
Y/NA
Y
3c. SEI SW Engr Risk Repository
Y
Y
Y/Y
Y
Y
Y/Y
Y
3d. SEI Conf on Risk Mgmt
Y
Y
Y/NA
Y
Y
Y/NA
Y
3e. SEI Continuous Risk Guidebook
Y
Y
Y/NA
Y
Y
Y/NA
Y
4. SW Risk Mgmt @ ASU ( R4 )
Y
Y
Y/NA
Y
Y
Y/NA
Y
5. Risk and Competitive Advantage
Y
Y
Y/NA
Y
Y
Y/NA
Y
5a. Risk Bibliography
Y
Y
Y/NA
Y
Y
Y/NA
N
5c. Proj Risk Bibliography
Y
Y
Y/NA
Y
Y
Y/Y
Y
6. Quantitative SW Mgmt - Risk Mgmt Strategies
Y
Y
Y/NA
Y
Y
Y/NA
Y
7. Quantitative Risk & Policy Analysis Guide
Y
Y
Y/NA
Y
Y
Y/NA
Y
General SPM Sites
8. HMS Software
Y
Y
Y/NA
Y
Y
Y/NA
N
8a. S/W White Papers
Y
Y
Y/NA
Y
Y
Y/NA
N
8b. PM Resources
Y
Y
Y/NA
Y
Y
Y/NA
N
8c. SW PM Articles
Y
Y
Y/NA
Y
Y
Y/NA
N
9. Key practices of CMM
Y
Y
Y/NA
Y
Y
Y/NA
N
9a. Lvl 2-Proj Tracking
Y
Y
Y/NA
Y
Y
Y/NA
N
10. Practical SW Measurement
Y
Y
Y/NA
Y
Y
Y/NA
N
11. Config Mgmt Yellow Pages
Y
Y
Y/NA
Y
Y
Y/NA
N
12. NASA IV&V Facility Home Page
Y
Y
Y/NA
Y
Y
Y/NA
N
12a. IV&V Related Links
Y
Y
Y/NA
Y
Y
Y/NA
N
13. Software Productivity Consortium
Y
Y
Y/NA
Y
Y
Y/NA
N
*** Tools (4.7.3.) (E2)
1. Tools and Models Index
Y
Y
Y/NA
Y
Y
Y/NA
2. Automated Cost Estimating Integrated Tools (ACEIT)
Y
Y
Y/NA
Y
Y
Y/Y
3. Project Management Products
Y
Y
Y/NA
Y
Y
Y/NA
3a. Welcom Software Technology
Y
Y
Y/NA
Y
Y
Y/NA
4. Seven Management Tools
Y
Y
Y/NA
Y
Y
Y/NA
4a. Risk from the Perspective of Competitive Advantage
Y
Y
Y/NA
Y
Y
Y/NA
5. Cost Track
Y
Y
Y/NA
Y
Y
Y/NA
5a. OnTrack Engineering, LTD
Y
Y
Y/AN
Y
Y
Y/AN
*** Other SWSE 625 Team Sites
1. ACDFGHIK
Y
Y
Y/NA
Y
Y
Y/NA
N/A
2. BE
Y
Y
Y/NA
N/A
N/A
N/A
N/A
3. LNOPQR
Y
Y
Y/NA
Y
Y
Y/NA
N/A
4. STUVWXZ
Y
Y
Y/NA
Y
Y
Y/NA
N/A
*** WEB Searches on Risk Mgmt (4.6.5.)
Y
Y
Y/NA
Y
Y
Y/NA
N/A

Prefix Legend

(D) -- error;

(D) -- defect;

( C ) -- comment;

( R ) - regression test item

*** -- Major Requirement Descriptor (Note: the related WBS numeric identifier comes in parentheses immediately following the descriptor)

Notes

1. Version numbering convention conflicts from previous builds have been resolved. In group discussion following Build 3 results, it was determined that all previous draft version numbering conventions would remain fixed, since all of these documents were now under configuration control. A standard numbering convention was adopted and would be adhered to for all future updates and final version. This closes Build 3 defects 2-6.

2. (E) Functional specification (search engines) links to the "software project management sites" section instead of "search engines" section. This problem occurs intermittently, and appears to be a browser problem instead of a site problem. See test results section for further information.

3. ( R ) Error E10 from build 3 has been corrected.

4. ( R ) "Error" E14 from build 2 has been corrected.

Software Project Management / Comments? / Back / Last updated: April 30, 1997