BPI Acceptance Test – Examples

The following is an example of the results from an Independent Verification and Validation (IV&V) of a Human Resources Information System. External Consultant conducted IV&V (or Acceptance Test) for a Public Services Client.

Logistic Information Technology Centre,

Chief of Staff - Human Resources

INDEPENDENT VERIFICATION AND VALIDATION TEST REPORT FOR AN INTEGRATED HUMAN RESOURCES INFORMATION

MANAGEMENT SYSTEM

Revised Draft

November 17, 2012

HUMAN RESOURCES INFORMATION MANAGEMENT SYSTEM

TEST REPORT

TABLE OF CONTENTS

1.     Summary Report of System Anomalies   

   

2.     Testing on Phase I of IHRIMS   

   

2.1     Description of Testing and Results:   

   

2.2     Login screen   

   

2.3     Gains Management   

   

2.4     Civilian Employee Information Management   

   

2.5     Military Employee Information Management   

   

2.6     Training Budget   

   

2.7     Position Information Management   

Summary Report of System Anomalies

Date: November 16, 2012	Modules Tested: Login,Civilian and Military Employee Information Management, Position Information Management, Gain Management, Training Budget
Test Conducted: Screen manipulations	Test Conducted By: XXXXXXX
Description of Testing and                 Results:
All forms listed under modules tested were put through general operation testing. Checked to see if the screen could be called up using the menu options available, and then verified that data could be entered and saved     on the forms. All function buttons available on the screen were checked to verify operations (this includes items such as the Locate, Cancel, Save, Exit, etc.). Also, tried entering some incorrect data to see if the system would accept the entries. In general, the information entered could not be saved to the tables. This impacted the level and degree of testing. As a result of problems saving data to the tables, the focus of the system discrepancies was on formatting and consistency between screens. Some forms could not be tested, since there function was dependent upon successfully entering data in another screen. For instance, the Gain and Loss Management screens were not successfully tested since there was difficulty entering information in the Position Information forms. The developers did make some modifications so that information could eventually be saved in the Position tables, however, information is still not being saved on Personnel.                                 As is to be expected in initial testing, all of the modules tested failed to operate as fully expected. This information has been relayed to the developers and modifications are currently underway.
Number of Tests Conducted:
Number of Deficiencies Detected: 46
Number of Pass:	Percentage of Pass:
Number of Failures:	Percentage of Fail: 100
Modules Passed	Modules Failed: All
Comments: (Discussion of progress as a result of testing, Analysis of the Pass/Fail Results, Impact of tests and discrepancies on system implementation):                      See the attached pages for a detailed description of the discrepancies found on each form.

Testing on Phase I of IHRIMS

Description of Testing and Results:

Initial testing consisted of general operation of the system. Logging into the IHRIMS system and moving from form to form using the menu options. Attempted to add test data in each screen to determine if information was being accepted by each of the forms and to determine if the information should have been accepted by the particular screen. For example, tested to ensure that the system would not allow the user to input new employee information anywhere the Gain Management screen. The tests to add new information to the tables and save the data all failed. Since data could not be added to the tables during initial testing, the majority of the anomalies noted below are format oriented.

General Note:

On all screens the position of the field that the cursor is on is very difficult to read, can the field that the cursor is on be highlighted as a different colour to enhance the visibility? (This was done on the Gain Management Screen)

Login screen

Type of Discrepancy	Solution
Spelling error	Change “Integrated” to Integrated
Time required to load the Beta model is extensive	This is due to the current set-up of downloading information from the CSC office, this should be corrected in the future

Gains Management

Type of Discrepancy	Error Messages	Solution
Security Field	Requires an entry	This field should allow Null values
Fix the Text labels next to the input fields	** The format for labeling fields should be consistent across all screens. Either use the label and box on all screens or remove it from all.	The title of the fields are displayed on background boxes - the boxes should be fixed to match the length of the text
The fields are not in sequential order when tabbing through the screen		The cursor skips a fields after the effective date, and if the user tabs backwards the cursor stops after the effective date and will not allow the user to continue tabbing backwards.
No military Grades are included in the pull down list	** The method for inputting grades should be consistent across all screens. On some screens this is an input field and on some     screens it’s a pull down field.	Add an option     “O-” and “E-” to the grade pull down menu.        Allow the user to enter values     from E-1-E-9 and O-1 - O-9
The Series field is required		This field should allow Null values (Military personnel do not have a series).
Once the cursor is placed in the bottom half of the screen it isn’t possible to move back to the top half of the screen
After entering Position Information, tried to add an employee through Gain Management. Received an error message	ORACLE error Unable to insert record	After the error message displayed - the cursor was moved to the effective date field. Tried varying the values entered in this date with no success.
PP, Series and grade		These fields need to be displayed consistently among all forms.

Civilian Employee Information Management

Type of Discrepancy	Error Messages	Solution
Cannot change the value in the pull-down field for minority status	Error message received “Cannot navigate out of the current block in enter query mode
On Exit Receive an additional message	Message appears on exiting the query when hitting the exit     button	Hide this message behind the scenes so the user does not have to respond to the additional question
Cannot Save information on this screen	“FRM40735; PRE-INSERT trigger raised unhandled exception ORA-02289”	Error message received since information required by the tables was not entered yet. Need to be able to store information to the tables.
Date on Station field is too small		Need to expand the width of the field to include a full 8 character date (12/12/2012)
Error trying to enter information in the Minority Status and Rotation Date fields	Cannot Navigate out of current block in enter query mode FRM 41047
After receiving the above error message, cannot use the tab key to move around the screen but can use the mouse to get into some fields
There is no check on the way dates are entered into the system		Can all date fields be formatted to ensure consistency in entering data?
On prior system demonstrations there was a check to ensure consistency between the command and the component this was not working.

Military Employee Information Management

Type of Discrepancy	Error Messages	Solution
Cannot add Military Grades		The Grade field should be a 4 character field with the Civilian Grades listed (0-15) and the Military Grades as “E-*” or “O-*” *Military grades run from E-1-E-9 and O-1-O-9
Cannot change the value in the pull-down field for minority status	Error message received “Cannot navigate out of the current block in enter query mode
In the “Keys” display box - The colours and font are very difficult to read		Increase the font size or change the background colours on the display field
Date of Birth - Needs to be entered as month/day/yr		Pre-format the field to a date field
Menu Option fields - Explain the difference between the Block and Field options
Define the difference between the options Count Hits and Fetch Next Set

Training Budget

Type of Discrepancy	Error Messages	Solution
Tuition Field isn’t formatted		Format the field to allow the user to enter a dollar amount without having to enter the commas and decimal places
The Tuition field should be expanded to allow for dollar amounts up to 5 digits plus a 2 decimal places		Expand the field to a width of 9.

Position Information Management

Type of Discrepancy	Error Messages	Solution
Can’t add Position titles to the screen	PRE_INSERT trigger raised unhandled exception ORA-02289	(*11/15/2012 5pm Able to add this information)
Move the location of the Edit button at the top of the screen		The Edit function should be grouped with the block Locate, Cancel Add...
Office Symbol - the text description for the field should be repositioned so the full text can be seen
Command List in the pull down menu is incomplete		Add the full list of command descriptions to this pull down field. (A full listing is shown on the Civilian Employee Info, form)
MPCN	Required field	This should allow Null values
Security Clearance	Required field	This should allow Null values
CPCN	Required field	This should allow Null values
Career, Financial, and Position Valid Radio buttons don’t match the format of the screen		Change the font to match the font displayed on the remainder of the screen.
Position Field looks like a data entry field		This is supposed to be a system generated number - it should be shown as a background display only field
Cannot save information on the screen	“FRM40735; Pre-Insert trigger raised unhanded exception ORA-02289”
Military grades can’t be entered in the grade field	WHEN-VALIDATE ITEM triggers failed on field POSITION.GRADE	Expand the acceptable grade categories to include military grades E-1-E-9 and O-1-O-9
The grade field is valid only for single digits		Expand the acceptable grades to include 1-15
Component and Command mismatch, the system allows the user to enter a command that does not match the component		Add the Error message sequence that is shown on the Civilian Employee Information screen to all screens that have both the Component and the Command.

Position Information Management (con’t.)

Type of Discrepancy	Error Messages	Solution
Acquisition Skill field allows only one valid entry,     “Contracting” for all other selections an error message appears	WHEN-VALID-ITEM triggers failed on field
There are two position description boxes shown at the bottom of the screen with true false buttons following -		The order on the True/False radio buttons should be the same beside each box. It currently displays as True/False next to one and False/True next to the other.
Problem saving information on this form	Receive a message that the record has already been inserted - but when searching for the information cannot retrieve the record.
The Position Information Management and the Position Management Forms are the same		These should be two different forms
The Series field is shown as a three digit number		If there are only three digits in a series it is to be displayed with a leading zero.
When trying to locate information on the screen the user hits the Locate button, after entering data the user must select the locate button again		Is it possible to allow the user to hit “enter” after typing an entry to begin locating the record?
After entering data on the screen and selecting some “False”     options on the radio buttons - we exited the screen reentered and pulled up the record. All of the radio buttons had gone back to “True” and information selected in the Command field was blank