owned this note
owned this note
Published
Linked with GitHub
# Change History
[Dogfooding](https://deviq.com/practices/dogfooding) is to run through as many relevant user scenarios as possible. Ideally, the individual scenarios work perfectly as intended. The reason it's important that we go through this process is to ensure the feature is ready for production. The purpose of internal testing is to identify potential gaps or defects so that items can be resolved prior to release.
## Capturing deficiencies
It's best that we document any issues that we discover in as much of a uniform standard as possible so that upon later review, we're able to parse the individual instances as easily as possible for potential translation to tech debt/tech improvement Jira tickets. </br>
Here's the template that we've decided to use for this session. So the goal is to fill it our for each individual discovery as throroughly as possible to capture the maximum amount of information on the particular issue:
### Issue 1
1. Description of issue -> The form validation box that displays when no selection is made is larger than the selection box
2. Expected result (what **should've** occurred) -> Validation box should be the same width as the selection box
3. Actual result (what **did** occur) -> Larger form validation displays over the selection
4. Steps to reproduce - Add condition and attempt to generate the task report without making a selection for the condition
5. Severity (**low**: minimal/non-blocking, **medium**: potentially blocking, **high**: significant blocker/work stoppage)
5. Relevant screenshot(s)
* 
### Issue 2
1. Description of issue -> Spelling of 'Please' in Add condition form validation
2. Expected result (what **should've** occurred) -> Please make a selection or remove this condition
3. Actual result (what **did** occur) - Plase make a selection or remove this condition
4. Steps to reproduce - Add condition and attempt to generate the task report without making a selection for the condition
6. Severity **high**
7. Relevant screenshot(s)
* 
### Issue 3
1. Description of issue ->
2. Expected result (what **should've** occurred) ->
3. Actual result (what **did** occur)
4. Steps to reproduce
5. Severity (**low**: minimal/non-blocking, **medium**: potentially blocking, **high**: significant blocker/work stoppage)
5. Relevant screenshot(s)
* screenshots are easy to add to hackMD, simply capture the shot you want on your machine, then drag and drop it into the doc like so:!
### Issue 4
1. Description of issue ->
2. Expected result (what **should've** occurred) ->
3. Actual result (what **did** occur)
4. Steps to reproduce
5. Severity (**low**: minimal/non-blocking, **medium**: potentially blocking, **high**: significant blocker/work stoppage)
5. Relevant screenshot(s)
* screenshots are easy to add to hackMD, simply capture the shot you want on your machine, then drag and drop it into the doc like so:!
### Issue 5
1. Description of issue ->
2. Expected result (what **should've** occurred) ->
3. Actual result (what **did** occur)
4. Steps to reproduce
5. Severity (**low**: minimal/non-blocking, **medium**: potentially blocking, **high**: significant blocker/work stoppage)
5. Relevant screenshot(s)
* screenshots are easy to add to hackMD, simply capture the shot you want on your machine, then drag and drop it into the doc like so:!
## Possible fixes needed
Tech-debt issue:
## Users
| Tester | Scenario | User ID | Pass/Fail |
| -------- | ------- | -------- |-- |
|Oluchi|1|CF_Q_397 | :heavy_check_mark:
|Dilyara|2 |CF_Q_283|:heavy_check_mark:
|Dillon|3|CF_MCCOY_317|:heavy_check_mark:
|Heather|4| CF_KIRK_283|:heavy_check_mark:
|Brandon|5|CF_PICARD_283|:yellow_heart: (issues 1&2)
|Prajwal|6|CF_DATA_283|:heavy_check_mark:
|Clay|7|CF_RIKER_283|:heavy_check_mark:
|Craig|8|CASEFLOW_317|:heavy_check_mark:
|Heather|9|CF_KHAN_283|:heavy_check_mark:
extra ids: 987654613, 666045250, 456978269, 561349914, 612301365, 700032667
extra users: CASEFLOW_317 [317], DUCHENE_W_RVSR [373], VBAWASGORDOJ [328],
## Scenario outcome indicators:
* Pass :heavy_check_mark:
* Pass with noted issue :yellow_heart:
* Failed :x:
# Scenarios
## Scenario 1 - Non-admin access to ‘Generate task report’ page
1. Sign in as your assigned user
2. Navigate to https://appeals.cf.uat.ds.va.gov/decision_reviews/vha/
3. Ensure the "Generate report" button does not exist
4. Manually enter the URL bar and go to https://appeals.cf.uat.ds.va.gov/decision_reviews/vha/report, it should generate a Drat page that reads "You aren't authorized to use this part of Caseflow yet." text
## Scenario 2 - Admin navigation to 'Generate task report' page
1. Sign in as your assigned user
2. Navigate to https://appeals.cf.uat.ds.va.gov/decision_reviews/vha
3. Ensure the "Generate report" button exists
4. User clicks the button and the page moves to https://appeals.cf.uat.ds.va.gov/decision_reviews/vha/report
5. Press the back button
6. User manually enters https://appeals.cf.uat.ds.va.gov/decision_reviews/vha/report in the URL bar and the page moves the Generate task report page
## Scenario 3 - Select 'Event/Action' report type for All Event/Action
1. On the Generate task report Page, select Event/Action from the Report type drop down
2. "All Events/Action" should be autoselected
3. Leave the Timing Specification as is
4. In Conditions click "Add Condition" once
5. Press the Generate Report button
6. Ensure that form validation happens when a user adds a conditon but does not select an option from the drop down
7. In Conditions click "Add Condition" till the button is greyed out
8. For each condition select the follow the following options
9. Variable select "Personnel"
10. Variable select "Days waiting"
11. Variable select "Decision Review Type"
12. Variable select "Issue Type"
13. Variable select "Issue Disposition"
14. Press the generate report button and ensure form validation happens for each item
15. For each condition select the following options
16. In the "Personnel" condtion from the drop down and select any VHA member
* 16a. After a VHA has been chosen the name should no longer appear on the list until removed via single removal or group removal
* 16b. After "Personnel" is selected verify that "Facility", is no longer s choice in the drop down
17. In the "Days Waiting" condition and for the Time range select "More than" from the time range and enter 0 in number of days
18. In the "Decision Review type" conditon tick the HLR box
19. In the "Issue type" condition select any of the options form the drop down
* 19a. After an Issue type has been chosen the option should no longer appear on the list until removed via single removal or group removal
20. In the "Issue Disposition" condition select any of the options from the drop down
* 20a. After an Issue Disspostion has been chosen the option should no longer appear on the list until removed via single removal or group removal
21. Click the Generate button in the bottom right of the page
22. Verify that all fields no longer have the red form validation text
23. Verify that a CSV is generated and downloaded automatically
24. Verify contents of CSV matches the content that was chosen(For example if HLR is only ticked then in the Claim type column then only HLR should show in the Claim type)
## Scenario 4 - Removal of condition with 'Event/Action' report type for All Event/Action
1. On the Generate task report Page, Select Event/Action from the Report type drop down
2. "All Events/Action" should be autoselected
3. Under the Timing Specification in the Range drop down selector select "After" from the drop down
4. Try to select a date in the future wit the date selector and ensure that it does not happen
5. Manually type in a date in the future
6. Press the generate button and ensure that form validation happens
7. Under the Timing Specification in the Range drop down selector select "None" from the drop down
8. In Conditions click add condition till the button is greyed out
9. For each condition select the follow the following options
10. Variable select "Personnel" from the drop down and select atleast 3 VHA members
11. Remove one of the VHA members via the "x" next the the name
12. Remove the rest of the VHA members with the group X next to the drown down arrow
13. Variable "Decision" Review type tick the HLR box and the SC box
14. Variable Issue type and select more atleast 3 of the options form the drop down
15. Remove one of the Issue types via the "x" next the the Issue type
16. Remove the rest of the Issue types via the group "x" next to the down arrow
17. Variable Issue Dispostion and select any of the options form the drop down
18. Remove one of the Issue Disposition via the "x" next disposition
19. Remove the rest of the Issue Disposition via the group "x" next to the down down arrow
20. Click Remove condition on one or more of the conditions
21. ReAdd the condition that was removed, ensure that the data was cleared
22. Generate a task report
23. Verify contents of CSV matches the content that was chosen(For example if HLR is only ticked then in the Claim type column then only HLR should show in the Claim type)
## Scenario 5 - Select 'Event/Action' report type for Specific Event/Action
1. On the Generate task report Page, Select Event/Action from the Report type drop down
2. "All Events/Action" should be autoselected
3. Select the "Specific Event/Action " radio button
4. Select at least 1 Event/Action by ticking the box next to a Event/Action
5. Under the Timing Specification in the Range drop down selector select "between" from the drop down
6. In the "from" date box choose a date thats is not a future date
7. In the "to" date box choose a date that is before the "from" date
8. Click the generate report button
9. Form validation happens in the "to" date box that reads "End date must be greater than the start date"
10. Change the date in the "to" date box to before the "from" date box
11. In Conditions click add condition till the button is greyed out
12. For each condition select the follow the following options
13. Variable select "Facility" from the drop down and select any VHA facility
* 13a. After a VHA Facility has been chosen the Facility should no longer appear on the list until removed via single removal or group removal
* 13b. After "Facility" is selected verify that "Personel", is no longer a choice in the drop down
14. Variable "Days Waiting" and in Time range select "Between" from the time range and enter 2 in min days and 1 in max days
15. Click Generate task report button
16. Ensure form validation happends as max days cannot smaller than min days
17. Change min days to 0 and max days to any number greater then 0
18. Variable Decision Review type tick the SC box
19. Variable Issue type and select any of the options form the drop down
* 19a. After an Issue type has been chosen the option should no longer appear on the list until removed via single removal or group removal
20. Variable Issue Disspostion and select any of the options form the drop down
* 20a. After an Issue Disspostion has been chosen the option should no longer appear on the list until removed via single removal or group removal
21. Click the Generate button in the bottom right of the page
22. Verify that a CSV is generated and downloaded automatically
23. Verify contents of CSV matches the content that was chosen(For example if HLR is only ticked then in the Claim type column then only HLR should show in the Claim type)
## Scenario 6 - Select 'Status' report type for All statuses
1. On the Generate task report Page, Select Status from the Report type drop down
2. "All Statuses" should be autoselected as aradio button
3. "Last Action Taken" under "Select type of status report" should be autoselected
4. In Conditions click add condition till the button is greyed out
5. For each condition select the follow the following options
6. Variable select Personnel from the drop down and select any VHA member
* 6a. After a VHA has been chosen the name should no longer appear on the list until removed via single removal or group removal
7. Variable Days Waiting and in Time range select "More than" from the time range and enter 0 in number of days
8. Variable Decision Review type tick the HLR box and the SC box
9. Variable Issue type and select any of the options form the drop down
* 9a. After an Issue type has been chosen the option should no longer appear on the list until removed via single removal or group removal
10. Variable Issue Disspostion and select any of the options form the drop down
* 10a. After an Issue Disspostion has been chosen the option should no longer appear on the list until removed via single removal or group removal
11. Click the Generate button in the bottom right of the page
12. Verify that a CSV is generated and downloaded automatically
13. Verify contents of CSV matches the content that was chosen(For example if HLR is only ticked then in the Claim type column then only HLR should show in the Claim type)
## Scenario 7 - Removal of condition with 'Status' report type for All statuses
1. On the Generate task report Page, Select "Status" from the Report type drop down
2. "All Statues" should be autoselected
4. In Conditions click add condition till the button is greyed out
5. For each condition select the follow the following options
6. Variable select Personnel from the drop down and select atleast 3 VHA members
7. Remove one of the VHA membrs via the "x" next the the name
8. Remove the rest of the VHA members voe the group X next to the drown down arrow
9. Variable Decision Review type tick the HLR box and the SC box
10. Variable Issue type and select more atleast 3 of the options form the drop down
11. Remove one of the Issue types via the "x" next the the Issue type
12. Remove the rest of the Issue types via the group "x" next to the down arrow
13. Variable Issue Dispostion and select any of the options form the drop down
14. Remove one of the Issue Disposition via the "x" next disposition
15. Remove the rest of the Issue Disposition via the group "x" next to the down down arrow
16. Click Remove condition on one or more of the conditions
17. ReAdd the condition that was removed, ensure that the data was cleared
18. Generate a task report
19. Verify contents of CSV matches the content that was chosen(For example if HLR is only ticked then in the Claim type column then only HLR should show in the Claim type)
## Scenario 8 - Select ‘Status’ report type -> Specific statuses
1. On the Generate task report Page, Select Status from the Report type drop down
2. "All Statuses" should be autoselected
3. Select "Specific Status"
4. Do not select any status yet Press the Generate Report Button
5. There should be a validation that reads "Please select at least one option"
6. User selects any of the Specific statuses
7. "Last Action Taken " under "Select type of status report" should be autoselected
8. Select "Summary"
9. In Conditions click add condition till the button is greyed out
10. For each condition select the follow the following options
11. Variable select Personnel from the drop down and select any VHA member
* 11a. After a VHA has been chosen the name should no longer appear on the list until removed via single removal or group removal
12. Variable Days Waiting and in Time range select "More than" from the time range and enter 0 in number of days
13. Variable Decision Review type tick the HLR box and the SC box
14. Variable Issue type and select any of the options form the drop down
* 14a. After an Issue type has been chosen the option should no longer appear on the list until removed via single removal or group removal
15. Variable Issue Disspostion and select any of the options form the drop down
* 12a. After an Issue Disposition has been chosen the option should no longer appear on the list until removed via single removal or group removal
16. Click the Generate button in the bottom right of the page
17. Verify that a CSV is generated and downloaded automatically
18. Verify contents of CSV matches the content that was chosen(For example if HLR is only ticked then in the Claim type column then only HLR should show in the Claim type)
## Scenario 9 - Validation for no result report
1. On the Generate task report Page, Select Event/Action from the Report type drop down
2. "All Events/Action" should be autoselected
3. For Timing Specification choose "Before" and select a year before 1600
4. Click Generate report
5. Ensure CSV generated is empty except for the for 2 rows