owned this note
owned this note
Published
Linked with GitHub
# Use Case Testing form - uc0008
### Reminders: Test on [staging](https://app-staging.nih-cfde.org/)! Test in incognito browser!!
**Reviewer**: Abhijna Parigi
**OS (including version)**: MacOS 10.15.7
**Browser (including version)**: Google Chrome Version 88.0.4324.150 (Official Build) (x86_64)
**Use case**: [UC-0008](https://use-cases.nih-cfde.org/uc-0008/)
**Review type**: manual
**Role groups**: NIH CFDE Kids First Submitters
# Use Case Test
<details><summary>Instructions</summary>
<p>
I would like each use case checked by at least two people. Preferably with a mix of browsers and OS, so that we have a better chance of spotting potential bugs.
1. Choose a use case that you will validate
2. Copy the text from the next comment into a new document
3. Follow the use case, filling out the document as you go
4. If you encounter one of the Quick Tests, check that it is right and check it off. If you don't encounter it as part of your use case, leave it blank. If it doesn't work, add some text explaining the problem
5. When you are done with your use case, post your filled form as a comment in this thread
I recommend starting by looking at the Quick Tests section and seeing which ones will be part of your use case so you can check them as you go instead of backtracking at the end
</p>
</details>
## Use Case Description
**1. Evaluate the description.**
- Does this description make sense?
- Does it sound like a useful thing to do?
- Are there any corrections that should be made (spelling, grammar, etc)?
**2. Try to complete the steps as they are described for the persona in the use case.**
<details><summary>Instructions</summary>
<p>
For each step record:
- the specific action you took, for e.g. I clicked on 'leg' in the 'anatomy' filter at [this web address]()
- Whether that action was possible/worked
- Whether the *results* of that action are as described
- and if they are not as described, how they differ
- Any other comments you have, or things you were surprised about. Be specific!
Copy the lines below as many times as needed for your use case
</p>
</details>
Action: I went to the portal home page and clicked on "Data Review". This opened a new tab called Submitted Datapackages.
- [x] Worked
- [x] Results as expected
- If not, why not:
- Other Comments
Action: Then I entered a name in the "Submitting User" filter's search. There's no one called Kristen as expected. I don't know who is from KF in this list so I'm going to use a different filter
- [x] Worked
- [x] Results as expected
- If not, why not:
- Other Comments
Action: I went to the "Submitting DCC" filter and clicked on The Gabriella Miller Kids First Pediatric Research Program filter.
- [x] Worked
- [ ] Results as expected
- If not, why not: I expected to see one or two submission by a single person
- there are 20 submissions!
- Other Comments: I'm going to be Nickolaus Saint because that's the most recent submission.
Action: I found the latest sumbission based on the time stamp in submission: 2021-02-12 10:33:55 (ID db4e96f2-6d60-11eb-9754-17335d75072b) then clicked the icon next to the submission in the View column.
- [x] Worked
- [x] Results as expected
- If not, why not:
- Other Comments: I happened to click on the view icon as a starting point. But this was not an obvious choice. I'm particularly confused by the Review content options I see in the Status Summary column.
Action: Checked the number of data files: 79312
- [x] Worked
- [x] Results as expected
- If not, why not:
- Other Comments
Action: Checked the number of subjects: 12,276
- [x] Worked
- [x] Results as expected
- If not, why not:
- Other Comments
Action: Checked the number of data types:7. Then clicked on the view icon next to it to look at the data types.
- [x] Worked
- [ ] Results as expected
- I was routed to this page.
- It tells me that the name of the table is data_type but there's no way of checking what the data types there are.
![](https://i.imgur.com/cwA2ljH.png)
- I clicked on the "content ready" hyperlink.
![](https://i.imgur.com/MI0h4Vm.png)
- This looks like another submission view table and has yet another data_type row.
- Other comments: see answer to the first question in the overall comments section below.
Action: Checked how many anatomy terms are represented: 14. Could not find which anatomy terms are represented in this view.
- [x] Worked
- [x] Results as expected
- If not, why not:
- Other Comments: see answer to the first question in the overall comments section below.
Action:
- [x] Worked
- [x] Results as expected
- If not, why not:
- Other Comments: see answer to the first question in the overall comments section below.
Action:
- [x] Worked
- [x] Results as expected
- If not, why not:
- Other Comments: see answer to the first question in the overall comments section below.
Action: What Project names are associated with her DCC? I went back to the page that [lists the submitted data packages](https://app-staging.nih-cfde.org/chaise/recordset/#registry/CFDE:datapackage/*::facets::N4IghgdgJiBcDaoDOB7ArgJwMYFM6JHQBcAjdafEAYQDEARAURABoQowiwAHMLAazABzHAH0kaEgFsAlkSLSIgkVCxYRAMz44AniAC6AX1YAlAJJ19rLAAsU03EkoBmACwBBfUeTpseBKGIyNAoEanomVnZOHn4hUXEpWXlFETQkHAwNLV1DE3NLEBs7B2cABQBNT0MgA@sort(submission_time::desc::,RID)) to the ["Browse Data" hyperlink](https://app-staging.nih-cfde.org/chaise/recordset/#26/CFDE:file@sort(RID)) associated with the data submission. Then I used the filters on the left to find "project". Clicked on "Show More". Got a list of 16 projects associated with my submission.
- [x] Worked
- [x] Results as expected
- If not, why not:
- Other Comments: I wish there was a browse data option on the view submission table. It would be easier if i didn't have to go back to the submissions list to do this.
Action: How many biosamples are in those Projects?
There are two ways to access this info:
- On the [view submission page](https://app-staging.nih-cfde.org/chaise/record/#registry/CFDE:datapackage/RID=4PC), i saw that there were 17,088 biosamples.
![](https://i.imgur.com/hc9pinm.png)
- On the [browse data page](https://app-staging.nih-cfde.org/chaise/recordset/#26/CFDE:file@sort(RID))
there are 17,083 records
![](https://i.imgur.com/vkwl0sv.png)
On the [Summary Charts page](https://app-staging.nih-cfde.org/dcc_review.html?catalogId=26), there are 17,088 again.
![](https://i.imgur.com/eieQ19T.png)
- [x] Worked
- [x] Results as expected
- If not, why not:
- Other Comments: see answer to the first question in the overall comments section below.
Testing other fields:
- subject in submission view: 12,276
- subject in browse data view: 12,276
- subject in summary charts view: 12,276
- file in submission view: 79,312
- file in browse data view: 79,312
- file in summary charts view: 79,312
Only biosample appears to be wonky!
---
How many data types are in those Projects?
Action:
- I went to the projects filter on [this page](https://app-staging.nih-cfde.org/chaise/recordset/#26/CFDE:file@sort(RID)) and selected all projects with some value.
- Then I went to the assay type filter, clicked on show details and round that there were 3 assay type: WGS, exome seq and RNA seq associated with these projects.
- I could also select a single project and see what data type was in that project with the same method.
- [x] Worked
- [x] Results as expected
### Testing user permissions functionality
If you are a Reviewer or Submitter, please try the following and document with screenshots (including computer clock):
Submitter:
- [ ] On the "Submitted Datapackage" page, I can click the pencil icon --> NO
- [ ] I can edit 1 or more field(s) for the Submitted Datapackage - please specify which field(s)
- I can't edit any fields and I don't see any buttons to do so
- I don't even know where I might look for an edit button
- [ ] I can change the "DCC Approval Status" --> NO
It says decision pending:
![](https://i.imgur.com/cYjoZnx.png)
WHen I click on the hyperlink next to DCC approval, it takes me to this page (looks like the first page, so actions are circular)
![](https://i.imgur.com/aoNguWR.png)
## Tasks for this use case:
1. Based on the description you walked through, does this list of tasks make sense? If not, why not? Are there missing tasks? Unused tasks? Task descriptions that don't quite match the workflow? Be specific both about which tasks and their specific problems.
The authentication task should be the fist one on the list.
Applies to all summarize tasks:
- the number of a thing (e.g. biosamples, files, etc) is easy to find. But the data submission viewer does not give details about the types of the thing. Users need to go back one step and navigate to the browser view and look through the filters to find this information. I found this process cumbersome and would have preferred it if the information about "types of a thing" could be made available from the data submission viewer page.
- missing task: Summarize all biosamples hosted by CF Program X
2. **OPTIONAL (if not already addressed above):**
Check whether each general task works, regardless of whether the specific instance described in the description works.
<details><summary>Instructions</summary>
<p>
For each task record:
- the specific action you took, for e.g. I clicked on 'leg' in the 'anatomy' filter at [this web address]()
- note that tasks are generally broader than the description, so you likely will need to do more than one action to test it
- Whether that action was possible/worked, i.e. was it technically possible to do?
- Whether the *results* of that action are what you expect, i.e. did it 'work' in the way a user would want
- and if they are not as described, how they differ
Copy the lines below as many times as needed for your use case
</p>
</details>
Action:
- [ ] Worked
- [ ] Results as expected
- If not, why not:
- Other Comments
Action:
- [ ] Worked
- [ ] Results as expected
- If not, why not:
- Other Comments
## Requirements for this use case:
1. Based on the description you walked through and it's tasks, does this list of requirements make sense? If not, why not? Are there things you needed but are not listed as requirements? Unused requirements? Requirement descriptions that don't quite match the workflow? Be specific both about which requirements and their specific problems.
Checking if these are in the requirements:
- [ ] How many data files exist for her DCC overall?
- [x] How many subjects are represented?
- [ ] How many and which data types are represented?
- [x] How many and which anatomy terms are represented?
- [x] What Project names are associated with her DCC?
- [x] How many biosamples are in those Projects?
- [x] How many data types are in those Projects?
Unused requirements:
- r-00007: The C2M2 model will support information relating assay types to CF programs
- r-00008: The catalog will store information relating assay types to CF programs
- r-00018: The interface will support the selection of a CF Program of interest
- This should be unnecessary because as a KF data reviewer i should only see KF data
Requirements that need to be added:
- C2M2 model will store information relating biosamples to Projects in a CF program
- C2M2 model will store information relating data types to Projects in a CF program
- C2M2 model will store information relating data files to CF programs
- C2M2 model will store information relating data types to CF programs
2. **OPTIONAL (if not already addressed above):**
Check whether each requirement works, if possible, regardless of whether the specific instance described in the description works.
<details><summary>Instructions</summary>
<p>
For each requirement record:
- the specific action you took, for e.g. I clicked on 'leg' in the 'anatomy' filter at [this web address]()
- note that requirements are very broad, so you may need to do more than one action to test it
- if you can't find a way to test the requirement, record that and why
- Whether that action was possible/worked, i.e. was it technically possible to do?
- Whether the *results* of that action are what you expect, i.e. did it 'work' in the way a user would want
- and if they are not as described, how they differ
</p>
</details>
Action:
- [ ] Was not testable
- [ ] Worked
- [ ] Results as expected
- If not, why not:
- Other Comments
Action:
- [ ] Was not testable
- [ ] Worked
- [ ] Results as expected
- If not, why not:
- Other Comments
# Overall
What difficulties did you encounter while completing your use case?
- I would like there to be a clear way to link number of a thing (in my Submitted Datapackage summary table) to type of a thing.
- For example: There are 7 data types in my submission but I don't know what data types there are. I tried clicking on the "Explore data" button on the "View Submission" page (right of table).
![](https://i.imgur.com/UAljd6t.png)
- This took me to a new page with a set of filters on a left
![](https://i.imgur.com/HSrHljE.png)
- I can select data_type (as shown in the above figure). But there is no way to get to which data types are in the portal from this review page.
- I could find this information by going back to the [list of submissions page](https://app-staging.nih-cfde.org/chaise/recordset/#registry/CFDE:datapackage/*::facets::N4IghgdgJiBcDaoDOB7ArgJwMYFM6JHQBcAjdafEAYQDEARAURABoQowiwAHMLAazABzHAH0kaEgFsAlkSLSIgkVCxYRAMz44AniAC6AX1YAlAJJ19rLAAsU03EkoBmACwBBfUeTpseBKGIyNAoEanomVnZOHn4hUXEpWXlFETQkHAwNLV1DE3NLEBs7B2cABQBNT0MgA@sort(submission_time::desc::,RID)) and clicking on the "Browse Data" option under "Status Summary".
These are the 7 data types.
![](https://i.imgur.com/6X9A2gH.png)
These are the 14 anatomy terms:
![](https://i.imgur.com/YDsndUt.png)
Did you see any spelling, grammar or similar mistakes on any resource you visited in completing your use case?
No
What other comments or questions do you have about your use case?
No
What other comments or questions do you have about any of the resources you visited?
What feedback do you have about this form/testing process?
# Quick Tests
Complete test if it is encountered as part of your use case.
- If test works/work is complete check the box.
- If you don't encounter the test during your use case, leave it blank
- If test does not work/work is not complete, note the issue. Be specific!
[Link to QA screens for reference](https://drive.google.com/file/d/11-SVyGzTsKy5Ke8o6s_lFE6LCF_BrJ2a/view)
Home page
- [x] Download button style now matches wireframe
- [x] chart in upper right corner reflects data
- [x] Color Palette is updated
Dashboard
- [ ] "Select Data view" box present to show which dashboard graphs are available
- [ ] Download button style now matches wireframe
- [ ] Timestamp for data missing
DCC Review
- [ ] Numbers have links ---> not sure what numbers we are talking about
- [ ] Scroll bar in Data Review table ---> don't see this
Registry
- [ ] [Spelling correct](https://github.com/nih-cfde/cfde-deriva/issues/131)
Navbar
- [ ] Bolded option in navbar when page is selected
- [ ] Log out button styles
- [ ] Locks next to Dashboard and Data Review links missing
- [ ] Color Palette