PILLAR 3: Research/Discovery Pillar

# PILLAR 3: Research/Discovery Pillar ## When and How to Join: - January 25, 2023, Wednesday, 11:00 AM - [Microsoft Teams - click to join](https://teams.microsoft.com/l/meetup-join/19%3ameeting_ODQ5ZjhiOTYtMGRmNy00NGIwLTljYjAtYzRiZDk1ZjdiODVm%40thread.v2/0?context=%7b%22Tid%22%3a%222ab5d82f-d8fa-4797-a93e-054655c61dec%22%2c%22Oid%22%3a%2265bb417d-8d6c-42c2-993f-54bfb1df0b66%22%7d) Meeting ID: 239 923 148 191 Passcode: zsW6tE Or call in (audio only) +1 443-339-4347,,175307137# - January 30 - April 6, 2023 (**weekly**, on Monday at 1:00PM) [Microsoft Teams - click to join](https://teams.microsoft.com/l/meetup-join/19%3ameeting_YTJjNWFiM2YtYjEwZi00NzRhLTg0MjMtNWQ0N2ZlZjQ4ODgy%40thread.v2/0?context=%7b%22Tid%22%3a%222ab5d82f-d8fa-4797-a93e-054655c61dec%22%2c%22Oid%22%3a%2265bb417d-8d6c-42c2-993f-54bfb1df0b66%22%7d) Meeting ID: 224 063 653 399 Passcode: daPtV3 Or call in (audio only) +1 443-339-4347,,161513952# --- ## ## Table of Content 1.[Meeting purpose](#Meeting-Purpose) 2.[Meeting #1 01/25/2023](#Meeting-1-01252023) 3.[Meeting #2 02/06/2023](#Meeting-2-02062023) ## Meeting Purpose: Review all action items of the Discovery Pillar, with a central fcous on the items with a deadline: **Jan 31 or Feb 1st, 2023** ### Pillar Description and Indicators - Discovery to accelerate usability for the community: (Michaela/Chris) a. 100% research product (output) is “signed off” by both Technical and Strategic Directors in 75% of topics. b. 50% of research products are linked to a development issue at the end of the first research cycle. ### Pilar Action Items i. Establish and distribute published process and workflow for research by 1/31/23. (Chris) #### DOCUMENT: [Proposed repository](https://github.com/usnistgov/OSCAL-Research) ii. Establish approach for documentation of research that does not get lost in day-to-dahttps://hackmd.io/w-CacC0ySDaT8nmXGBHY_w?edit#y development with review/approvals by 1/31/23. (Chris) #### DOCUMENT: [Proposal](https://github.com/usnistgov/OSCAL-Research/blob/prototype-candidate/getting-started/GUIDED-TOUR.md) iii. Develop a standard decision-making process/rubric (inclusive of space for engineering testing) for prioritizing and evaluating features inclusive of community input by 1/15/23 with the review and validation of an advisory board. (Process should be designed to avoid duplication and enable development efficiency). (Sanjay, David F) #### DOCUMENT: Word document provided via email. iv. Track research topics, assignments, cycle, feedback, and close date through 12/31/23 to establish median (velocity over time) and evaluate engagement. (Michaela) #### DOCUMENT: NONE - This is an ongoing activity that needs to produce conclusive material by 12/31/23. The action item (track to establish median) relies on the implementation of other action items: - 3.i - 3.ii - 3.v - 3.vi - 3.vii v. Establish a backlog and labels for research topics by 1/31/23 inclusive of monthly reviews thereafter. (AJ) #### DOCUMENT: [Proposal -TBD](TBD) vi. Establish Internal & External communication strategy: Research Roundtable for backlog prioritization and review by 3/31/23. (Michaela, Chris) #### DOCUMENT: [Proposal-TBD](TBD) vii. Develop External communication platforms inclusive of presentation of findings & collaborative investigation by 3/31/23. (Chris, Wendell) #### DOCUMENT: [Proposal-TBD](TBD) - This action item is not totally disjoined from 3.i and 3.ii which are worked together --- ### Other Material: - [OSCAL SP (for Obsidian) ](https://nistgov-my.sharepoint.com/:f:/r/personal/miorga_nist_gov/Documents/_OSCAL%20ELP%20Strategic%20Plan/OSCAL%20SP?csf=1&web=1&e=Dyd5Wa) - [OSCAL SP.xlsx (project plan style)](https://nistgov-my.sharepoint.com/:x:/r/personal/miorga_nist_gov/Documents/_OSCAL%20ELP%20Strategic%20Plan/OSCAL%20Strategic%20Plan.xlsx?d=w4221560c40cb43a68d25f8a4d48b85ec&csf=1&web=1&e=beqVJt) --- ## ## Meeting #1: 01/25/2023 ## **Generic agenda:** review the status of all action items under implementation/development, identify dependencies, roadblocks to completion, next actions and how the team can help **Participants:** Michaela, AJ, Chris, Wendell (quorum [x]) ### Specific topics to be discussed - Please provide any high-priority topic here (we will start the discussion with those topics): NO ADDITIONS ### Minutes: (volunteer minutes taker: AJ - thank you for taking over. sorry for having DoS induced tech issues) iii. Develop a standard decision-making process/rubric (inclusive of space for engineering testing) for prioritizing and evaluating features inclusive of community input by 1/15/23 with the review and validation of an advisory board. (Process should be designed to avoid duplication and enable development efficiency). (Sanjay, David F) #### Deadline: 1/15/23 #### STATUS: In progress, past deadline (deadline update suggested) #### ACTION: Please participate in the 01/25/2023 @12:00PM ET meeting where Jay will present his proposal. i. Establish and distribute published process and workflow for research by 1/31/23. (Chris) #### Deadline: 1/31/23 #### STATUS: In progress #### ACTION: Please review the [proposed repository](https://github.com/usnistgov/OSCAL-Research) - Wendell asked if he should review this document and if his feedback is encouraged or required. - AJ, David has provided feedback via PR, Chris is currently wrapping in changes and feedback. - Chris is progressing through feedback, he will invite the team to a brief, tentatively Friday or Monday. ii. Establish approach for documentation of research that does not get lost in day-to-day development with review/approvals by 1/31/23. (Chris) #### Deadline: 1/31/23 #### STATUS: In progress #### ACTION: Please review the [proposal](https://github.com/usnistgov/OSCAL-Research/blob/prototype-candidate/getting-started/GUIDED-TOUR.md) - Chris created an example in [the PR to initialize the research repository currently under review](https://github.com/usnistgov/OSCAL-Research/pull/1) as discussed and covered in 3.i v. Establish a backlog and labels for research topics by 1/31/23 inclusive of monthly reviews thereafter. (AJ) #### Deadline: 1/31/23 #### STATUS: In progress #### ACTION: [Proposal -TBD](TBD) - AJ and Chris agreed to review items in the backlog relevant for the research progress. - AJ and Chris will sync up later this week and later next week, it appears it can be on schedule. vi. Establish Internal & External communication strategy: Research Roundtable for backlog prioritization and review by 3/31/23. (Michaela, Chris) #### Deadline: 3/31/23 #### STATUS: TODO (Will start in 02/23) #### ACTION: [Proposal -TBD](TBD) vii. Develop External communication platforms inclusive of presentation of findings & collaborative investigation by 3/31/23. (Chris, Wendell) #### Deadline: 3/31/23 #### STATUS: TODO #### ACTION: [Proposal -TBD](TBD) - This action item is not totally disjoined from 3.i and 3.ii which are worked together iv. Track research topics, assignments, cycle, feedback, and close date through 12/31/23 to establish median (velocity over time) and evaluate engagement. (Michaela) #### Deadline: 12/31/23 #### STATUS: TODO #### ACTION: - - This is an ongoing activity that needs to produce conclusive material by 12/31/23. The action item (track to establish median) relies on the implementation of other action items: - 3.i - 3.ii - 3.v - 3.vi - 3.vii --- ## ## Meeting #2: 02/06/2023 ## **Generic agenda:** review the status of all action items under implementation/development, identify dependencies, roadblocks to completion, next actions and how the team can help **Participants:** AJ, Chris, Wendell. Michaela (quorum [x]) ### Specific topics to be discussed - A.J. identified that due to staffing changes in the team he will be likely be late on responsible action items ### Minutes: (volunteer minutes taker: AJ ) iii. Develop a standard decision-making process/rubric (inclusive of space for engineering testing) for prioritizing and evaluating features inclusive of community input by 1/15/23 with the review and validation of an advisory board. (Process should be designed to avoid duplication and enable development efficiency). (Sanjay, David F) #### Deadline: 1/15/23 #### STATUS: In progress, past deadline (deadline update suggested) #### DONE: Please participate in the 01/25/2023 @12:00PM ET meeting where Jay will present his proposal. - Michaela reviewed and provided feedback to Sanjay and Dave F. - Sanjay and Dave F were on travel all last week i. Establish and distribute published process and workflow for research by 1/31/23. (Chris) #### Deadline: 1/31/23 #### STATUS: In progress #### ACTION: Please review the [proposed repository](https://github.com/usnistgov/OSCAL-Research) - Michaela: - A second PR was submitted and made availabe for team's review - Office hours (recurrent) were scheduled weekly on Wednesdays, 10AM-12PM - Chris' update: - All current PRs closed, and compiling together into one document - First office hours will be this Wednesday (10AM-12PM) ii. Establish approach for documentation of research that does not get lost in day-to-day development with review/approvals by 1/31/23. (Chris) #### Deadline: 1/31/23 #### STATUS: In progress #### ACTION: Please review the [proposal](https://github.com/usnistgov/OSCAL-Research/blob/prototype-candidate/getting-started/GUIDED-TOUR.md) - Chris created an example in [the PR to initialize the research repository currently under review](https://github.com/usnistgov/OSCAL-Research/pull/1) as discussed and covered in 3.i - Currently working in parallel with i. v. Establish a backlog and labels for research topics by 1/31/23 inclusive of monthly reviews thereafter. (AJ) #### Deadline: ~~1/31/23~~ 2/10/23 #### STATUS: In progress #### ACTION: [Proposal -TBD](TBD) - AJ and Chris agreed to review items in the backlog relevant for the research progress. - AJ and Chris will sync up later this week and later next week, it appears it can be on schedule. Update: - AJ acknowledged he missed the deadlined but had adjusted it last week to 10 February 2023. AJ will coordinate with Chris. vi. Establish Internal & External communication strategy: Research Roundtable for backlog prioritization and review by 3/31/23. (Michaela, Chris) #### Deadline: 3/31/23 #### STATUS: TODO (Will start in 02/23) #### ACTION: [Proposal -TBD](TBD) vii. Develop External communication platforms inclusive of presentation of findings & collaborative investigation by 3/31/23. (Chris, Wendell) #### Deadline: 3/31/23 #### STATUS: TODO #### ACTION: [Proposal -TBD](TBD) - This action item is not totally disjoined from 3.i and 3.ii which are worked together iv. Track research topics, assignments, cycle, feedback, and close date through 12/31/23 to establish median (velocity over time) and evaluate engagement. (Michaela) #### Deadline: 12/31/23 #### STATUS: TODO #### ACTION: - - This is an ongoing activity that needs to produce conclusive material by 12/31/23. The action item (track to establish median) relies on the implementation of other action items: - 3.i - 3.ii - 3.v - 3.vi - 3.vii ## Meeting #3: 02/13/2023 ## **Generic agenda:** review the status of all action items under implementation/development, identify dependencies, roadblocks to completion, next actions and how the team can help **Participants: ** AJ, Chris, Wendell (quorum [x]) ### General Comments and Topic Requests i. Establish and distribute published process and workflow for research by 1/31/23. (Chris) #### Deadline: 1/31/23 #### STATUS: In progress #### ACTION: Please review the [proposed repository](https://github.com/usnistgov/OSCAL-Research) - Putting together presentation for the first meeting on Feb 16 as a general overview. - Need to make one more round of edits based on feedback. - PR Feedback Summary [is here](https://github.com/usnistgov/OSCAL-Research/discussions/9). - Notes from first internal [office hours](https://github.com/usnistgov/OSCAL-Research/discussions/10). - Next office hours on Wednesday. - First public meeting on Thursday. - Would like to prepare and open the OSCAL-Research repository by March 1. ii. Establish approach for documentation of research that does not get lost in day-to-day development with review/approvals by 1/31/23. (Chris) #### Deadline: 1/31/23 #### STATUS: In progress #### ACTION: Please review the [proposal](https://github.com/usnistgov/OSCAL-Research/blob/prototype-candidate/getting-started/GUIDED-TOUR.md) - Chris created an example in [the PR to initialize the research repository currently under review](https://github.com/usnistgov/OSCAL-Research/pull/1) as discussed and covered in 3.i - Currently working in parallel with i. iii. Develop a standard decision-making process/rubric (inclusive of space for engineering testing) for prioritizing and evaluating features inclusive of community input by 1/15/23 with the review and validation of an advisory board. (Process should be designed to avoid duplication and enable development efficiency). (Sanjay, David F) - Per Michaela, we should receive an updated draft from Sanjay soon. v. Establish a backlog and labels for research topics by 1/31/23 inclusive of monthly reviews thereafter. (AJ) #### Deadline: 1/31/23 #### STATUS: DONE #### ACTION: Next steps are TBD, depends on how we will prioritize efforts under this pillar. - Backlog established as a tab in the [NIST OSCAL Work Board](https://github.com/orgs/usnistgov/projects/25/views/18). --- ## ## Meeting #4: 02/21/2023 ## **Generic agenda:** review the status of all action items under implementation/development, identify dependencies, roadblocks to completion, next actions and how the team can help **Participants: ** Chris, Wendell, Michaela (quorum [ ]) ### General Comments and Topic Requests i. Establish and distribute published process and workflow for research by 1/31/23. (Chris) #### Deadline: 1/31/23 #### STATUS: Done #### ACTION: Please review the [proposed repository](https://github.com/usnistgov/OSCAL-Research) - First DEFINE meeting took place! Congratulations! Thank you Chris - RELATE to ii. - waiting for community's feedback (due Friday, 02.24.2023) - csrc website needs to be created, and video process for accessibility and posted - mirror on OSCAL pages - address community's comments by March 3, 2023 - make repo public as a preview ii. Establish approach for documentation of research that does not get lost in day-to-day development with review/approvals by 1/31/23. (Chris) #### Deadline: 1/31/23 #### STATUS: In progress #### ACTION: Please review the [proposal](https://github.com/usnistgov/OSCAL-Research/blob/prototype-candidate/getting-started/GUIDED-TOUR.md) - First DEFINE meeting took place! Congratulations! Thank you Chris. Chris docuemnted follow up actions. - RELATED to i. - waiting for community's feedback (due Friday, 02.24.2023) - csrc website needs to be created, and video process for accessibility and posted - mirror on OSCAL pages - address community's comments by March 3, 2023 - make repo public as a preview iii. Develop a standard decision-making process/rubric (inclusive of space for engineering testing) for prioritizing and evaluating features inclusive of community input by 1/15/23 with the review and validation of an advisory board. (Process should be designed to avoid duplication and enable development efficiency). (Sanjay, David F) - Per Michaela, we should receive an updated draft from Sanjay soon. v. Establish a backlog and labels for research topics by 1/31/23 inclusive of monthly reviews thereafter. (AJ) #### Deadline: 1/31/23 #### STATUS: DONE #### ACTION: Next steps are TBD, depends on how we will prioritize efforts under this pillar. - Backlog established as a tab in the [NIST OSCAL Work Board](https://github.com/orgs/usnistgov/projects/25/views/18). vi. Establish Internal & External communication strategy: Research Roundtable for backlog prioritization and review by 3/31/23. (Michaela, Chris) #### Deadline: 3/31/23 #### STATUS: (Will start in 02/23) #### ACTION: see next - DEFINE meeting is first - CAC participates in the DEFINE - NIST - CAC meets soon (Monday after the Th DEFINE meeting) - need to establish CAC (dependancy) - getting CAC up and running will take few months - we will use CRM Model which is needed. - DEFINE meetings are monthly - meetings were announced - monthly cadence was established vii. Develop External communication platforms inclusive of presentation of findings & collaborative investigation by 3/31/23. (Chris, Wendell) #### Deadline: 3/31/23 #### STATUS: TODO #### ACTION: - This action item is not totally disjoined from 3.i and 3.ii which are worked together iv. Track research topics, assignments, cycle, feedback, and close date through 12/31/23 to establish median (velocity over time) and evaluate engagement. (Michaela) #### Deadline: 12/31/23 #### STATUS: TODO #### ACTION: - - This is an ongoing activity that needs to produce conclusive material by 12/31/23. The action item (track to establish median) relies on the implementation of other action items: - 3.i - 3.ii - 3.v - 3.vi - 3.vii --- ## ## Meeting #5: 03/13/2023 ## **Generic agenda:** review the status of all action items under implementation/development, identify dependencies, roadblocks to completion, next actions and how the team can help **Participants: ** Nikita, Chris, Dmitry, Arminta, Wendell ### General Comments and Topic Requests i. Establish and distribute published process and workflow for research by 1/31/23. (Chris) #### Deadline: 1/31/23 #### STATUS: Done #### ACTION: Please review the [proposed repository](https://github.com/usnistgov/OSCAL-Research) - First DEFINE meeting took place! Congratulations - Chris prepared for the second DEFINE meeting to demonstrate a CRM Model research spiral ii. Establish approach for documentation of research that does not get lost in day-to-day development with review/approvals by 1/31/23. (Chris) #### Deadline: 1/31/23 #### STATUS: DONE #### DONE: [GH Repo](https://github.com/usnistgov/OSCAL-Research/blob/prototype-candidate/getting-started/GUIDED-TOUR.md) - Chris prepared for the second DEFINE meeting to demonstrate a CRM Model research spiral iii. Develop a standard decision-making process/rubric (inclusive of space for engineering testing) for prioritizing and evaluating features inclusive of community input by 1/15/23 with the review and validation of an advisory board. (Process should be designed to avoid duplication and enable development efficiency). (Sanjay, David F) - Per Michaela, we should receive an updated draft from Sanjay soon (Sanjay had family emergency in India). v. Establish a backlog and labels for research topics by 1/31/23 inclusive of monthly reviews thereafter. (AJ) #### Deadline: 1/31/23 #### STATUS: DONE - Backlog established as a tab in the [NIST OSCAL Work Board](https://github.com/orgs/usnistgov/projects/25/views/18). vi. Establish Internal & External communication strategy: Research Roundtable for backlog prioritization and review by 3/31/23. (Michaela, Chris) #### Deadline: 3/31/23 #### STATUS: DONE -(The CAC should help NIST accomplish it) - getting CAC up and running will take few months - Until CAC is established, we will use the OSCAL engineering and DEFINE meetings and the discussion board to gather feedback. vii. Develop External communication platforms inclusive of presentation of findings & collaborative investigation by 3/31/23. (Chris, Wendell) #### Deadline: 3/31/23 #### STATUS: TODO #### ACTION: - This action item is not totally disjoined from 3.i and 3.ii which are worked together - Is anything else not covered by 3.i and 3.ii that is needed here? - How is work under the communication pillar aligned with this? - **To reframe this item, are we asking about means to communicate findings externally for work performed as a part of the research pillar?** - We know we will produce content within the OSCAL-DEFINE repo - Are there other next steps after the repository content is produced? (i.e., NIST publication, other publication?) - How do we formally report the final result of a research effort? - How do we integrate with NIST division publication mechanisms? - Should we set OSCAL-DEFINE repository to publish to pages.nist.gov? - (Would this eventually use ERB/MIDAS for more formal research efforts? Like guidance for industry...) iv. Track research topics, assignments, cycle, feedback, and close date through 12/31/23 to establish median (velocity over time) and evaluate engagement. (Michaela) #### Deadline: 12/31/23 #### STATUS: TODO #### ACTION: - - This is an ongoing activity that needs to produce conclusive material by 12/31/23. The action item (track to establish median) relies on the implementation of other action items: - 3.i - 3.ii - 3.v - 3.vi - 3.vii

Syntax	Example	Reference
# Header	Header	基本排版
- Unordered List	Unordered List
1. Ordered List	Ordered List
- [ ] Todo List	Todo List
> Blockquote	Blockquote
Bold font	Bold font
Italics font	Italics font
~~Strikethrough~~	~~Strikethrough~~
19^th^	19^th
H~2~O	H₂O
++Inserted text++	Inserted text
==Marked text==	Marked text
[link text](https:// "title")	Link
![image alt](https:// "title")	Image
`Code`	`Code`	在筆記中貼入程式碼
```javascript var i = 0; ```	`var i = 0;`
:smile:		Emoji list
{%youtube youtube_id %}	Externals
$L^aT_eX$	L^aT_eX
:::info This is a alert area. :::	This is a alert area.