owned this note
owned this note
Published
Linked with GitHub
# Part 2 - Data Storage and Organization
# Group 1
1. **Storage**
- Where do you tend to store raw data you've collected? (e.g., personal computer hard disk)
- locally
- cloud
- What are some of the challenges you face when storing your raw data? (e.g., limited capacity)
- the data isn't always stored in the same place
- google drive, onedrive, teams, dropbox
- cybersecurity
- university sometimes prevents access to networked resources
- storage limits
- TB of data vs GB limits
2. **Organization**
- How do you tend to organize raw data as you are collecting it (or after you collect it), and where did that organizational practice come from?
- by file name in different folders
- by user name
- whatever's easiest
- by date/day
- by flight/session
- one big file
- What are some issues that an organizational strategy has addressed or causes for you (or others)?
- analysis
- some people prefer python, others prefer R
- cost of learning new language
- as long as the data is documented and accessible analysts can work in whatever language they prefer
- easy to lose data or create redundant work if hierarchy is not clear or if collaborator can't find the work
- people can get blocked on not being able to find a document
- data that is too disseminated can be hard to discover/search through
# Group 2
1. **Storage**
- Where do you tend to store raw data you've collected? (e.g., personal computer hard disk)
- onedrive, harddrive, cloud,
- What are some of the challenges you face when storing your raw data? (e.g., limited capacity)
- storage
- organization
- accessing from different computers
- wrong format
- variable labels
- different versions
- types of operating systems
- some specific softwares for some type of data
2. **Organization**
- How do you tend to organize raw data as you are collecting it (or after you collect it), and where did that organizational practice come from?
- by date
- by year, categories if time series or panel
- folder,
- separating raw and processed
- older us
- from team members
- the university
- What are some issues that an organizational strategy has addressed or causes for you (or others)?
- data corruption
- different softwares- some use licensed version some free
- user authorization
- codes by some members cannot be run by other team members
-
# Group 3
1. **Storage**
- Where do you tend to store raw data you've collected? (e.g., personal computer hard disk)
- What are some of the challenges you face when storing your raw data? (e.g., limited capacity)
2. **Organization**
- How do you tend to organize raw data as you are collecting it (or after you collect it), and where did that organizational practice come from?
- What are some issues that an organizational strategy has addressed or causes for you (or others)?
# Group 4
1. **Storage**
- Where do you tend to store raw data you've collected? (e.g., personal computer hard disk)
- What are some of the challenges you face when storing your raw data? (e.g., limited capacity)
2. **Organization**
- How do you tend to organize raw data as you are collecting it (or after you collect it), and where did that organizational practice come from?
- What are some issues that an organizational strategy has addressed or causes for you (or others)?
# Group 5
1. **Storage**
- Where do you tend to store raw data you've collected? (e.g., personal computer hard disk)
- What are some of the challenges you face when storing your raw data? (e.g., limited capacity)
2. **Organization**
- How do you tend to organize raw data as you are collecting it (or after you collect it), and where did that organizational practice come from?
- What are some issues that an organizational strategy has addressed or causes for you (or others)?