---
# System prepended metadata

title: Untitled

---


## youtube

- API: http://youtube-captions.herokuapp.com/search?q=electromagnet
- UI: https://wordnerd.fun/electromagnet#videos
- inspiration: youglish.com
- 10K vidoes gathered so far
- youtube API is constricted. many discovery methods are now deprecated.
- youtube scraping gets throttled (very well)
- lots of shitty clickbait videos collected so far, despite intentions to collect educational content
- gender bias in video collection so far. mostly dudes :{
- scraping is only option for getting AI transcripts
- 25% of transcripts gathered so far are human generated
- machine transcripts are one big long lowecase string with no punctuation. impossible to get a good sample sentence.

## mongodb

- flexible
- not using mongooose yet
- mongodb Compass desktop app much faster than Atlas site

## moby-thesaurus.org

- 1000 requests per hour
- analytics showing much lower numbers (ad blockers, duckduckgo, bots?)
- added a banner to funnel traffic to wordnerd; innefective so far

## challenges

- performance is not great
- maybe mongo indexing needs refinement
- cache more! PS caching is hard
- break content up? separate URL paths per result type (/:query/definitions, /:query/videos, etc)
- no tests yet. still feels a little early for tests
- 

## ideas

- create your own glossary
- commercial product for students, teachers, schools
- other product idea: printed custom maps with translation markers