# Philip/Jon Running Notes

[](https://hackmd.io/nwmsyBkHQ8ygh0EvDmCpww)

## 2024-06-25
###### tags: `2024-Summer-check-in`
### Things done in last 6 months
- SkellyTracker
- Enjoying more architecture level work
- Tested/built out more trackers
- Started Multiperson work
- Have 2 object, 2 camera working
- Blender work with Andres
- Generally understanding the Blender code better
- Generalizing Mediapipe
- Camera shopping for Ben

#### Things proud of
- Multiperson
- SkellyTracker
- Generalizing Mediapipe
- Getting better at architecture level work
- Figuring out deeper math/geometry stuff
- Writing more tests
- Pyapp groundwork - updating was very easy

### Plans/Goals for the next six months
- more involved in skellycam/js (freemocap 2??) stuff
- Align on SkellyCam work when return from trip
- Working multiperson based on epipolar geometry
- Have the surrounding work in place, then we can iterate on it from there
- Mediapipe Generalized (running YOLO, OpenPose through FreeMoCap)

### ...next year
- Realtime proof of concept / realtime at some FPS
- Having a main architecture/data models stable enough to optimize
- Working on new calibration code (at least optimized triangulation, maybe in Rust)
- Having another maintainer separate from a developer
- Someone to just review and comment on PRs, look through code, check on issues and bugs
- Ideally knowledgeable about software, but doesn't need much domain specific stuff

(copied from last checkin)
### ...next 2 years
- full time employment at >$100k (or part time at >$100k???)
- someone that you're teaching/training - a wee mentee of some kind
- Very solid "staff" level skill/knowledge at software

### ...next 5 years
- Live somewhere more permanently / own land / have a cat or garden / have the financial stability to do the above
- working as a kind of "technical lead" style person

### ...next 10 years
- Above but more
- semi-indendently funded to pursue your own sub-interests under the happy umbrella of freemocap foundation

## 2024-02-20
###### tags: `2024-Spring-check-in`

### Things done in last 6 months
- skelly tracker integration
- Process Recording Folder update
- Major logging changes
- Multiprocessing improvements
- Finally merging reprojection error filtering
- PyApp stuff
- Wrangling the FreeMoCap server
- Continuing to get good at CI/CD GH Actions DevOps stuff

#### Things proud of
- Fixed a lot of long lasting pain points
- Skelly tracker generally
- Process recording folder
- Getting packaging "solved"

### Plans/Goals for the next six months
- Working with Ben Scholl
- working towards adding fancy features
- realtime
- multi-person
- Computer hardware/software diagnostics
- been playing with SkellyCam options and strats and whatnot
- Finish "~1.2" goals
- Getting multiple trackers working

### ...next year
- More money
- something like ~$60k-ish would be nice
- funding through contract work or small grants
- More time to look at slackline data
- Have built something meaningful in low level language

### ...next 2 years
- full time employment at >$100k (or part time at >$100k???)
- someone that you're teaching/training - a wee mentee of some kind
- Very solid "staff" (beyond junior) level skill/knowledge at software

### ...next 5 years
- Live somewhere more permanently / own land / have a cat or garden / have the financial stability to do the above
- working as a kind of "technical lead" style person

### ...next 10 years
- Above but more
- semi-indendently funded to pursue your own sub-interests under the happy umbrella of freemocap foundation

## 2023-10-05
###### tags: `2023-Summer-check-in`

### Things done in last 6 months
- A whole lot of freemocap development
- SkellySynchronize working
- with illumination method
- Did cool stuff with SkellyTracker YOLOTracker
- Reprojection filtering stuff
- bunch of UX/UI fixes, patches, improvements, etc
- Pyinstaller things
- Charuco groundplane things, fixing some anipose bugs
- Went to SciPy 2023
- Made `mkdocs` page for slackline project
- Lots of work managing the FreeMoCap server
- Getting simulated slackline data and comparison to real data

### Things proud of
- Contributing a lot to FreeMoCap
- feeling like real cool hacker guy software man
- deep debugging, learning to read error messages, learning to navigate other people's code
- Jon appreciates philips role in the server
- Reprojection filtering code
- starting to write a proper algorithm
- Pyinstaller adventures!
- into the deep deep guts of code at the interface of software/hardware

### Plans/Goals for the next six months

- More involved in Architecture level
- Working on SkellyTracker
- Handling bigger software projects
- Career prep stuff
- looking for additional work
- another part time software job
- Some kind of public sharing of 'pop sci' level version of slackline output
- Get mocap of someone highlining

### Plans/Goals for the next 1 year
- Be making tech money while working remotely and having freedom
- Doing bigger freemocap software stuff
- Slackline project published somewhere

### Plans/Goals for the next 2 year
- Jon says - philip is working for full-time scratch at freemocap/skellytech
- Have a loooot of knowledge about the slackline biomechanics control theory etc stuff
- Have published a book on slackline rigging

### Plans/Goals for the next 5 year

- Strong stable foundation of professional skills/income/lifestyle

### Plans/Goals for the next 10 year
- Not have to do tech if I don't want to (own the means of ~~production~~ living)

## 2023-01-19
###### tags: `2023-winter-check-in`

### Things done in the past 6 months
- Got up and running state space analysis
- Developed cart and pendulum physical model
- Recorded a bunch of freemocap slackline sessions
- Continuing to do lit review stuff
- Started working with Steve Heim more
- Worked on FreeMoCap Ethics statement

### Things proud of

- Cool state space visualization video
- Balance a cart-pole with initial conditions from real session (even though constraints were pretty weak)
- building deeper understanding of the physical/comptuation dynamics relevant to slackline task

### Plans/Goals for the next six months
- Getting a more complete physical model with Steve
- Also that has more realistic constraints
- Getting a research output (some form of conclusion drawn)
- Improving visualization
- Streamlined/More Aesthetic
- Easier to understand
- folded into (or derived from) `skelly_view` package
- Integrate video sync (and YOLO crop?) methods into freemocap core gui
- As part of push to learn more professional scale 'software development' skills
- Apply for moneys from
- Google Summer of Code
- Epic MegaGrant

### Plans/Goals for the next 1 year

- Get code skills to the point where can routinely contribute to `freemocap` project directly
- Learning/internalizing best practices
- Some kind of communicated scientific output from slackline project
- Conference paper/poster
- publication of some kind
- Just some kind of encapusalted research output that has been shared with people outside of the lab
- Some kind of public sharing of 'pop sci' level version of slackline output
- e.g. honing the visualization of the data to a point that a lay person can see it and get something out of it
- able to be interesting to a specialist but graspable by someone without domain specific knowledge
- actually get highline mocap recording
- preliminary data for potential neuroscience about fear and motor control
- probably won't be able to do much with it (with respect to deep insights), besides just noting differences

### Plans/Goals for the next 2 year

- Find some form of reliable funding to support more research
- possibly through HuMoN lab funding/grants
- possibly through FreeMoCap/ISA joint ventures of some kind
- Start thinking about the highline vs lowline research questions
- i.e. nervous system regulation (fear) effects on full body motor control/balance
- Transition from understanding one foot standing to walking (single pendulum -> double pendulum, or static vs dynamic balance)
- Make teaching slackline classes sustainable, financially

### Plans/Goals for the next 5 year
- Finding some clarity about 'career-level' life path kinds of questions
- choosing sub-specialities
- reliable enough income to think about home ownership and whatnot
- e.g. software development jobs to support nomadic lifestyle
- Potential to keep in research path through some kind of big, NIH scale grant (or other form of external funding)
- Finding ways to get life stabilizing levels of money from slackline activities
- ISA stuff
- Rigging stuff
- research stuff
- etc

### Plans/Goals for the next 10 year
- living somewhere cool, doing something cool
- maintaining high freedom lifestyle with sufficient stability for comfort
- in some kind of leadership-ish position over a specific (constrained) project/domain that you care about

---
## 2022-07-22
###### tags: `2022-summer-check-in`

### Things done in the past 6 months
- specific stuff done
- Attended Dynamic Walking
- Attended Rocky Mountain ASB
- Recorded freemocap slackline stuff
- Built some cool matplotlib 3d skels and plotted videos and whatnot
- Made the video sync method
- Did a great job assisting with the freemocap server management
- Drafted freemocap Ethics statement
- literature research
- skills developed
- python
- learning to make scripts/software, not just one off algorithms
- getting started with computer vision
- getting started with data visualization (2d/3d plotting and animation)
- Getting more familiar with Github
- Learning markdown/effective note taking
- Learning about biomechanics and Center of Mass type stuff

### Things proud of
- Slackline Animation - both plotting and understanding the biomechanics a bit
- Getting the video synch script going from full noobishness
- Gathering understanding of the literature/conference topics

### Things to work on

- Get an understanding of more professional software practices
- PR based github workflow
- breaking things up into separate files and importing classes/functions

- Get slackline work more structured
- Make roadmaps
- Choose/follow direction
- Clearer end goal (ebventually get to a publication)
- Reintegrate Kiley however she can fit in

- Figure out some kind of physical modeling
- Python acrobot?
- Mujoco?
- Blender?
- just learning raw ODE solvers?
- goal is figure out slackrobot

### Plans/Goals for the next six months
- Get the Slackline project "up and running"
- maybe have a pilot subject with data analyzed
- Have some kind of physical modelling applied to slackline data
- Have the time sync code integrated into `freemocap-core` software

---
---