---
# System prepended metadata

title: Philip/Jon Running Notes
tags: [2023-winter-check-in, 2022-summer-check-in]

---

# Philip/Jon Running Notes

[![hackmd-github-sync-badge](https://hackmd.io/nwmsyBkHQ8ygh0EvDmCpww/badge)](https://hackmd.io/nwmsyBkHQ8ygh0EvDmCpww)

## 2024-06-25
###### tags: `2024-Summer-check-in`
### Things done in last 6 months
- SkellyTracker
    - Enjoying more architecture level work
    - Tested/built out more trackers
- Started Multiperson work
    - Have 2 object, 2 camera working
- Blender work with Andres
    - Generally understanding the Blender code better
- Generalizing Mediapipe
- Camera shopping for Ben

#### Things proud of
- Multiperson
- SkellyTracker
- Generalizing Mediapipe
- Getting better at architecture level work
- Figuring out deeper math/geometry stuff
- Writing more tests
- Pyapp groundwork - updating was very easy


### Plans/Goals for the next six months
- more involved in skellycam/js (freemocap 2??) stuff
- Align on SkellyCam work when return from trip 
- Working multiperson based on epipolar geometry
    - Have the surrounding work in place, then we can iterate on it from there
- Mediapipe Generalized (running YOLO, OpenPose through FreeMoCap)

### ...next year
- Realtime proof of concept / realtime at some FPS
- Having a main architecture/data models stable enough to optimize
- Working on new calibration code (at least optimized triangulation, maybe in Rust)
- Having another maintainer separate from a developer 
    - Someone to just review and comment on PRs, look through code, check on issues and bugs
    - Ideally knowledgeable about software, but doesn't need much domain specific stuff

(copied from last checkin)
### ...next 2 years
- full time employment at >$100k (or part time at >$100k???)
- someone that you're teaching/training - a wee mentee of some kind
- Very solid "staff" level skill/knowledge at software

### ...next 5 years
- Live somewhere more permanently / own land / have a cat or garden / have the financial stability to do the above
- working as a kind of "technical lead" style person 

### ...next 10 years
- Above but more
- semi-indendently funded to pursue your own sub-interests under the happy umbrella of freemocap foundation


## 2024-02-20 
###### tags: `2024-Spring-check-in`

### Things done in last 6 months
- skelly tracker integration
- Process Recording Folder update
- Major logging changes
- Multiprocessing improvements
- Finally merging reprojection error filtering
- PyApp stuff
- Wrangling the FreeMoCap server
- Continuing to get good at CI/CD GH Actions DevOps stuff

#### Things proud of
- Fixed a lot of long lasting pain points
- Skelly tracker generally
- Process recording folder
- Getting packaging "solved"

### Plans/Goals for the next six months
- Working with Ben Scholl
- working towards adding fancy features
    - realtime 
    - multi-person
- Computer hardware/software diagnostics 
    - been playing with SkellyCam options and strats and whatnot
- Finish "~1.2" goals
    - Getting multiple trackers working 

### ...next year
- More money
    - something like ~$60k-ish would be nice
    - funding through contract work or small grants
- More time to look at slackline data
- Have built something meaningful in low level language

### ...next 2 years
- full time employment at >$100k (or part time at >$100k???)
- someone that you're teaching/training - a wee mentee of some kind
- Very solid "staff" (beyond junior) level skill/knowledge at software

### ...next 5 years
- Live somewhere more permanently / own land / have a cat or garden / have the financial stability to do the above
- working as a kind of "technical lead" style person 

### ...next 10 years
- Above but more
- semi-indendently funded to pursue your own sub-interests under the happy umbrella of freemocap foundation


## 2023-10-05
###### tags: `2023-Summer-check-in`

### Things done in last 6 months
- A whole lot of freemocap development
    - SkellySynchronize working
        - with illumination method
    - Did cool stuff with SkellyTracker YOLOTracker
    - Reprojection filtering stuff
    - bunch of UX/UI fixes, patches, improvements, etc
    - Pyinstaller things
    - Charuco groundplane things, fixing some anipose bugs
- Went to SciPy 2023
- Made `mkdocs` page for slackline project
- Lots of work managing the FreeMoCap server
- Getting simulated slackline data and comparison to real data

### Things proud of
- Contributing a lot to FreeMoCap 
    - feeling like real cool hacker guy software man
        - deep debugging, learning to read error messages, learning to navigate other people's code
    - Jon appreciates philips role in the server
- Reprojection filtering code
    - starting to write a proper algorithm
- Pyinstaller adventures!
    - into the deep deep guts of code at the interface of software/hardware

### Plans/Goals for the next six months

- More involved in Architecture level 
    - Working on SkellyTracker
    - Handling bigger software projects 
- Career prep stuff
    - looking for  additional work 
        - another part time software job
- Some kind of public sharing of 'pop sci' level version of slackline output
- Get mocap of someone highlining

### Plans/Goals for the next 1 year
 - Be making tech money while working remotely and having freedom
 - Doing bigger freemocap software stuff
 - Slackline project published somewhere 

### Plans/Goals for the next 2 year
- Jon says - philip is working for full-time scratch at freemocap/skellytech
- Have a loooot of knowledge about the slackline biomechanics control theory etc stuff
- Have published a book on slackline rigging

### Plans/Goals for the next 5 year

- Strong stable foundation of professional skills/income/lifestyle

### Plans/Goals for the next 10 year
- Not have to do tech if I don't want to (own the means of ~~production~~ living)

## 2023-01-19 
###### tags: `2023-winter-check-in`

### Things done in the past 6 months
- Got up and running state space analysis
- Developed cart and pendulum physical model
- Recorded a bunch of freemocap slackline sessions
- Continuing to do lit review stuff
- Started working with Steve Heim more
- Worked on FreeMoCap Ethics statement


### Things proud of

- Cool state space visualization video
- Balance a cart-pole with initial conditions from real session (even though constraints were pretty weak)
- building deeper understanding of the physical/comptuation dynamics relevant to slackline task 

### Plans/Goals for the next six months
- Getting a more complete physical model with Steve
    - Also that has more realistic constraints
- Getting a research output (some form of conclusion drawn)
- Improving visualization
    - Streamlined/More Aesthetic 
    - Easier to understand
    - folded into (or derived from) `skelly_view` package
- Integrate video sync (and YOLO crop?) methods into freemocap core gui
    - As part of push to learn more professional scale 'software development' skills
- Apply for moneys from
    - Google Summer of Code
    - Epic MegaGrant 


### Plans/Goals for the next 1 year

- Get code skills to the point where can routinely contribute to `freemocap` project directly
    - Learning/internalizing best practices
- Some kind of communicated scientific output from slackline project
    - Conference paper/poster
    - publication of some kind
    - Just some kind of encapusalted research output that has been shared with people outside of the lab
- Some kind of public sharing of 'pop sci' level version of slackline output
    - e.g. honing the visualization of the data to a point that a lay person can see it and get something out of it
    - able to be interesting to a specialist but graspable by someone without domain specific knowledge
- actually get highline mocap recording
    - preliminary data for potential neuroscience about fear and motor control
    - probably won't be able to do much with it (with respect to deep insights), besides just noting differences

### Plans/Goals for the next 2 year

- Find some form of reliable funding to support more research 
    - possibly through HuMoN lab funding/grants
    - possibly through FreeMoCap/ISA joint ventures of some kind
- Start thinking about the highline vs lowline research questions 
    - i.e. nervous system regulation (fear) effects on full body motor control/balance
- Transition from understanding one foot standing to walking (single pendulum  -> double pendulum, or static vs dynamic balance)
- Make teaching slackline classes sustainable, financially

### Plans/Goals for the next 5 year
- Finding some clarity about 'career-level' life path kinds of questions
    - choosing sub-specialities
    - reliable enough income to think about home ownership and whatnot
    - e.g. software development jobs to support nomadic lifestyle
    - Potential to keep in research path through some kind of big, NIH scale grant (or other form of external funding)
- Finding ways to get life stabilizing levels of money from slackline activities
    - ISA stuff
    - Rigging stuff
    - research stuff
    - etc

### Plans/Goals for the next 10 year
- living somewhere cool, doing something cool
- maintaining high freedom lifestyle with sufficient stability for comfort 
- in some kind of leadership-ish position over a specific (constrained) project/domain that you care about


---
## 2022-07-22 
###### tags: `2022-summer-check-in`

### Things done in the past 6 months
- specific stuff done
    - Attended Dynamic Walking
    - Attended Rocky Mountain ASB
    - Recorded freemocap slackline stuff
    - Built some cool matplotlib 3d skels and plotted videos and whatnot
    - Made the video sync method
    - Did a great job assisting with the freemocap server management
    - Drafted freemocap Ethics statement 
    - literature research
- skills developed
    - python 
        - learning to make scripts/software, not just one off algorithms
        - getting started with computer vision 
        - getting started with data visualization (2d/3d plotting and animation)
    - Getting more familiar with Github
    - Learning markdown/effective note taking
    - Learning about biomechanics and Center of Mass type stuff


### Things proud of
 - Slackline Animation - both plotting and understanding the biomechanics a bit
 - Getting the video synch script going from full noobishness
 - Gathering understanding of the literature/conference topics

### Things to work on 

 - Get an understanding of more professional software practices
     - PR based github workflow
     - breaking things up into separate files and importing classes/functions

- Get slackline work more structured
    - Make roadmaps
    - Choose/follow direction
    - Clearer end goal (ebventually get to a publication)
    - Reintegrate Kiley however she can fit in

- Figure out some kind of physical modeling
    - Python acrobot? 
    - Mujoco? 
    - Blender?
    - just learning raw ODE solvers?
    - goal is figure out slackrobot

### Plans/Goals for the next six months
- Get the Slackline project "up and running"
    - maybe have a pilot subject with data analyzed 
- Have some kind of physical modelling applied to slackline data
- Have the time sync code integrated into `freemocap-core` software

---
---



