02 / Challenge
Useful movement feedback depends on more than detecting a pose.
A rehabilitation tool must connect observed motion to a repeatable assessment workflow. It also needs to communicate uncertainty and avoid presenting a noisy estimate as a clinical fact.
Camera position, occlusion, clothing, lighting, and movement pace can all affect landmark quality, while the system still needs to remain practical on ordinary CPU hardware.
- Operate without requiring a dedicated GPU.
- Separate unstable observations from usable movement samples.
- Keep setup and session feedback understandable to a non-specialist user.
03 / Approach
Frame input becomes feedback through a sequence of explicit checks.
The working model captures a frame, estimates landmarks, assesses reliability, calculates joint geometry, updates movement state, detects compensation patterns, and records session output. Temporal state turns those observations into range-of-motion, repetition, and compensation feedback, while the reporting layer organizes the session into something a person can review.
- Gate calculations using landmark reliability instead of accepting every frame.
- Use explicit state transitions for repetition counting.
- Keep compensation feedback separate from the primary movement signal.
04 / Result
The project made reliability and evidence boundaries part of the product.
The prototype connects pose observations to a reviewable exercise-session workflow while remaining conservative about uncertain input and clinical interpretation.
The strongest lesson was that evaluation design cannot be separated from implementation: the reference method, population, protocol, denominators, and error analysis must be defined before performance figures are presented.
What I would improve next
- Validate reliability across more camera positions, movement conditions, and representative sessions.
- Define a formal reference protocol and error-analysis method before publishing performance metrics.