Towards a Segmentation Solution: Hidden Markov Models for Sleep-Wake Segmentation

What can we learn about transitioning between sleep and wake states for longer full-video segmentation on the edge?
Sleep-Wake Transition Animation

Extracting Pose and Optical Flow features

Optical Flow Visualization

NN-HMM architecture

HMM Architecture

Selected NN-HMM Segmentation Results

Ground Truth Segmentation

Extracted Features

NN-HMM Predictions (Top: Ground Truth, Bottom: Predicted)

NN-HMM Predictions (Top: Ground Truth, Bottom: Predicted)

Ground Truth Segmentation

Extracted Features

NN-HMM Predictions (Top: Ground Truth, Bottom: Predicted)

NN-HMM Predictions (Top: Ground Truth, Bottom: Predicted)