WebView / native messages

Message types emitted by Upload Tracking and when they fire.

The page emits structured messages (sendDataToNative-style) so the host app can react.

Message naming and transport depend on your integration. The list below documents the logical message types and payloads.

Common (video and image)

initialization

Status while loading media or initializing the pose model.

Typical fields:

• message

• ready (boolean)

environment

Sent after backend init.

Typical fields:

• webgl (boolean)

error

Any error (invalid token, CORS, model load failure, etc).

Typical fields:

• code (examples: video_load_error, image_load_error, cross_origin_video)

• message

Video-only

keypoints (when keypoints=true)

Array of keypoints:

• name

• x, y, z

• score

angles (when angles=true)

Computed angles object.

posture

Current posture / ready state for exercise.

counter

Repetition count. Includes final=true when the video ends.

progression (when progression=true)

Per-rep progression payload.

recommendations (when recommendations=true)

Posture recommendations during exercise tracking.

keypoints_batch (when keypoints=true)

Time-stamped keypoints for the whole video.

exercise_summary

Final summary (counter, recommendations, progression).

export_ready (when export=true)

Sent when export finishes.

Includes:

• url (blob URL of the exported video)

Image-only

keypoints (when keypoints=true)

Single set of keypoints.

angles (when angles=true)

Single set of computed angles.

image_overlay

Data URL of the image with skeleton drawn.

Example:

data:image/png;base64,...