Video

Activity Grouping

Detect, categorize, and group activities in video content

420K runs

Note: This playground provides simulated output to showcase functionality. No input data is processed or stored on our servers. Use this demo to explore the feature extractor's capabilities before integrating it into your application.

Input

File URL string

Enter a URL to a video file

Upload video

Drag and drop a video file here, or click to browse

Select File

# detection_mode string

Detection mode to use. Default: standard

# min_activity_duration number

Minimum activity duration in seconds. Default: 1

# detection_threshold number

Confidence threshold for activity detection. Default: 0.7

# similarity_threshold number

Similarity threshold for grouping activities. Default: 0.8

# detect_fine_grained boolean

Detect detailed sub-categories of activities. Default: false

# track_participants boolean

Track people participating in activities. Default: true

# generate_embedding boolean

Generate activity embedding for similarity matching. Default: true

# extract_representative_frames boolean

Extract key frames representing the activity. Default: true

# frame_sampling integer

Process every Nth frame for performance. Default: 1

Output

{
  "activity": {
    "id": "activity_12345",
    "class": "dancing",
    "fine_grained_class": "ballroom_dancing",
    "confidence": 0.92,
    "instances": [
      {
        "start_frame": 120,
        "end_frame": 180,
        "start_time": 4,
        "end_time": 6,
        "duration": 2,
        "participants": [
          "person_123",
          "person_456"
        ],
        "confidence": 0.94,
        "bounding_box": {
          "x": 125,
          "y": 80,
          "width": 320,
          "height": 450
        }
      }
    ],
    "embedding": {
      "model": "activity_encoder_v1",
      "dimension": 512,
      "vector": [
        0.12,
        0.34,
        0.56,
        0.78,
        0.9
      ],
      "normalized": true
    },
    "total_duration": 5,
    "representative_frame_urls": [
      "https://storage.example.com/activities/activity_12345_1.jpg",
      "https://storage.example.com/activities/activity_12345_2.jpg"
    ]
  },
  "video": {
    "filename": "dance_performance.mp4",
    "width": 1920,
    "height": 1080,
    "fps": 30,
    "duration": 180.5
  }
}

Ready to run Activity Grouping on your data? Spin it up in Studio — no infra to host.

Run this in Studio

Already have embeddings? Skip extraction — search your own vectors with MVS. First 1M vectors free.

Try MVS →