Dataset
The currently available annotations on the JackRobbot dataset and benchmark (JRDB) include:
2D bounding box annotations around all the pedestrians visible in five RGB streams and their cylindrical composition.
3D oriented cuboid annotations around pedestrians in two Velodyne-16 LiDAR streams.
2D-3D associations between bounding boxes and cuboids.
Time consistent trajectories (tracks) for all annotated individuals in both 2D and 3D.
In addition to the above, we have provided a new set of annotations, including:
Individual action labels for all the individuals visible in RGB 360° cylindrical video stream, representing:
Human pose actions (total 11 exclusive categories including a miscellaneous class).
Human-to-human interaction actions (total 3 categories including a miscellaneous class).
Human-to-object interaction actions (total 12 categories including a miscellaneous class).
The action label difficulty level (4 categories) for each attribute.
Social group formation of all the individuals, visible in RGB 360° cylindrical video stream, (ranging from the groups with 1 person to the groups with 29 people)
Social activity labels for each social groups as the accumulation of the majority of individual action labels for each social group
Open Challenge
In addition to the existing four benchmarks and challenges on JRDB, i.e. 2D-3D person detection and tracking challenges, in this workshop, we organise three new challenges using our new annotations:
Human social group identification
Individual action detection
Social activity recognition
The first winner of each of the seven challenges will be awarded a $100-$300 amazon gift card and a certificate. The winners will also have an opportunity to present their work as a spotlight (5 minutes) and poster presentation during the workshop.
Guidelines for participation: The participants should strictly follow the same submission policy provided in the main JRDB webpage, which can be found
here.
Also, in order to distinguish the challenge submissions from the other regular submissions, each submission name should be followed by a CVPR21 tag, e.g., "submissionname_CVPR21". Otherwise, we ignore those submissions for the challenge.
Each challenge submission should be followed by an extended abstract submission via our
CMT webpage (the details are available below) or a link to an existing Arxiv preprint /publication.
Evaluation: we use the first metric after "name" in all the leaderboards as the main evaluation for ranking the entries. The evaluation instruction and toolkits for all seven benchmarks are available
here.
