Dataset used for training action recognition method and task status prediction method for use in human-robot collaborative assembly scenario. Inertial measurement unit and skeleton tracking data included while users perform assembly tasks and gestures. Dataset has two parts; 1) human action recognition where sensor data is recorded along with ground truth of action being performed at that time 2) task status prediction where sensor data is recorded along with how long until each action in the task is completed.