Abstract
General object detection methods detect various objects independently without paying attention to the relationship between objects. Independent detection of hands and hand-held objects does not take the hand-object relation into account, so the object detector does not achieve optimal performance in such scenes with associated objects. The detection of hand-held objects is an important topic for its wide applications, but few works have been done to model this specific scenario. In this paper, we uses information about the interaction between the hand and the hand-held object as well as causal information when observing the hand-held object as a person to build a novel hand-held object detection model. Experimental results show that our method greatly improves hand-held object detection performance.