R-FCN proposes multiple ROIs. For each ROI, it assumes there is an object or no object. For each ROI, the model predicts scores for all classes and we pick the class with the top score.