The removal of a pooling layer helps YOLO to detect smaller objects. You are right (not to make it to odd number.)