You're referring to Billy Doctrove, I take it?
Anyhow perhaps the umpires saw some extremely suspicious marks on the ball. That might well be good enough evidence. It depends on how the ball looked. As for consulting the Referee, I see no need for it. The Laws of the Cricket make these things pretty clear imho.
Ball-tampering comes under Law 42 (Fair and Unfair Play).
Law 42.2 provides that "The umpires shall be the sole judges of fair and unfair play. If either umpire considers an action, not covered by the Laws, to be unfair, he shall intervene without appeal..."
(1) In other words, this is a matter for the umpires, not the match referee.
Law 42.3(c) provides that the umpires shall make "frequent and irregular inspections of the ball."
(2) The reason being to detect ball-tampering from simply looking at the condition of the ball.
Law 42.3(d) provides that if the umpires believe that there has been unfair ball tampering,
"the umpires after consultation shall
(i) change the ball forthwith...
(ii) inform the batsmen that the ball has been changed.
(iii) award 5 penalty runs to the batting side..."
(3) The umpires have to act "after consultation". This means consultation with each other, not with the referee, and still less with a TV company who may happen to have juicy footage.
(4) Note also that the process is an immediate one. The condition of the ball must be changed forthwith. The umpires are not entitled to wait for an interval or the close of play, or to consult with anyone except each other.
Law 42.3(e) provides that "if there is any further instance of unfairly changing the condition of the ball in that innings, the umpires after consultation shall
(i) repeat the procedure in (d)(i), (ii) and (iii) above.
(ii) inform the captain of the fielding side of the reason for the action taken and direct him to take off forthwith the bowler who delivered the immediately preceding ball. The bowler thus taken off shall not be allowed to bowl again in that innings..."
(5) Again, the Law is providing for an immediate remedy - the bowler shall be taken off forthwith - there is no power for the umpires, having formed the opinion that a second infringement has occurred, to wait till an interval or until the close of play.