The other problem with the signs is that in a rush, you just look up and see the no right picture, not even noticing the times. It looks like a straight out no-right sign when you look quickly. And when you're driving in a busy downtown, making quick and informed decisions is key to safety, and to good traffic flow.
Now, This is what the turn restriction sign looks like on Yonge and Bloor during rush hour. No left, no right. Simple. No times of day to worry about.
Of course, just like every smart idea in Toronto, it's sparsely implemented. I'm sure that this is a 'pilot project' by the city, and will probably remain that way forever. It's a shame. I'm sick of getting honked at.