The Theory that you are kind of in an "Area" where a Trinket is, whenever you get that, helped for me.
I know a lot of this silly Rituals you are talking about, but 90% of the Time I play around that "The Fish got away"-Area there will be a Trinket.
So it pretty much gives you a Hint that you...