Should extended metaphors be relevant and justifiable?

As a writer I feel uncomfortable using extended metaphors that are not thematically/topically linked with what I am writing about. Heaney, for example, justified his use of Greek mythological metaphors by arguing a parallel between Greek and Irish culture. Should extended metaphors be used only when strictly relevant to the subject matter?