How can I tell Perl's prove utility to ignore certain tests?

I usually do something like this:

$ find t/ -name '*.t' ! -name '*timeout*' | xargs prove -l

(skips slow timeout tests)