Why don't Venn diagrams count as formal proofs?
I don't know exactly what you have written, but I would venture to say that anything you "prove" with Venn diagrams probably has an extremely direct translation into set theory, which would certainly be an acceptable form of proof.
The strongest reason to not let you just use a Venn diagram alone is that your teacher probably wants you to verbalize your explanation. This is a key part of mathematics. Drawing a picture can really help illustrate the idea involved, but it does not always explain the connection to the logic you are working within.
There is also a huge drawback to proving things by Venn diagram: your visual preconceptions may fool you into making a mistake. This cannot happen (or happens to a much smaller degree) when you work in the language of set theory.
Using the default Venn diagram with two intersecting circles, it is "evident" that $A\cup B\ne A\cap B$. But of course this statement is not true in general.
The point is, you need to take care to be specific about what is being talked about. Symbols tend to be more specific, but mathematicians still sometimes make equivocation errors in the language. Really it boils down to not confusing the subjects and objects in a proof. As some other people have said, a Venn diagram typically applies to one set or another, so to generalize is a risky business. The same errors can occur in symbolic math manipulation, though. So there is nothing inherently invalid about the type of proof.
Venn diagrams are hardly distinct from proofs in Geometry by drawing figures.
I do agree with the comment that we are just talking about convention. Over the centuries mathematicians have changed their opinions on what constitutes a valid proof. Some of Euler's work, for example, comes to mind. It was rather arbitrary for us today to call his proofs weaker than ours today. Its a cultural chance in mindset, really.
Venn diagrams, geometrical figures... these are just concepts illustrated on paper. Thats it. How is that different than algebraic symbols written on paper? Or English? Its a language that conveys a concept. To de-emphasize the worth of one simply because it takes a different form is at best arbitrary and subjective. At worst its irrational or bigoted. Let me ask you, is there a formal proof as to why figures and shapes and Venn diagrams are less effective than symbols? It would seem to me that this would require a proof of its own.
Until such time that this is proven, the only criticism I can give the use of any one proof method over another is that we are fallible humans that may not interpret or capture the meaning of the question adequately enough in one system of proof, but we do in another. Its a failure on our own part.