Why are oral tests and exams not common in American educational systems?
An oral exam takes me about 30 minutes (including preparation and discussion afterwards). I have about 110 students in my class. Doing an oral exam for that class would take me about 55 hours. This is not the only class I teach. I teach about 5 classes per semester. In order to avoid some of the subjectivity my department requires that an additional staff member is present. So implementing this for my courses would take about 55*5*2=550 person hours. That is just not practical (not to mention that my colleagues won't thank me for the additional work I give them as they have to sit in for these exams).
I know how long an oral exam takes because I do use it sometimes, but for practical reasons I can only do that for a small number of courses and I have to justify why this is necessary to my colleagues.
As others have pointed out, oral exams take a lot of time.
I'm not familiar with the US education system, but I'm in a country where, from the elementary school to the university, verbal tests and oral exams are quite common, and I've administered oral exams for about 20 years (with a duration from 20 min to 1 hour, depending on the class). I'll thus try to outline what factors, apart from tradition, allow to administer oral exams in a manageable way.
The most significant factor is probably the structure of courses and exams. In my country, there are usually several exam sessions in a year and students can take an exam in any one of those sessions. And, frequently, for very small courses, professors allow students to take the exam whenever they wish along the year. This means that if you have a course of, say, 100 students, 50 will probably take the exam at the first session, 30 at the second and 10-15 at the third session and the rest along the year (of course, at each session there's also a bit of backlog).
Second, for many courses, there are both a written and oral tests. Those who don't pass the written test are not admitted to the oral test and fail the exam. This means that of 50 students that try the exam at the first session, maybe only 20-40 pass the exam (in the past, just 10 would not have been uncommon), and this further limits the number of oral exams that you have to deliver each session.
Third, there is a certain freedom on how to administer the exams. Some professors will thus make the oral test optional: students who decide to not take the oral test cannot get a top grade (e.g. they can get a B, or equivalent, at most). And, usually, it is remarked that the oral exam can also worsen the grade. This, again, allows to further reduce the number of oral exams (in my experience, only about 10% of the students try the oral exam if it's optional).
In addition to the above points, there is also the acceptance of the stress of the oral exam and the subjectivity, or perceived fairness, of the evaluation (and a few comments here show that this is a controversial point, probably worth of a different question).
I actually did that once, as a TA in basic computer science for CS majors. 90ish students, 10-15mins each group of 3 students, it took me the best part of two weeks, including days from 7am to 9pm.
I was only able to do it because I had a lot of "free" time as a TA (MS student, but I didn't have any courses of my own and my work was ahead of schedule).
NEVER AGAIN
Why? Because it takes an insane amount of man-hours (even if you do in parallel) and it doesn't inform you of anything you don't know already. After a while, it is fairly easy to spot the good students, the lazy but good, and the bad students. In that specific course, the marks for that oral exam were remarkably similar to the ones of a regular written exam I applied two months later.
Unless you want to see how the student behaves when "put on the spot", it serves no purpose.