Comment by kevindamm
I like this idea, however I worry that it would be difficult to do it while being consistent (and unbiased). If the same questions are asked of each student then later students might be unfairly prepped. If different questions are asked then it becomes very difficult to normalize scores across the class. The bias risk is self-explanatory and may be unconscious.
If you could solve this problem well, you could also probably fix the issues with most interview processes.