I think there's a difference between new commers and newbies. Not all new commers are beginners.
We all know that most of the beginners are using Backtrack so they'll become h4x0rs and try their luck in cracking WEP. They are skipping one step: basic linux skills.
Every human being is at first a beginner, but that doesn't mean it's right to have 80% of posts about basic linux questions in a Pentesting specialized forum.
There are other forums for that, like LinuxQuestions and Ubuntu's community forum.
Also most beginners here want to be part of the h4x0r community, and it will give them a great motivation to gain some linux skills to be able to post in "the big ligue".
Such a quiz could also help them focus their energy on parts that matter in Backtrack (i.e there's not such a great need to know how to change the default scheduler, but rather how to solve video and networking problems)
If there's a CTF challenge, how would you like it to be organized/held?