Yes, I agree!
Unless they edited some uncomfortable looks in that were actually bored looks from another moment in the show.
(Like they do on The Apprentice almost constantly)
I loved seeing Rufus's rubbish tattoos though. 
Argumental - Series 2 Page 2
I've already made my feelings known about Marcus on another thread, so I always route for Rufus - despite him coming third in a Simon Pegg look-a-likee contest.
As with most panel shows, the comedy lives or dies by the quality of guest. In the past, cracks were covered up by a witty and charasmatic host - Angus Deayton, Stephen Fry and Simon Amstell being prime exponents of the craft. John Seargent is a likeable fellow, but I never feel he is in control of his 'brood'.
Argumental is a good format, so I hope it continues.
He does look a lot like Simon Pegg.
I'd say he'd even come second.