Tom Baker's Fourth Doctor costume, in a range of autumnal colors, all cover what is essentially the clothes of an Edwardian/Victorian gentleman. Possibly even an apothecary or a doctor. It's the smart outfit of a well-to-do man, who has chosen to plop a scruffy hat and a silly scarf over the top because he doesn't care. He's well-to-do, why should he?