As commuters fumed, the city's executive member for regeneration, Cllr Peter Millea, played a game of miniature golf on the deserted street to promote the initiative.
Organisers denied they were being anti-motorist.
Cllr Millea said: "Car Free Day is an opportunity for people to think about whether they really need to bring a car into the city centre.
But one commuter, who was made late for work, said: "Pedestrianising Castle Street is a nice idea in theory but the reality was a massive pain this morning."