Agreed you take taxi, from Stanley Bay to Wanchai is already about 1/2 hour is the traffic is to congested then go for western harbour. Though more expensive but this should be the fastest way.
My case is opposite to yours 1:15 hour from CKY to st Stephen. Might drop one out not sure which one