I've only ever heard such connotation when it's used sarcastically. 'Posh', on the other hand, often has connotations of 'affected' and 'pretentious'.