David Cameron has warned housing associations they “must improve their performance” and find efficiency savings, branding them “part of the public sector”.