The Rudd Government must act swiftly if a United Nations committee finds the Northern Territory intervention is racist, UNSW law professor George Williams says.