The Pacific Islands are not a part of Australia. If you are leaving Australia, then yes, you need a passport!