Must a GV holder also be a tax resident to import stuff?

Yes, you need to change your NIF address to PT (i.e. become a PT tax resident) in order to receive the import tax exemption.