US green card holder changing citizenship

I am a green card holder and my country of citizenship does not allow dual citizenship. If I change my citizenship to say Dominica will that be OK with the USCIS? I won’t be able to use my earlier passport to enter the US in that case. Will they allow me to enter on my green card?