Who told you that / source? It is really not what I was told or read online. It looks like the "traditional Portuguese Visa (short or long term)… NOT the Golden Visa.
Source: Nomad Capitalist;
"But you won’t have to wait for citizenship to enjoy travel benefits. Your Golden Visa residence permit will grant you visa-free travel privileges within the Schengen Area and many other countries around the world.
Aside from granting you the right to live in Portugal and work toward citizenship, your Golden Visa residence will also allow you to legally work in the country. If you don’t want to spend much time in Portugal while you wait for citizenship, you are only required to spend an average of seven days per year there to maintain your residence. And, as a resident of an EU country, you have the right to live and work in any of the EU/EEA countries.
Portugal’s Golden Visa gives you unlimited access to the EU so, if your goal is to be able to live, do business and travel to the EU beyond the 90 or 180 days of visa -free access that you have on your current passport, a Portuguese residence permit may do the trick.
Also, technically it would be impossible for any other country in the Schengen Area to “track you down”. There is no borders. You can flight to France and stay there 6 months… then leave and go 3 months to Belgium by car.
Tracking flights and mobile numbers through satellites has only been used so far for criminal tracking.
As long as you flight in and out of the Schengen Area through Portugal, nobody will know where you were traveling in Europe during that year.