For permanent residence, you must visit the country no less than once every two years. You could lose your permit if you do not.