Managers may look the other way to prevent workers from seeking other opportunities, remote work experts said.