Even under current law you're required to have your Residence Card with you at all times if you leave your residence. If caught without it, you'll at least get dragged to the Koban and assessed a fine. I carry with me even when I'm running down the street to get milk.