Yeah, if you don't use it you lose it.
A few years back my wife located someone she had known from long ago. At the time he could read English newspapers so she was surprised that he wasn't speaking to me in English. Too long without using it--he had gone from being able to read the paper to not being able to do simple conversation.