There are reasons why someone might admit guilt when they didnt do it. A fall guy for the mafia, for example. In that case an honest court system might want a trial to uncover the truth, rather than just lock up the patsy.
Thats what they said, which is extraordinarily suspicious. The weapon is to be disposed of, literally everyone knows this. And to carry it to another state for days?