Or is the subtext that really people aren't happy about anyone who's committed an offence ever being let out of jail?

This is indeed the case, I'm sure. Except that each individual makes exceptions in the case of any friends or family who may have done time for whatever reason.

Add to this the fact that there are plenty of people who'd like to deport all foreigners and this simply provides a more acceptable excuse...