Of course, there is something that can be done about it. How about not making the death penalty a joke for starters. Death row = life sentence. Few people are ever executed and die in prison from other causes.
Start making examples of people and when criminals see that there is a unification of noncriminals who are behind electrocution or lethal injection, then see how fast it all dies down.
You'll never be 100% rid of the criminal element that's to generational curses but it will be significantly reduced.