As title, if you try to unbind either keyboard or controller keys it just moves to the second available keybinding in the list where you cannot remove it.
This is especially a problem for me as I use an analogue keyboard and have rebound my keys to allow for this.