Right now you need to remove an item from the quickbelt to drag a new item in it on the same place.

My idea is, that you drag & drop an item on the quickbelt slot with an existing item and you just replace it. The old item jumps back automatically into the inventory and your new item is in the belt.