Now that we have this most amazing drag and drop, "Insert and delete row" would really facilitate restructuring an existing dashboard.
Edit: An easy workaround is to temporarily add a couple of empty rows to the right as a parking place. Wish that little game with the plastic tiles you slide around could do that.