Right-clicking a saved space should allow a context menu for the removal of a saved space. There is currently no intuitive UI indication that instructs the user to drag it to the wallpaper to remove it.