Right-clicking an entry and selecting Remove from Library > Remove Game doesn't do anything. The button flashes for a second but the warning prompt stays on screen and the games are still there.
Edit: Seems like it only happens with games that haven't been ran before. I ran some unplayed games and then was able to delete them.