Cut from the inside...

Remove the old seat by using a cerated knife to cut through the old rush.  Cut along the inside of the rails of the stool.