You must select the registry option that you specified in the Write Data to Registry action:

This will identify the correct registry entry in the Windows Registry and delete the whole entry.