I'm afraid that this is the normal behavior. The dialog closes when the "Readme" button is clicked. In order to prevent this, you can create a new image button which will execute a "Launch file" custom action that will open the release notes file. In this case, you do not need to use the "View Readme" option from the "Finish Actions" tab anymore.