Hello Mike,
Currently your actions are after "Remove Resources" group, therefore when they will be launched will try to cal the INF file which was already deleted from disk. Thus the uninstall driver action will fail.
Can you please move the actions like I suggest in the below screenshot.
Let me know if this helped.
All the best,
Daniel