Hello,
You are indeed right!
All the files included in the setup (either MSI or EXE) will be signed and also the MSI and/or EXE itself will be signed.
You can see the files that are to be signed in the "Digital Signature" page --> "Files configured for signing" tab.
Best regards,
Catalin