Hello Catalin,
that's exactly what I am doing. I double checked once again on a new Windows 10 machine and the behavior was still the same.
The only option I see is to add a "delete folder" action at the end of the setup, but I think Advanced Installer should be able to produce a "clean installation" without putting unnecessary empty folders in there.
Did you maybe try a different operating system?
Best regards,
Simon