Description
The default project folder is an integral part of an ArcGIS AllSource project and cannot be deleted regardless of whether it is used.
Solution
To use a different folder as the project's home folder, right-click that folder and select the Make Default option.