Hello:

To manually rename a Visual Studio project you have to rename your ".sln" file and your ".suo" file on the root. When you start your debugger your Visual Studio program will look for a ".suo" file with the same name than your ".sln" file. Then rename your project directory and, inside it, rename your ".vbproj" file. After that open your ".sln" file on a text editor and change your name and path.

Here is a section of the ".sln file:

Microsoft Visual Studio Solution File, Format Version 11.00
# Visual Basic Express 2010
Project("{F184B08F-C81C-45F6-A57F-5ABD9991F28F}") = "RandomTexture", "RandomTexture\RandomTexture.vbproj", "{B34F1C94-953D-447D-B9C7-6DC067E52AF2}"
EndProject
.
.
.

You would change it to this:

Microsoft Visual Studio Solution File, Format Version 11.00
# Visual Basic Express 2010
Project("{F184B08F-C81C-45F6-A57F-5ABD9991F28F}") = "NewName", "NewName\NewName.vbproj", "{B34F1C94-953D-447D-B9C7-6DC067E52AF2}"
EndProject
.
.
.