Whenever we delete files, the files gets stored in the Recycle Bin for restoration at any later stage but the files gets piled up there until you manually delete the files from there.

But if you are sure enough that you do not need the files at later stage then Shift + Delete is a good option but just to make you people aware, following methods can also be used to bypass the Recycle Bin when deleting the files.

Method 1:

Right click on Recycle Bin and click Properties. Now select the option “Do not move files to Recycle Bin. Remove files immediately when deleted”

Now the files will be deleted permanently and not move to Recycle bin.

Method 2 (registry tweak):

Go to Start -> Run menu, enter regedit and navigate to the registry path
HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\Policies\Explorer\
Now, create a DWORD value name “NoRecycleFiles”, if this value does not exist. Now, right-click and modify the value data box with “1” to enable the setting.

Files will be deleted immediately after system restart.