really delete the folder

Command-delete just moves it to Trash, where it still takes up space. To really delete the folder, you can enter this command in Terminal:

rm -rf ~/Library/Developer/Xcode/DerivedData/*