This message means the virtual PlayStation 3 inside your computer has stopped responding. The game has frozen, the audio may stutter into a loop, and your only apparent option is to hit "Close" and lose your unsaved progress.

Reinstall the latest official firmware via File → Install Firmware .