Upon entering the DSN in settings it immediately returned a 500 error and the log contains the following:
PHP Fatal error: Class 'Raven_Breadcrumbs' not found in /var/www/test.dev/wp-content/plugins/getsentry-client/raven/lib/Raven/Client.php on line 94