Just to confirm that PHP debugging output was being sent to the browser. In case it helps anyone else experiencing a similar issue, here is the step my host took to prevent this:
The notice warning on your website does appear to be generated from WordPress via the wp-config.php file (DEBUG MODE ON).
I have since turned off the rule which states notices should be displayed on the live website for you.