You can't make them html using the email template, some email clients will automatically make them clickable though. You can mod the code so they're always in html.
Open _updateFileOptions.ajax.php.
On line 63 (after $subject = t('...'); ) add:
foreach($fullUrls AS $k=>$fullUrl)
{...