{"id":1449,"date":"2026-07-30T10:51:37","date_gmt":"2026-07-30T14:51:37","guid":{"rendered":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/?p=1449"},"modified":"2026-07-30T11:07:24","modified_gmt":"2026-07-30T15:07:24","slug":"the-safety-first-scorecard","status":"publish","type":"post","link":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/","title":{"rendered":"The Safety-First Scorecard"},"content":{"rendered":"\n<h3 class=\"wp-block-heading\">New research describes how to hold AI accountable for how well it protects users in crisis.<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Content Warning: This article discusses suicide. For those experiencing suicidal thoughts or ideations, help is always available. The 988 Suicide &amp; Crisis Lifeline provides free 24-hour, confidential support by calling or texting 988 or visiting <a href=\"http:\/\/988lifeline.org\" target=\"_blank\" rel=\"noreferrer noopener\">988lifeline.org<\/a>.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We often judge chatbots by how they make us feel. Did the reply sound kind? Did it seem to understand? Did it avoid sounding cold or robotic? Those signals are important, but they are also not enough for serious mental health conversations, especially in the context of suicide risk. That project lies at the heart of \u201c<a href=\"https:\/\/www.hbs.edu\/faculty\/Pages\/item.aspx?num=69020\" target=\"_blank\" rel=\"noreferrer noopener\">Benchmarking the Safety of General-Purpose Large Language Models for Suicide Risk Detection and Response<\/a>,\u201d a new working paper co-written by HBS AI Institute associate <a href=\"https:\/\/www.hbs.edu\/faculty\/Pages\/profile.aspx?facId=1326184\">Julian De Freitas<\/a>. To systematically address whether AI chatbots behave safely in critical situations, De Freitas and his co-authors examine how automated benchmarking is a new and important form of accountability: a way to make safety visible, comparable, and improvable.&nbsp;<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Why This Matters<\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">For business leaders and executives deploying AI in healthcare, HR, customer support, or any context involving users who may be at risk, this paper models what responsible benchmarking looks like: transparent criteria, standardized testing conditions, and honest acknowledgement of what the evaluation cannot yet capture. Just as a financial firm wouldn\u2019t deploy an automated trading algorithm without rigorous stress-testing, true due diligence requires evaluating AI systems on their worst-case outputs, tracking specific failures, and building explicit, low-friction handoffs to human oversight when high-stakes thresholds are crossed.&nbsp;<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/aiinstitute.hbs.edu\/the-safety-first-scorecard-evaluating-llms-on-critical-crisis-management\/\" target=\"_blank\" rel=\"noreferrer noopener\">Link to the HBS AI Institute Insight Article<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/www.hbs.edu\/faculty\/Pages\/item.aspx?num=69020\" target=\"_blank\" rel=\"noreferrer noopener\">Link to the Research Paper<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/aiinstitute.hbs.edu\/#join-our-community\">Sign up for our newsletter to stay up to date with HBS AI Institute news and research<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Future Proof with AI<\/p>\n","protected":false},"author":19382,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_trash_the_other_posts":false,"rkv_hide_featured_image":false,"rkv_hide_page_title":false,"rkv_hide_abstract_shapes":true,"rkv_reduce_header":false,"hbsd3_featured_media_url":"https:\/\/vimeo.com\/1212366005?share=copy&fl=sv&fe=ci","hbsd3_featured_media_url_autoplay":false,"editor_notices":[],"footnotes":""},"categories":[1],"tags":[],"tax_cop":[],"rkv-people-shadow":[8],"insight_type":[],"class_list":["post-1449","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>The Safety-First Scorecard - Future Proof with AI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Safety-First Scorecard - Future Proof with AI\" \/>\n<meta property=\"og:description\" content=\"Future Proof with AI\" \/>\n<meta property=\"og:url\" content=\"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/\" \/>\n<meta property=\"og:site_name\" content=\"Future Proof with AI\" \/>\n<meta property=\"article:published_time\" content=\"2026-07-30T14:51:37+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-07-30T15:07:24+00:00\" \/>\n<meta name=\"author\" content=\"HBS AI Content &amp; Learning\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"HBS AI Content &amp; Learning\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/the-safety-first-scorecard\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/the-safety-first-scorecard\\\/\"},\"author\":{\"name\":\"achieco\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/#\\\/schema\\\/person\\\/a30e66e9aecc145f39ba2467215f1687\"},\"headline\":\"The Safety-First Scorecard\",\"datePublished\":\"2026-07-30T14:51:37+00:00\",\"dateModified\":\"2026-07-30T15:07:24+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/the-safety-first-scorecard\\\/\"},\"wordCount\":297,\"commentCount\":0,\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/the-safety-first-scorecard\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/the-safety-first-scorecard\\\/\",\"url\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/the-safety-first-scorecard\\\/\",\"name\":\"The Safety-First Scorecard - Future Proof with AI\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/#website\"},\"datePublished\":\"2026-07-30T14:51:37+00:00\",\"dateModified\":\"2026-07-30T15:07:24+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/#\\\/schema\\\/person\\\/a30e66e9aecc145f39ba2467215f1687\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/the-safety-first-scorecard\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/the-safety-first-scorecard\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/the-safety-first-scorecard\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Safety-First Scorecard\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/#website\",\"url\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/\",\"name\":\"Future Proof with AI\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/#\\\/schema\\\/person\\\/a30e66e9aecc145f39ba2467215f1687\",\"name\":\"achieco\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/44cd579f7651e04c828e4b9a14e6fd15567965289b4cd69abc67783ded295f37?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/44cd579f7651e04c828e4b9a14e6fd15567965289b4cd69abc67783ded295f37?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/44cd579f7651e04c828e4b9a14e6fd15567965289b4cd69abc67783ded295f37?s=96&d=mm&r=g\",\"caption\":\"achieco\"},\"url\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/author\\\/d3-content-learning\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Safety-First Scorecard - Future Proof with AI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/","og_locale":"en_US","og_type":"article","og_title":"The Safety-First Scorecard - Future Proof with AI","og_description":"Future Proof with AI","og_url":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/","og_site_name":"Future Proof with AI","article_published_time":"2026-07-30T14:51:37+00:00","article_modified_time":"2026-07-30T15:07:24+00:00","author":"HBS AI Content & Learning","twitter_card":"summary_large_image","twitter_misc":{"Written by":"HBS AI Content & Learning","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/#article","isPartOf":{"@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/"},"author":{"name":"achieco","@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/#\/schema\/person\/a30e66e9aecc145f39ba2467215f1687"},"headline":"The Safety-First Scorecard","datePublished":"2026-07-30T14:51:37+00:00","dateModified":"2026-07-30T15:07:24+00:00","mainEntityOfPage":{"@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/"},"wordCount":297,"commentCount":0,"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/","url":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/","name":"The Safety-First Scorecard - Future Proof with AI","isPartOf":{"@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/#website"},"datePublished":"2026-07-30T14:51:37+00:00","dateModified":"2026-07-30T15:07:24+00:00","author":{"@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/#\/schema\/person\/a30e66e9aecc145f39ba2467215f1687"},"breadcrumb":{"@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/the-safety-first-scorecard\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/"},{"@type":"ListItem","position":2,"name":"The Safety-First Scorecard"}]},{"@type":"WebSite","@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/#website","url":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/","name":"Future Proof with AI","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/#\/schema\/person\/a30e66e9aecc145f39ba2467215f1687","name":"achieco","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/44cd579f7651e04c828e4b9a14e6fd15567965289b4cd69abc67783ded295f37?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/44cd579f7651e04c828e4b9a14e6fd15567965289b4cd69abc67783ded295f37?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/44cd579f7651e04c828e4b9a14e6fd15567965289b4cd69abc67783ded295f37?s=96&d=mm&r=g","caption":"achieco"},"url":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/author\/d3-content-learning\/"}]}},"_links":{"self":[{"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/posts\/1449","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/users\/19382"}],"replies":[{"embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/comments?post=1449"}],"version-history":[{"count":2,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/posts\/1449\/revisions"}],"predecessor-version":[{"id":1451,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/posts\/1449\/revisions\/1451"}],"wp:attachment":[{"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/media?parent=1449"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/categories?post=1449"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/tags?post=1449"},{"taxonomy":"tax_cop","embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/tax_cop?post=1449"},{"taxonomy":"rkv-people-shadow","embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/rkv-people-shadow?post=1449"},{"taxonomy":"insight_type","embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/insight_type?post=1449"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}