{"id":1418,"date":"2026-07-14T13:57:15","date_gmt":"2026-07-14T13:57:15","guid":{"rendered":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/?p=1418"},"modified":"2026-07-14T13:57:16","modified_gmt":"2026-07-14T13:57:16","slug":"does-your-ai-work-test-it-where-it-lives","status":"publish","type":"post","link":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/does-your-ai-work-test-it-where-it-lives\/","title":{"rendered":"Does Your AI Work? Test It Where It Lives"},"content":{"rendered":"\n<h3 class=\"wp-block-heading\"><em>A new framework argues that AI evaluation should start where AI actually gets used.<\/em><\/h3>\n\n\n\n<p>Real-world AI use is messy. Uneven user expertise, shifting workflows, institutional dynamics, and a range of other factors all have an effect on what we get out of AI, but we also want to have a clear picture of whether AI investments are driving worker productivity and firm value. The new article \u201c<a href=\"https:\/\/hdsr.mitpress.mit.edu\/pub\/ak16gxi2\/release\/2\" target=\"_blank\" rel=\"noreferrer noopener\">Toward Causal Field Evaluations of AI Systems<\/a>,\u201d co-written by HBS AI Institute PI <a href=\"https:\/\/www.hbs.edu\/faculty\/Pages\/profile.aspx?facId=1199332\" target=\"_blank\" rel=\"noreferrer noopener\">Iavor Bojinov<\/a>, makes the case that the messy real world is exactly the place to evaluate the efficacy of AI. It presents a new framework for thinking more rigorously about how AI systems can be evaluated through <em>causal field evaluations<\/em>: randomized experiments run in the actual setting where a new system will be used.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Why This Matters<\/strong><\/h4>\n\n\n\n<p>One of the most popular AI integration plans in business today is barely a plan at all: hand everyone an AI chatbot, encourage them to experiment, and hope for the best. For business leaders and executives, this research should make you think twice about that plan, not because experimentation is wrong, but because unstructured experimentation might not be answering the questions you truly care about. When you simply let adoption happen, the people who lean in differ from those who don\u2019t, and the feedback data you collect could be almost entirely preference data. A stronger playbook starts by envisioning what a credible evaluation will look like in your company, and which guardrails and outcomes will tell you whether the tool is actually improving work and value. In a business environment where AI models change quickly, workflows are fragile, and implementation costs are real, that discipline can mean the difference between adopting AI that feels good and implementing AI that actually works.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<p><a href=\"https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/\" target=\"_blank\" rel=\"noreferrer noopener\">Link to the HBS AI Institute Insight Article<\/a><br><a href=\"https:\/\/hdsr.mitpress.mit.edu\/pub\/ak16gxi2\/release\/2\" target=\"_blank\" rel=\"noreferrer noopener\">Link to the Research Paper<\/a><br><a href=\"https:\/\/aiinstitute.hbs.edu\/#join-our-community\" target=\"_blank\" rel=\"noreferrer noopener\">Sign up for our newsletter to stay up to date with HBS AI Institute news and research<\/a><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>A new framework argues that AI evaluation should start where AI actually gets used.<\/p>\n","protected":false},"author":19452,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_trash_the_other_posts":false,"rkv_hide_featured_image":false,"rkv_hide_page_title":false,"rkv_hide_abstract_shapes":true,"rkv_reduce_header":false,"hbsd3_featured_media_url":"https:\/\/vimeo.com\/1208141796","hbsd3_featured_media_url_autoplay":false,"editor_notices":[],"footnotes":""},"categories":[1],"tags":[],"tax_cop":[],"rkv-people-shadow":[],"insight_type":[],"class_list":["post-1418","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Does Your AI Work? Test It Where It Lives - Future Proof with AI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Does Your AI Work? Test It Where It Lives - Future Proof with AI\" \/>\n<meta property=\"og:description\" content=\"A new framework argues that AI evaluation should start where AI actually gets used.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/\" \/>\n<meta property=\"og:site_name\" content=\"Future Proof with AI\" \/>\n<meta property=\"article:published_time\" content=\"2026-07-14T13:57:15+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-07-14T13:57:16+00:00\" \/>\n<meta name=\"author\" content=\"HBS AI Content &amp; Learning\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"HBS AI Content &amp; Learning\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/does-your-ai-work-test-it-where-it-lives\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/does-your-ai-work-test-it-where-it-lives\\\/\"},\"author\":{\"name\":\"trevormasse\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/#\\\/schema\\\/person\\\/1185726ac704474179c007e053462f9d\"},\"headline\":\"Does Your AI Work? Test It Where It Lives\",\"datePublished\":\"2026-07-14T13:57:15+00:00\",\"dateModified\":\"2026-07-14T13:57:16+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/does-your-ai-work-test-it-where-it-lives\\\/\"},\"wordCount\":337,\"commentCount\":0,\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/aiinstitute.hbs.edu\\\/does-your-ai-work-test-it-where-it-lives\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/does-your-ai-work-test-it-where-it-lives\\\/\",\"url\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/does-your-ai-work-test-it-where-it-lives\\\/\",\"name\":\"Does Your AI Work? Test It Where It Lives - Future Proof with AI\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/#website\"},\"datePublished\":\"2026-07-14T13:57:15+00:00\",\"dateModified\":\"2026-07-14T13:57:16+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/#\\\/schema\\\/person\\\/1185726ac704474179c007e053462f9d\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/does-your-ai-work-test-it-where-it-lives\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/aiinstitute.hbs.edu\\\/does-your-ai-work-test-it-where-it-lives\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/does-your-ai-work-test-it-where-it-lives\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Does Your AI Work? Test It Where It Lives\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/#website\",\"url\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/\",\"name\":\"Future Proof with AI\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/#\\\/schema\\\/person\\\/1185726ac704474179c007e053462f9d\",\"name\":\"trevormasse\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1fc8bf8d51ffb84ce05cbf148543f340094d44cd0e56022daac5fbf115b8dc5a?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1fc8bf8d51ffb84ce05cbf148543f340094d44cd0e56022daac5fbf115b8dc5a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1fc8bf8d51ffb84ce05cbf148543f340094d44cd0e56022daac5fbf115b8dc5a?s=96&d=mm&r=g\",\"caption\":\"trevormasse\"},\"url\":\"https:\\\/\\\/aiinstitute.hbs.edu\\\/future-proof-with-ai\\\/author\\\/d3-content-learning\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Does Your AI Work? Test It Where It Lives - Future Proof with AI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/","og_locale":"en_US","og_type":"article","og_title":"Does Your AI Work? Test It Where It Lives - Future Proof with AI","og_description":"A new framework argues that AI evaluation should start where AI actually gets used.","og_url":"https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/","og_site_name":"Future Proof with AI","article_published_time":"2026-07-14T13:57:15+00:00","article_modified_time":"2026-07-14T13:57:16+00:00","author":"HBS AI Content & Learning","twitter_card":"summary_large_image","twitter_misc":{"Written by":"HBS AI Content & Learning","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/#article","isPartOf":{"@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/does-your-ai-work-test-it-where-it-lives\/"},"author":{"name":"trevormasse","@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/#\/schema\/person\/1185726ac704474179c007e053462f9d"},"headline":"Does Your AI Work? Test It Where It Lives","datePublished":"2026-07-14T13:57:15+00:00","dateModified":"2026-07-14T13:57:16+00:00","mainEntityOfPage":{"@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/does-your-ai-work-test-it-where-it-lives\/"},"wordCount":337,"commentCount":0,"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/does-your-ai-work-test-it-where-it-lives\/","url":"https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/","name":"Does Your AI Work? Test It Where It Lives - Future Proof with AI","isPartOf":{"@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/#website"},"datePublished":"2026-07-14T13:57:15+00:00","dateModified":"2026-07-14T13:57:16+00:00","author":{"@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/#\/schema\/person\/1185726ac704474179c007e053462f9d"},"breadcrumb":{"@id":"https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/aiinstitute.hbs.edu\/does-your-ai-work-test-it-where-it-lives\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/"},{"@type":"ListItem","position":2,"name":"Does Your AI Work? Test It Where It Lives"}]},{"@type":"WebSite","@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/#website","url":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/","name":"Future Proof with AI","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/#\/schema\/person\/1185726ac704474179c007e053462f9d","name":"trevormasse","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1fc8bf8d51ffb84ce05cbf148543f340094d44cd0e56022daac5fbf115b8dc5a?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1fc8bf8d51ffb84ce05cbf148543f340094d44cd0e56022daac5fbf115b8dc5a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1fc8bf8d51ffb84ce05cbf148543f340094d44cd0e56022daac5fbf115b8dc5a?s=96&d=mm&r=g","caption":"trevormasse"},"url":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/author\/d3-content-learning\/"}]}},"_links":{"self":[{"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/posts\/1418","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/users\/19452"}],"replies":[{"embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/comments?post=1418"}],"version-history":[{"count":1,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/posts\/1418\/revisions"}],"predecessor-version":[{"id":1419,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/posts\/1418\/revisions\/1419"}],"wp:attachment":[{"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/media?parent=1418"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/categories?post=1418"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/tags?post=1418"},{"taxonomy":"tax_cop","embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/tax_cop?post=1418"},{"taxonomy":"rkv-people-shadow","embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/rkv-people-shadow?post=1418"},{"taxonomy":"insight_type","embeddable":true,"href":"https:\/\/aiinstitute.hbs.edu\/future-proof-with-ai\/wp-json\/wp\/v2\/insight_type?post=1418"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}