The Factual Accuracy metric is a non-deterministic Metric used by Galtea to evaluate the performance of your AI products, especially in Retrieval-Augmented Generation (RAG) and question answering systems. It measures whether the information in the model’s output is factually correct, complete, and appropriately addresses the user’s input when compared to a trusted reference answer.This metric helps ensure that your LLM-generated responses are not only relevant and factually accurate, but also comprehensive enough to adequately answer the user’s question, reducing the risk of hallucinations, misinformation, or incomplete responses in your product’s outputs.
Evaluation Parameters
To compute the factual_accuracy metric, the following parameters are required:
input: The original user query or question that prompted the response.
expected_output: The reference or ground truth answer that the model’s output should be compared against.
actual_output: The response generated by your LLM application.
How Is It Calculated?
Factual Accuracy is computed using an LLM-as-a-judge process that evaluates the response on three key dimensions: accuracy, completeness, and relevance, in the following sense:
Accuracy: whether the information is correct and consistent with what is expected.
Completeness: whether all relevant points from the input are properly addressed.
Relevance: whether the content stays focused on the topic without adding unnecessary or unsupported material.
Each of these aspects is carefully verified to ensure the output fully meets the required standards before a final judgment is made.Finally, the final score is determined based on these details:
Score 1: Response aligns with the reference answer with no errors, omissions, or unsupported additions
Score 0: Response contains factual errors, omits essential information needed for the input, or includes unsupported content
The scoring system provides granular feedback on response quality, allowing you to identify and address different types of factual accuracy issues in your AI system.
This metric is inspired by best practices in the open source community and is implemented natively in the Galtea platform.
Suggested Test Case Types
The Factual Accuracy metric is effective for evaluating Accuracy test cases in Galtea, since it assesses the model’s ability to maintain factual correctness.
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"Galtea Docs","colors":{"primary":"#5286FF","light":"#A9E3FE","dark":"#171717"},"logo":{"light":"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/light.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=52a5941e3fa4d5af453da96cfa8d07e5","dark":"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/dark.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=0ea251446a97e2cd0bb0e9de1b049412"},"favicon":"https://mintcdn.com/galtea/sKxmtq77X98SiOSi/favicon.png?fit=max\u0026auto=format\u0026n=sKxmtq77X98SiOSi\u0026q=85\u0026s=a297a4f88e5dd07d7858dc2998dfe3ce","appearance":{"default":"system","strict":false},"background":{"color":{"light":"#f6f6f5","dark":"#09090a"}},"navbar":{"links":[{"href":"mailto:support@galtea.ai","label":"Support"}],"primary":{"type":"button","label":"Dashboard","href":"https://platform.galtea.ai"}},"footer":{"socials":{"linkedin":"https://linkedin.com/company/galtea-ai","website":"https://galtea.ai"}},"fonts":{"family":"Geist"},"icons":{"library":"fontawesome"},"styling":{"eyebrows":"breadcrumbs","codeblocks":"system","latex":true},"integrations":{"posthog":{"apiKey":"phc_5hcYhBTteqSv1mp9ObS5j28EKEA1HV6sog9EZHikgcF","apiHost":"https://t.galtea.ai","sessionRecording":false}},"contextual":{"options":["copy","view","chatgpt","claude","perplexity","mcp","cursor","vscode"],"display":"header"},"navigation":{"global":{"anchors":[{"anchor":"Blog","icon":"newspaper","href":"https://galtea.ai/blog"},{"anchor":"Changelog","icon":"list-check","href":"https://docs.galtea.ai/changelog"}]},"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"galtea","hasAudioNarration":false,"actualSubdomain":"galtea","customDomains":["docs.galtea.ai"],"gitSource":{"type":"github","owner":"galtea-ai","repo":"docs","deployBranch":"main","contentDirectory":"","isPrivate":true,"mountPath":"","label":""},"entitlements":{},"buildId":"6afc354e44ba07be7352fb3b","clientVersion":"0.0.4177","searchFilterCounts":[{"language":"default","tag":"Concepts","count":3896},{"language":"default","tag":"REST API","count":1987},{"language":"default","tag":"Endpoints","count":1760},{"language":"default","tag":"SDK","count":1413},{"language":"default","tag":"Metrics","count":387},{"language":"default","tag":"Guides","count":330},{"language":"default","tag":"Deployment","count":180},{"language":"default","tag":"evaluations","count":180},{"language":"default","tag":"monitors","count":180},{"language":"default","tag":"metrics","count":177}]},"assistantConfig":{},"basePath":"","hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-rbac-roles","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"rbac-expansion","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-metadata","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-serve","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"live-agents","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"starter-pricing","enabled":true,"variant":{"name":"treatment","enabled":true,"payload":{"type":"string","value":"treatment"},"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":true},"customCss":[],"page":{"pagePath":"v5.10/concepts/metric/factual-accuracy","slug":"/v5.10/concepts/metric/factual-accuracy","pageMetadata":{"title":"Factual Accuracy","description":"Evaluates whether the generated output is factually accurate and adequately addresses the user's input when compared to the reference answer.","href":"/v5.10/concepts/metric/factual-accuracy"},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsx(_components.p, {\n children: \"Evaluates whether the generated output is factually accurate and adequately addresses the user’s input when compared to the reference answer.\"\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,code:`code`,li:`li`,ol:`ol`,p:`p`,strong:`strong`,ul:`ul`,..._provideComponents(),...props.components},{Heading,Note,Warning}=_components;if(!Heading)_missingMdxReference(`Heading`,true);if(!Note)_missingMdxReference(`Note`,true);if(!Warning)_missingMdxReference(`Warning`,true);return _jsxs(_Fragment,{children:[_jsx(Warning,{children:_jsxs(_components.p,{children:[`You are reading the docs of Galtea 5.10. `,_jsx(_components.a,{href:`/concepts/metric/factual-accuracy`,children:`Read this page in the latest version`}),`.`]})}),`\n`,_jsxs(_components.p,{children:[`The `,_jsx(_components.strong,{children:`Factual Accuracy`}),` metric is a `,_jsx(_components.a,{href:`/v5.10/concepts/metric`,children:`non-deterministic Metric`}),` used by Galtea to evaluate the performance of your AI products, especially in Retrieval-Augmented Generation (RAG) and question answering systems. It measures whether the information in the model’s output is factually correct, complete, and appropriately addresses the user’s input when compared to a trusted reference answer.`]}),`\n`,_jsx(_components.p,{children:`This metric helps ensure that your LLM-generated responses are not only relevant and factually accurate, but also comprehensive enough to adequately answer the user’s question, reducing the risk of hallucinations, misinformation, or incomplete responses in your product’s outputs.`}),`\n`,_jsx(Heading,{level:`2`,id:`evaluation-parameters`,children:`Evaluation Parameters`}),`\n`,_jsxs(_components.p,{children:[`To compute the `,_jsx(_components.code,{children:`factual_accuracy`}),` metric, the following parameters are required:`]}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.strong,{children:_jsx(_components.code,{children:`input`})}),`: The original user query or question that prompted the response.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.strong,{children:_jsx(_components.code,{children:`expected_output`})}),`: The reference or ground truth answer that the model’s output should be compared against.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.strong,{children:_jsx(_components.code,{children:`actual_output`})}),`: The response generated by your LLM application.`]}),`\n`]}),`\n`,_jsx(Heading,{level:`2`,id:`how-is-it-calculated`,children:`How Is It Calculated?`}),`\n`,_jsx(_components.p,{children:`Factual Accuracy is computed using an LLM-as-a-judge process that evaluates the response on three key dimensions: accuracy, completeness, and relevance, in the following sense:`}),`\n`,_jsxs(_components.ol,{children:[`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Accuracy:`}),` whether the information is correct and consistent with what is expected.`]}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Completeness:`}),` whether all relevant points from the input are properly addressed.`]}),`\n`]}),`\n`,_jsxs(_components.li,{children:[`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Relevance:`}),` whether the content stays focused on the topic without adding unnecessary or unsupported material.`]}),`\n`]}),`\n`]}),`\n`,_jsx(_components.p,{children:`Each of these aspects is carefully verified to ensure the output fully meets the required standards before a final judgment is made.`}),`\n`,_jsx(_components.p,{children:`Finally, the final score is determined based on these details:`}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.strong,{children:`Score 1`}),`: Response aligns with the reference answer with no errors, omissions, or unsupported additions`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.strong,{children:`Score 0`}),`: Response contains factual errors, omits essential information needed for the input, or includes unsupported content`]}),`\n`]}),`\n`,_jsx(_components.p,{children:`The scoring system provides granular feedback on response quality, allowing you to identify and address different types of factual accuracy issues in your AI system.`}),`\n`,_jsx(Note,{children:`This metric is inspired by best practices in the open source community and is implemented natively in the Galtea platform.`}),`\n`,_jsx(Heading,{level:`2`,id:`suggested-test-case-types`,children:`Suggested Test Case Types`}),`\n`,_jsx(_components.p,{children:`The Factual Accuracy metric is effective for evaluating Accuracy test cases in Galtea, since it assesses the model’s ability to maintain factual correctness.`})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"codeStyling":"system","config":{},"pageMetadata":{"title":"Factual Accuracy","description":"Evaluates whether the generated output is factually accurate and adequately addresses the user's input when compared to the reference answer.","href":"/v5.10/concepts/metric/factual-accuracy"}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[{"title":"Evaluation Parameters","slug":"evaluation-parameters","depth":2,"children":[]},{"title":"How Is It Calculated?","slug":"how-is-it-calculated","depth":2,"children":[]},{"title":"Suggested Test Case Types","slug":"suggested-test-case-types","depth":2,"children":[]}],"codeExamples":{}},"jsLinks":["/_mintlify/custom/galtea/d232846d89fbe5a1/galtea-assistant.js"],"subdomain":"galtea","siteName":"Galtea Docs","title":"Factual Accuracy - Galtea Docs","navMaps":{"firstHrefInVersion":{"5.18":{"href":"/concepts/metric/factual-accuracy","matchLevel":1},"5.17":{"href":"/v5.17/concepts/metric/factual-accuracy","matchLevel":1},"5.16":{"href":"/v5.16/concepts/metric/factual-accuracy","matchLevel":1},"5.15":{"href":"/v5.15/concepts/metric/factual-accuracy","matchLevel":1},"5.14":{"href":"/v5.14/concepts/metric/factual-accuracy","matchLevel":1},"5.13":{"href":"/v5.13/concepts/metric/factual-accuracy","matchLevel":1},"5.12":{"href":"/v5.12/concepts/metric/factual-accuracy","matchLevel":1},"5.11":{"href":"/v5.11/concepts/metric/factual-accuracy","matchLevel":1},"5.10":{"href":"/v5.10/concepts/metric/factual-accuracy","matchLevel":0}},"firstHrefInLanguage":{}},"lastModified":"2026-11-17T11:08:27.765Z","originalFileLocation":"v5.10/concepts/metric/factual-accuracy.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Evaluates whether the generated output is factually accurate and adequately addresses the user\u0026#x27;s input when compared to the reference answer.\">\u003cmeta data-mint-head name=\"application-name\" content=\"Galtea Docs\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Factual Accuracy - Galtea Docs\">\u003cmeta data-mint-head property=\"og:description\" content=\"Evaluates whether the generated output is factually accurate and adequately addresses the user\u0026#x27;s input when compared to the reference answer.\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Galtea Docs\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.galtea.ai/v5.10/concepts/metric/factual-accuracy\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://galtea.mintlify.site/_mintlify/api/og/v2?division=RAG\u0026amp;title=Factual+Accuracy\u0026amp;description=Evaluates+whether+the+generated+output+is+factually+accurate+and+adequately+addresses+the+user%27s+input+when+compared+to+the+reference+answer.\u0026amp;theme=fd2f90730a25c88261e3323d\u0026amp;signature=d75c299356f42e5462e9224edb4577950cedd56c40a5d1931a8e6c33ec955d08\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Factual Accuracy - Galtea Docs\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Evaluates whether the generated output is factually accurate and adequately addresses the user\u0026#x27;s input when compared to the reference answer.\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://galtea.mintlify.site/_mintlify/api/og/v2?division=RAG\u0026amp;title=Factual+Accuracy\u0026amp;description=Evaluates+whether+the+generated+output+is+factually+accurate+and+adequately+addresses+the+user%27s+input+when+compared+to+the+reference+answer.\u0026amp;theme=fd2f90730a25c88261e3323d\u0026amp;signature=d75c299356f42e5462e9224edb4577950cedd56c40a5d1931a8e6c33ec955d08\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Galtea Docs\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#5286FF\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.galtea.ai/v5.10/concepts/metric/factual-accuracy\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/v5.10/concepts/metric/factual-accuracy.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.galtea.ai/#organization\",\"name\":\"Galtea Docs\",\"url\":\"https://docs.galtea.ai\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/light.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=52a5941e3fa4d5af453da96cfa8d07e5\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.galtea.ai#website\",\"name\":\"Galtea Docs\",\"url\":\"https://docs.galtea.ai\",\"publisher\":{\"@id\":\"https://docs.galtea.ai/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.galtea.ai/v5.10/concepts/metric/factual-accuracy#webpage\",\"url\":\"https://docs.galtea.ai/v5.10/concepts/metric/factual-accuracy\",\"name\":\"Factual Accuracy\",\"description\":\"Evaluates whether the generated output is factually accurate and adequately addresses the user's input when compared to the reference answer.\",\"dateModified\":\"2026-11-17T11:08:27.765Z\",\"isPartOf\":{\"@id\":\"https://docs.galtea.ai#website\"},\"breadcrumb\":{\"@id\":\"https://docs.galtea.ai/v5.10/concepts/metric/factual-accuracy#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.galtea.ai/v5.10/concepts/metric/factual-accuracy#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Concepts\",\"item\":\"https://docs.galtea.ai/v5.10/concepts/product\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Metrics\",\"item\":\"https://docs.galtea.ai/v5.10/concepts/metric\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Factual Accuracy\",\"item\":\"https://docs.galtea.ai/v5.10/concepts/metric/factual-accuracy\"}]},{\"@type\":[\"Article\",\"TechArticle\"],\"@id\":\"https://docs.galtea.ai/v5.10/concepts/metric/factual-accuracy#article\",\"headline\":\"Factual Accuracy\",\"name\":\"Factual Accuracy\",\"description\":\"Evaluates whether the generated output is factually accurate and adequately addresses the user's input when compared to the reference answer.\",\"url\":\"https://docs.galtea.ai/v5.10/concepts/metric/factual-accuracy\",\"mainEntityOfPage\":{\"@id\":\"https://docs.galtea.ai/v5.10/concepts/metric/factual-accuracy#webpage\"},\"dateModified\":\"2026-11-17T11:08:27.765Z\",\"publisher\":{\"@id\":\"https://docs.galtea.ai/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.galtea.ai#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Galtea Docs\",\"publisher\":{\"@type\":\"Organization\",\"name\":\"Galtea Docs\"},\"provider\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","agentPointerHref":"/v5.10/concepts/metric/factual-accuracy.md","siteName":"Galtea Docs","nav":{"global":{"anchors":[{"anchor":"Blog","icon":"newspaper","href":"https://galtea.ai/blog"},{"anchor":"Changelog","icon":"list-check","href":"https://docs.galtea.ai/changelog"}]},"versions":[{"version":"5.18","default":true,"tag":"Latest","pages":[{"title":"5.18","href":"/concepts/metric/factual-accuracy"}]},{"version":"5.17","pages":[{"title":"5.17","href":"/v5.17/concepts/metric/factual-accuracy"}]},{"version":"5.16","pages":[{"title":"5.16","href":"/v5.16/concepts/metric/factual-accuracy"}]},{"version":"5.15","pages":[{"title":"5.15","href":"/v5.15/concepts/metric/factual-accuracy"}]},{"version":"5.14","pages":[{"title":"5.14","href":"/v5.14/concepts/metric/factual-accuracy"}]},{"version":"5.13","pages":[{"title":"5.13","href":"/v5.13/concepts/metric/factual-accuracy"}]},{"version":"5.12","pages":[{"title":"5.12","href":"/v5.12/concepts/metric/factual-accuracy"}]},{"version":"5.11","pages":[{"title":"5.11","href":"/v5.11/concepts/metric/factual-accuracy"}]},{"version":"5.10","tabs":[{"tab":"Guides","pages":[{"title":"Guides","href":"/v5.10/introduction"}]},{"tab":"Concepts","groups":[{"group":"Introduction","pages":[{"title":"Overview","sidebarTitle":"Overview","icon":"diagram-project","href":"/v5.10/concepts/overview"}]},{"group":"SDK","pages":[{"title":"Installation","icon":"box","href":"/v5.10/sdk/installation"},{"title":"Usage","icon":"code","href":"/v5.10/sdk/usage"},{"title":"Galtea Client","sidebarTitle":"Galtea Client","icon":"plug","href":"/v5.10/sdk/api/galtea"}]},{"group":"CLI","pages":[{"title":"Installation","icon":"box","href":"/v5.10/cli/installation"},{"title":"Usage","icon":"terminal","href":"/v5.10/cli/usage"}]},{"group":"Concepts","pages":[{"group":"Product","icon":"cube","pages":[{"title":"Product","sidebarTitle":"Overview","href":"/v5.10/concepts/product"},{"group":"SDK","icon":"code","pages":[{"title":"Product Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/product/service"},{"title":"Listing Products","sidebarTitle":"List","href":"/v5.10/sdk/api/product/list"},{"title":"Retrieving Product","sidebarTitle":"Get","href":"/v5.10/sdk/api/product/get"},{"title":"Retrieving Product By Name","sidebarTitle":"Get By Name","href":"/v5.10/sdk/api/product/get-by-name"},{"title":"Deleting Product","sidebarTitle":"Delete","href":"/v5.10/sdk/api/product/delete"}]}]},{"group":"Specification","icon":"bullseye","pages":[{"title":"Specification","sidebarTitle":"Overview","href":"/v5.10/concepts/product/specification"},{"group":"SDK","icon":"code","pages":[{"title":"Specifications Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/specification/service"},{"title":"Create Specification","sidebarTitle":"Create","href":"/v5.10/sdk/api/specification/create"},{"title":"Listing Specifications","sidebarTitle":"List","href":"/v5.10/sdk/api/specification/list"},{"title":"Retrieving Specification","sidebarTitle":"Get","href":"/v5.10/sdk/api/specification/get"},{"title":"Deleting Specification","sidebarTitle":"Delete","href":"/v5.10/sdk/api/specification/delete"},{"title":"Link Metrics","sidebarTitle":"Link Metrics","href":"/v5.10/sdk/api/specification/link-metrics"},{"title":"Unlink Metrics","sidebarTitle":"Unlink Metrics","href":"/v5.10/sdk/api/specification/unlink-metrics"},{"title":"Get Linked Metrics","sidebarTitle":"Get Metrics","href":"/v5.10/sdk/api/specification/get-metrics"},{"title":"Link Datasets","sidebarTitle":"Link Datasets","href":"/v5.10/sdk/api/specification/link-datasets"},{"title":"Unlink Datasets","sidebarTitle":"Unlink Datasets","href":"/v5.10/sdk/api/specification/unlink-datasets"},{"title":"Get Linked Datasets","sidebarTitle":"Get Datasets","href":"/v5.10/sdk/api/specification/get-datasets"}]}]},{"group":"Monitor","icon":"gauge-high","pages":[{"title":"Monitor","sidebarTitle":"Overview","href":"/v5.10/concepts/product/monitor"},{"group":"SDK","icon":"code","pages":[{"title":"Monitors Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/monitor/service"},{"title":"Create Monitor","sidebarTitle":"Create","href":"/v5.10/sdk/api/monitor/create"},{"title":"Listing Monitors","sidebarTitle":"List","href":"/v5.10/sdk/api/monitor/list"},{"title":"Retrieving Monitor","sidebarTitle":"Get","href":"/v5.10/sdk/api/monitor/get"},{"title":"Updating Monitor","sidebarTitle":"Update","href":"/v5.10/sdk/api/monitor/update"},{"title":"Pausing Monitor","sidebarTitle":"Pause","href":"/v5.10/sdk/api/monitor/pause"},{"title":"Resuming Monitor","sidebarTitle":"Resume","href":"/v5.10/sdk/api/monitor/resume"},{"title":"Deleting Monitor","sidebarTitle":"Delete","href":"/v5.10/sdk/api/monitor/delete"}]}]},{"group":"Version","icon":"code-branch","pages":[{"title":"Version","sidebarTitle":"Overview","href":"/v5.10/concepts/product/version"},{"group":"SDK","icon":"code","pages":[{"title":"Version Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/version/service"},{"title":"Create Version","sidebarTitle":"Create","href":"/v5.10/sdk/api/version/create"},{"title":"Get or Create Version","sidebarTitle":"Get or Create","href":"/v5.10/sdk/api/version/get-or-create"},{"title":"Listing Versions","sidebarTitle":"List","href":"/v5.10/sdk/api/version/list"},{"title":"Retrieving Version","sidebarTitle":"Get","href":"/v5.10/sdk/api/version/get"},{"title":"Retrieving Version By Name","sidebarTitle":"Get By Name","href":"/v5.10/sdk/api/version/get-by-name"},{"title":"Update Version","sidebarTitle":"Update","href":"/v5.10/sdk/api/version/update"},{"title":"Deleting Version","sidebarTitle":"Delete","href":"/v5.10/sdk/api/version/delete"}]}]},{"group":"Endpoint Connection","icon":"plug","pages":[{"title":"Endpoint Connection","sidebarTitle":"Overview","href":"/v5.10/concepts/product/endpoint-connection"},{"title":"Input Schema","sidebarTitle":"Input Schema","icon":"brackets-curly","href":"/v5.10/concepts/product/endpoint-connection-input-schema"},{"title":"Templates \u0026 Mapping","sidebarTitle":"Templates \u0026 Mapping","icon":"code","href":"/v5.10/concepts/product/endpoint-connection-configuration"},{"title":"Structured Input Template Syntax","sidebarTitle":"Template Syntax","icon":"brackets-curly","href":"/v5.10/concepts/product/endpoint-connection-template-syntax"},{"group":"SDK","icon":"code","pages":[{"title":"Endpoint Connection Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/endpoint-connection/service"},{"title":"Create Endpoint Connection","sidebarTitle":"Create","href":"/v5.10/sdk/api/endpoint-connection/create"},{"title":"List Endpoint Connections","sidebarTitle":"List","href":"/v5.10/sdk/api/endpoint-connection/list"},{"title":"Get Endpoint Connection","sidebarTitle":"Get","href":"/v5.10/sdk/api/endpoint-connection/get"},{"title":"Get Endpoint Connection By Name","sidebarTitle":"Get By Name","href":"/v5.10/sdk/api/endpoint-connection/get-by-name"},{"title":"Update Endpoint Connection","sidebarTitle":"Update","href":"/v5.10/sdk/api/endpoint-connection/update"},{"title":"Delete Endpoint Connection","sidebarTitle":"Delete","href":"/v5.10/sdk/api/endpoint-connection/delete"},{"title":"Test Connection","sidebarTitle":"Test Connection","href":"/v5.10/sdk/api/endpoint-connection/test-connection"}]}]},{"group":"Phone Connection","icon":"phone","pages":[{"title":"Phone Connection","sidebarTitle":"Overview","href":"/v5.10/concepts/product/phone-connection"},{"group":"SDK","icon":"code","pages":[{"title":"Phone Connection Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/phone-connection/service"},{"title":"Create Phone Connection","sidebarTitle":"Create","href":"/v5.10/sdk/api/phone-connection/create"},{"title":"List Phone Connections","sidebarTitle":"List","href":"/v5.10/sdk/api/phone-connection/list"},{"title":"Get Phone Connection","sidebarTitle":"Get","href":"/v5.10/sdk/api/phone-connection/get"},{"title":"Get Phone Connection By Name","sidebarTitle":"Get By Name","href":"/v5.10/sdk/api/phone-connection/get-by-name"},{"title":"Update Phone Connection","sidebarTitle":"Update","href":"/v5.10/sdk/api/phone-connection/update"},{"title":"Delete Phone Connection","sidebarTitle":"Delete","href":"/v5.10/sdk/api/phone-connection/delete"}]}]},{"group":"WebRTC Connection","icon":"tower-broadcast","pages":[{"title":"WebRTC Connection","sidebarTitle":"Overview","href":"/v5.10/concepts/product/webrtc-connection"},{"group":"SDK","icon":"code","pages":[{"title":"WebRTC Connection Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/webrtc-connection/service"},{"title":"Create WebRTC Connection","sidebarTitle":"Create","href":"/v5.10/sdk/api/webrtc-connection/create"},{"title":"List WebRTC Connections","sidebarTitle":"List","href":"/v5.10/sdk/api/webrtc-connection/list"},{"title":"Get WebRTC Connection","sidebarTitle":"Get","href":"/v5.10/sdk/api/webrtc-connection/get"},{"title":"Get WebRTC Connection By Name","sidebarTitle":"Get By Name","href":"/v5.10/sdk/api/webrtc-connection/get-by-name"},{"title":"Update WebRTC Connection","sidebarTitle":"Update","href":"/v5.10/sdk/api/webrtc-connection/update"},{"title":"Delete WebRTC Connection","sidebarTitle":"Delete","href":"/v5.10/sdk/api/webrtc-connection/delete"}]}]},{"group":"Dataset","icon":"vial-circle-check","pages":[{"title":"Dataset","sidebarTitle":"Overview","href":"/v5.10/concepts/product/dataset"},{"title":"Data Augmentation","sidebarTitle":"Data Augmentation","href":"/v5.10/concepts/product/dataset/data-augmentation"},{"title":"Extend Test Cases","sidebarTitle":"Extend Test Cases","icon":"layer-group","href":"/v5.10/concepts/product/dataset/extend-test-cases"},{"group":"Accuracy","icon":"certificate","pages":[{"title":"Accuracy Datasets","sidebarTitle":"Overview","href":"/v5.10/concepts/product/dataset/accuracy-datasets"}]},{"group":"Security \u0026 Safety","icon":"shield-check","pages":[{"title":"Security \u0026 Safety Datasets","sidebarTitle":"Overview","href":"/v5.10/concepts/product/dataset/security-datasets"},{"title":"Threats","href":"/v5.10/concepts/product/dataset/security-threats"},{"title":"Strategies","href":"/v5.10/concepts/product/dataset/security-strategies"}]},{"group":"Behavior","icon":"person-walking","pages":[{"title":"Behavior Datasets","sidebarTitle":"Overview","href":"/v5.10/concepts/product/dataset/behavior-datasets"}]},{"group":"SDK","icon":"code","pages":[{"title":"Dataset Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/dataset/service"},{"title":"Create Dataset","sidebarTitle":"Create","href":"/v5.10/sdk/api/dataset/create"},{"title":"Listing Datasets","sidebarTitle":"List","href":"/v5.10/sdk/api/dataset/list"},{"title":"Retrieving Dataset","sidebarTitle":"Get","href":"/v5.10/sdk/api/dataset/get"},{"title":"Retrieving Dataset By Name","sidebarTitle":"Get By Name","href":"/v5.10/sdk/api/dataset/get-by-name"},{"title":"Update Dataset","sidebarTitle":"Update","href":"/v5.10/sdk/api/dataset/update"},{"title":"Deleting Dataset","sidebarTitle":"Delete","href":"/v5.10/sdk/api/dataset/delete"},{"title":"Downloading Dataset","sidebarTitle":"Download","href":"/v5.10/sdk/api/dataset/download"}]}]},{"group":"Test Case","icon":"list","pages":[{"title":"Test Case","sidebarTitle":"Overview","href":"/v5.10/concepts/product/dataset/test-case"},{"group":"SDK","icon":"code","pages":[{"title":"Test Case Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/test-case/service"},{"title":"Create Test Case","sidebarTitle":"Create","href":"/v5.10/sdk/api/test-case/create"},{"title":"Upload Input File","sidebarTitle":"Upload Input File","href":"/v5.10/sdk/api/test-case/upload-input-file"},{"title":"Listing Test Cases","sidebarTitle":"List","href":"/v5.10/sdk/api/test-case/list"},{"title":"Retrieving Test Case","sidebarTitle":"Get","href":"/v5.10/sdk/api/test-case/get"},{"title":"Deleting Test Case","sidebarTitle":"Delete","href":"/v5.10/sdk/api/test-case/delete"}]}]},{"group":"Conversation Simulator","icon":"comments","pages":[{"title":"Conversation Simulator","sidebarTitle":"Overview","icon":"comments","href":"/v5.10/concepts/product/dataset/test-case/conversation-simulator"},{"group":"SDK","icon":"code","pages":[{"title":"Simulator Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/simulator/service"},{"title":"Simulate Conversation","sidebarTitle":"Simulate","href":"/v5.10/sdk/api/simulator/simulate"}]}]},{"group":"Agent","icon":"robot","pages":[{"title":"AgentInput","icon":"inbox","href":"/v5.10/sdk/api/agent/input"}]},{"group":"Session","icon":"clock-rotate-left","pages":[{"title":"Session","sidebarTitle":"Overview","href":"/v5.10/concepts/product/version/session"},{"group":"SDK","icon":"code","pages":[{"title":"Session Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/session/service"},{"title":"Create Session","sidebarTitle":"Create","href":"/v5.10/sdk/api/session/create"},{"title":"Get Or Create Session","sidebarTitle":"Get Or Create","href":"/v5.10/sdk/api/session/get-or-create"},{"title":"List Sessions","sidebarTitle":"List","href":"/v5.10/sdk/api/session/list"},{"title":"Get Session","sidebarTitle":"Get","href":"/v5.10/sdk/api/session/get"},{"title":"Get Session By Custom ID","sidebarTitle":"Get By Custom ID","href":"/v5.10/sdk/api/session/get-by-custom-id"},{"title":"Delete Session","sidebarTitle":"Delete","href":"/v5.10/sdk/api/session/delete"},{"title":"Update Session","sidebarTitle":"Update","href":"/v5.10/sdk/api/session/update"},{"title":"Finish Session","sidebarTitle":"Finish","href":"/v5.10/sdk/api/session/finish"}]}]},{"group":"Trace","icon":"arrow-right-from-bracket","pages":[{"title":"Trace","sidebarTitle":"Overview","href":"/v5.10/concepts/product/version/session/trace"},{"group":"SDK","icon":"code","pages":[{"title":"Trace Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/trace/service"},{"title":"Generate Trace","sidebarTitle":"Generate","href":"/v5.10/sdk/api/trace/generate"},{"title":"Create Trace","sidebarTitle":"Create","href":"/v5.10/sdk/api/trace/create"},{"title":"Create and Evaluate Trace","sidebarTitle":"Create and Evaluate","href":"/v5.10/sdk/api/trace/create-and-evaluate"},{"title":"Create Trace Batch","sidebarTitle":"Create Batch","href":"/v5.10/sdk/api/trace/create-batch"},{"title":"Update Trace","sidebarTitle":"Update","href":"/v5.10/sdk/api/trace/update"},{"title":"Upload Output File","sidebarTitle":"Upload Output File","href":"/v5.10/sdk/api/trace/upload-output-file"},{"title":"List Traces","sidebarTitle":"List","href":"/v5.10/sdk/api/trace/list"},{"title":"Get Trace","sidebarTitle":"Get","href":"/v5.10/sdk/api/trace/get"},{"title":"Delete Trace","sidebarTitle":"Delete","href":"/v5.10/sdk/api/trace/delete"}]}]},{"group":"Span","icon":"sitemap","pages":[{"title":"Span","sidebarTitle":"Overview","href":"/v5.10/concepts/product/version/session/span"},{"group":"SDK","icon":"code","pages":[{"title":"Span Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/span/service"},{"title":"start_span","sidebarTitle":"Start span","href":"/v5.10/sdk/api/span/start-span"},{"title":"Set Context","href":"/v5.10/sdk/api/span/set-context"},{"title":"Clear Context","href":"/v5.10/sdk/api/span/clear-context"},{"title":"Create Span","sidebarTitle":"Create","href":"/v5.10/sdk/api/span/create"},{"title":"Create Span Batch","sidebarTitle":"Create Batch","href":"/v5.10/sdk/api/span/create-batch"},{"title":"List Spans","sidebarTitle":"List","href":"/v5.10/sdk/api/span/list"},{"title":"Get Span","sidebarTitle":"Get","href":"/v5.10/sdk/api/span/get"},{"title":"Delete Span","sidebarTitle":"Delete","href":"/v5.10/sdk/api/span/delete"},{"title":"@traced Decorator","href":"/v5.10/sdk/api/span/traced-decorator"}]}]},{"group":"Metrics","icon":"gauge","pages":[{"title":"Metric","sidebarTitle":"Overview","href":"/v5.10/concepts/metric"},{"title":"Evaluation Types","sidebarTitle":"Evaluation Types","icon":"layer-group","href":"/v5.10/concepts/metric/evaluation-types"},{"title":"Evaluation Parameters","sidebarTitle":"Evaluation Parameters","icon":"sliders","href":"/v5.10/concepts/metric/evaluation-parameters"},{"title":"AI Metric Generation","sidebarTitle":"AI Generation","icon":"sparkles","href":"/v5.10/concepts/metric/ai-generation"},{"title":"Classifier (Jev)","sidebarTitle":"Classifier (Jev)","icon":"bolt","href":"/v5.10/concepts/metric/classifier"},{"group":"SDK","icon":"code","pages":[{"title":"Metrics Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/metric/service"},{"title":"Create Metric","sidebarTitle":"Create","href":"/v5.10/sdk/api/metric/create"},{"title":"Listing Metrics","sidebarTitle":"List","href":"/v5.10/sdk/api/metric/list"},{"title":"Retrieving Metric","sidebarTitle":"Get","href":"/v5.10/sdk/api/metric/get"},{"title":"Retrieving Metric By Name","sidebarTitle":"Get By Name","href":"/v5.10/sdk/api/metric/get-by-name"},{"title":"Deleting Metric","sidebarTitle":"Delete","href":"/v5.10/sdk/api/metric/delete"},{"title":"Setting Analytics Exclusion","sidebarTitle":"Set Analytics Exclusion","href":"/v5.10/sdk/api/metric/set-analytics-exclusion"},{"title":"Getting Analytics Exclusion Impact","sidebarTitle":"Get Analytics Exclusion Impact","description":"Get the results and products affected by excluding a metric revision from analytics.","href":"/v5.10/sdk/api/metric/get-analytics-exclusion-impact"}]},{"group":"RAG","icon":"magnifying-glass-chart","pages":[{"title":"Factual Accuracy","href":"/v5.10/concepts/metric/factual-accuracy"},{"title":"Resilience To Noise","description":"Measures a language model's robustness to input noise such as typos, OCR/ASR errors, grammatical mistakes, and distracting content.","href":"/v5.10/concepts/metric/resilience-to-noise"},{"title":"Answer Relevancy","href":"/v5.10/concepts/metric/answer-relevancy"},{"title":"Faithfulness","href":"/v5.10/concepts/metric/faithfulness"},{"title":"Contextual Precision","href":"/v5.10/concepts/metric/contextual-precision"},{"title":"Contextual Recall","href":"/v5.10/concepts/metric/contextual-recall"},{"title":"Contextual Relevancy","href":"/v5.10/concepts/metric/contextual-relevancy"}]},{"group":"Conversational","icon":"message","pages":[{"title":"Knowledge Retention","href":"/v5.10/concepts/metric/knowledge-retention"},{"title":"Role Adherence","href":"/v5.10/concepts/metric/role-adherence"},{"title":"Conversation Completeness","href":"/v5.10/concepts/metric/conversation-completeness"},{"title":"Conversation Relevancy","href":"/v5.10/concepts/metric/conversation-relevancy"},{"title":"User Satisfaction","href":"/v5.10/concepts/metric/user-satisfaction"},{"title":"User Objective Accomplished","href":"/v5.10/concepts/metric/user-objective-accomplished"}]},{"group":"Security \u0026 Safety","icon":"shield-check","pages":[{"title":"Misuse Resilience","href":"/v5.10/concepts/metric/misuse-resilience"},{"title":"Non-Toxic","href":"/v5.10/concepts/metric/non-toxic"},{"title":"Unbiased","href":"/v5.10/concepts/metric/unbiased"},{"title":"Jailbreak Resilience","href":"/v5.10/concepts/metric/jailbreak-resilience"},{"title":"Data Leakage","href":"/v5.10/concepts/metric/data-leakage"}]},{"group":"Deterministic","icon":"calculator","pages":[{"title":"BLEU","href":"/v5.10/concepts/metric/bleu"},{"title":"ROUGE","href":"/v5.10/concepts/metric/rouge"},{"title":"METEOR","href":"/v5.10/concepts/metric/meteor"},{"title":"Text Similarity","href":"/v5.10/concepts/metric/text-similarity"},{"title":"Text Match (Deprecated)","href":"/v5.10/concepts/metric/text-match"},{"title":"IOU","href":"/v5.10/concepts/metric/iou"},{"title":"Spatial Match","href":"/v5.10/concepts/metric/spatial-match"},{"title":"URL Validation","href":"/v5.10/concepts/metric/url-validation"},{"title":"Tool Correctness","href":"/v5.10/concepts/metric/tool-correctness"},{"title":"JSON Field Match","href":"/v5.10/concepts/metric/json-field-match"},{"title":"JSON Field Match (Normalized)","href":"/v5.10/concepts/metric/json-field-match-normalized"},{"title":"JSON Field Match (Strict)","href":"/v5.10/concepts/metric/json-field-match-strict"},{"title":"JSON Field Match (Normalized, Strict)","href":"/v5.10/concepts/metric/json-field-match-normalized-strict"}]}]},{"group":"Evaluation","icon":"clipboard-check","pages":[{"title":"Evaluation","sidebarTitle":"Overview","href":"/v5.10/concepts/product/version/session/evaluation"},{"group":"SDK","icon":"code","pages":[{"title":"Evaluation Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/evaluation/service"},{"title":"Run Evaluation","sidebarTitle":"Run","href":"/v5.10/sdk/api/evaluation/run"},{"title":"Create Single-Turn Evaluation","sidebarTitle":"Create Single-Turn","href":"/v5.10/sdk/api/evaluation/create-single-turn"},{"title":"Create Evaluations","sidebarTitle":"Create","href":"/v5.10/sdk/api/evaluation/create"},{"title":"Waiting for Evaluations","sidebarTitle":"Wait For","href":"/v5.10/sdk/api/evaluation/wait-for"},{"title":"Listing Evaluations","sidebarTitle":"List","href":"/v5.10/sdk/api/evaluation/list"},{"title":"Retrieving Evaluation","sidebarTitle":"Get","href":"/v5.10/sdk/api/evaluation/get"},{"title":"Retrying Evaluations","sidebarTitle":"Retry","href":"/v5.10/sdk/api/evaluation/retry"},{"title":"Deleting Evaluation","sidebarTitle":"Delete","href":"/v5.10/sdk/api/evaluation/delete"}]}]},{"group":"Run","icon":"rocket","pages":[{"title":"Run","sidebarTitle":"Overview","href":"/v5.10/concepts/product/run"},{"group":"SDK","icon":"code","pages":[{"title":"Runs Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/run/service"},{"title":"Start Run","sidebarTitle":"Start","href":"/v5.10/sdk/api/run/start"},{"title":"List Runs","sidebarTitle":"List","href":"/v5.10/sdk/api/run/list"},{"title":"Get Run","sidebarTitle":"Get","href":"/v5.10/sdk/api/run/get"},{"title":"Get Run By Custom ID","sidebarTitle":"Get By Custom ID","href":"/v5.10/sdk/api/run/get-by-custom-id"},{"title":"Close Run","sidebarTitle":"Close","href":"/v5.10/sdk/api/run/close"},{"title":"Delete Run","sidebarTitle":"Delete","href":"/v5.10/sdk/api/run/delete"}]}]},{"group":"Job","icon":"circle-stop","pages":[{"group":"SDK","icon":"code","pages":[{"title":"Jobs Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/job/service"},{"title":"Get Job Status","sidebarTitle":"Get Status","href":"/v5.10/sdk/api/job/get-status"},{"title":"Cancel Job","sidebarTitle":"Cancel","href":"/v5.10/sdk/api/job/cancel"}]}]},{"group":"Storage","icon":"box","pages":[{"group":"SDK","icon":"code","pages":[{"title":"Storage Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/storage/service"},{"title":"Upload File","sidebarTitle":"Upload","href":"/v5.10/sdk/api/storage/upload"},{"title":"Download File","sidebarTitle":"Download","href":"/v5.10/sdk/api/storage/download"},{"title":"Read File","sidebarTitle":"Read","href":"/v5.10/sdk/api/storage/read"}]}]},{"group":"User Group","icon":"users","pages":[{"title":"User Group","sidebarTitle":"Overview","href":"/v5.10/concepts/user-group"},{"group":"SDK","icon":"code","pages":[{"title":"User Groups Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/user-group/service"},{"title":"Create User Group","sidebarTitle":"Create","href":"/v5.10/sdk/api/user-group/create"},{"title":"Listing User Groups","sidebarTitle":"List","href":"/v5.10/sdk/api/user-group/list"},{"title":"Retrieving User Group","sidebarTitle":"Get","href":"/v5.10/sdk/api/user-group/get"},{"title":"Retrieving User Group by Name","sidebarTitle":"Get by Name","href":"/v5.10/sdk/api/user-group/get-by-name"},{"title":"Update User Group","sidebarTitle":"Update","href":"/v5.10/sdk/api/user-group/update"},{"title":"Delete User Group","sidebarTitle":"Delete","href":"/v5.10/sdk/api/user-group/delete"},{"title":"Link Users","sidebarTitle":"Link Users","href":"/v5.10/sdk/api/user-group/link-users"},{"title":"Unlink Users","sidebarTitle":"Unlink Users","href":"/v5.10/sdk/api/user-group/unlink-users"},{"title":"Link Metrics","sidebarTitle":"Link Metrics","href":"/v5.10/sdk/api/user-group/link-metrics"},{"title":"Unlink Metrics","sidebarTitle":"Unlink Metrics","href":"/v5.10/sdk/api/user-group/unlink-metrics"},{"title":"Link Products","sidebarTitle":"Link Products","href":"/v5.10/sdk/api/user-group/link-products"},{"title":"Unlink Products","sidebarTitle":"Unlink Products","href":"/v5.10/sdk/api/user-group/unlink-products"}]}]},{"group":"Model","icon":"microchip","pages":[{"title":"Model","sidebarTitle":"Overview","href":"/v5.10/concepts/model"},{"group":"SDK","icon":"code","pages":[{"title":"Model Service","sidebarTitle":"Service","href":"/v5.10/sdk/api/model/service"},{"title":"Create Model","sidebarTitle":"Create","href":"/v5.10/sdk/api/model/create"},{"title":"List Models","sidebarTitle":"List","href":"/v5.10/sdk/api/model/list"},{"title":"Get Model","sidebarTitle":"Get","href":"/v5.10/sdk/api/model/get"},{"title":"Get Model By Name","sidebarTitle":"Get By Name","href":"/v5.10/sdk/api/model/get-by-name"},{"title":"Update Model","sidebarTitle":"Update","href":"/v5.10/sdk/api/model/update"},{"title":"Delete Model","sidebarTitle":"Delete","href":"/v5.10/sdk/api/model/delete"}]}]}]}]},{"tab":"Deployment","pages":[{"title":"Deployment","href":"/v5.10/deployment/executive-summary"}]},{"tab":"REST API","pages":[{"title":"REST API","href":"/v5.10/api-reference/health-check"}]}]}]},"basePath":"","title":"Factual Accuracy - Galtea Docs","deploymentId":"dpl_HhUetB7eHHDAmK9T1Teip38TgFx9","buildId":"dpl_HhUetB7eHHDAmK9T1Teip38TgFx9","dynamics":[],"chunks":[]}