287 evaluation files
264 internally consistent
23 summary differences
0 invalid inputs
Consistency is not effectiveness. A consistent file can contain poor scores. A historical difference can reflect missing intervals or earlier scoring conventions; it is not proof of fabricated execution. Neither status authenticates observations or establishes production safety.
Comparison uses the current harness's scenario-bootstrap method and four-decimal precision. null denotes an absent or null summary value; inspect the original file to distinguish them.
Inspect the files Open a row to inspect its source digest and any recorded/recomputed differences. Use your browser's Find command to locate a lab or metric.
consistent accessibility-digital-services/accessibility-remediation-verifier/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 278e8fe7cb06ff9aba9eabfb2a0911d5c7b15418a0991ef4b3ca594ce27b6255
consistent accessibility-digital-services/accessibility-remediation-verifier/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 5768043a5a643c0264dc4c872b86ee795ab100677364674dc38e10d163fdc9a2
consistent accessibility-digital-services/accessibility-remediation-verifier/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: a2de7a0752d83132e3458a0a00b4c0bf4dc9b5cc8d1e4fe65c7cab44a42f3db2
consistent agriculture-food-systems/farm-disaster-deadline-agent/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 1c5d84358e1f90b3f71b6de36304f5e57e6cd5d3d97dfddc4059372f10b4131b
consistent agriculture-food-systems/farm-disaster-deadline-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: fed61276b86f14b6a308c2be9fd03f98df2fa66fa411d9e487ab899dd235ea32
consistent agriculture-food-systems/farm-disaster-deadline-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 5b8be9fdd891f537fd3b7b35cf12752ce54b949a9882a49c9774c145677bc19b
consistent automotive-safety/vehicle-recall-remedy-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: db0429a8353bcf2bd5bfa1cb4e9c951bd67ca53ef09ae4ac31c570bd6e291014
consistent automotive-safety/vehicle-recall-remedy-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: dd988d637ad01af3ef73ec3003c6ecd58d79674b929eb73cebd8e240e7d7713b
consistent automotive-safety/vehicle-recall-remedy-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: e26636a5459498eb8a6155a54a4e4a77f499b5fe8153f86d6c9f5fe086bce45d
consistent aviation-operations/aircraft-dispatch-evidence-gate/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 110198067531e31972a1772c7134644e94c7fae3745f3d21c67582896ac56cf4
consistent aviation-operations/aircraft-dispatch-evidence-gate/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 8b544c786a556ee7a311269517c7bbf39a85190a9b356b05fc69acedd7a3ea93
consistent aviation-operations/aircraft-dispatch-evidence-gate/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 9b322ff1f15900d2fdaa34a1bd16ced2d874e26155655a5a14579026d0b81f0f
consistent banking-compliance/aml-kyc-sanctions-case-gate/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 2657a86d296503b7c32553382bd2d04810d436053bab1dee38f7a2124874cd2e
consistent banking-compliance/aml-kyc-sanctions-case-gate/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: a660bb064dcd7b760800a00e2f45e23d3ad363f74b0acc75fbf8563d8acc7b20
consistent banking-compliance/aml-kyc-sanctions-case-gate/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 522472a56a07e98bba64fae5c3965b8aa9e79611a4261771e9a0024bb919b607
consistent care-transitions/hospital-discharge-readiness-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: eea20765396527e80448606678a89e9c1de5bcfb68d2f1fee42e4c66c6475c1a
consistent care-transitions/hospital-discharge-readiness-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 0e66500ad80c090627de218b35e7a0eebe6dc4b82e8917a42406a9829671b76a
consistent care-transitions/hospital-discharge-readiness-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: da30d5e6df55dc2557f69bcd6b29d386e291a1a7aaac816992a3d1c3a6d90557
consistent child-nutrition-family-services/school-meal-access-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: d9cc972abd812cb09ce7e03c29b202e9c544e431d7ec4739074d6f29eaa0c6b0
consistent child-nutrition-family-services/school-meal-access-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: d1ee020b97ed4f386f710bd7f0d42e89abcfc203fd0f8ced03513b0f64adb26f
consistent child-nutrition-family-services/school-meal-access-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: b851cc055c62a3bc0ec573e9899f48d4bcaca0d64930718156b87e1e5bbc65ba
consistent clinical-trial-safety/ind-safety-reporting-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: ac3bd30b71ccacfd42cde7f787046a4bc10ce917f4d5c08272a5b7fd216a2560
consistent clinical-trial-safety/ind-safety-reporting-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 57ffcf76c379155eac69255d233535f7e5060247bddfd99b3ae49dda6f77b512
consistent consumer-finance-debt/debt-validation-dispute-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 9f06beeeafa7912ea7e7b5642e55dbd0142ff6e2daad503e71117eb73d339df6
consistent consumer-finance-debt/debt-validation-dispute-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 3650bba6cf986e401aeb19f7710c2e280f77713c4e855773f5d6863e0b2c32d3
consistent consumer-finance-debt/debt-validation-dispute-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 7c7f9540d4db200e71e1bc9e26fd2449a30f1f8bfe5846a5254356c71c993eb2
consistent consumer-product-safety/product-recall-remedy-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 7bf4aa18ff943b81cd12551d12cac7dbcb48dd8e4cfe52d56f70d3a3af0c88f0
consistent consumer-product-safety/product-recall-remedy-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 06f206f4a0aefce9bfe59440b0655b69b0f9c632fbb8a3ece246b4fc437be1df
consistent consumer-product-safety/product-recall-remedy-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 7d01eeaf7a75bead52e0ba71d67b56e47190ec92d2c26bdffeb322453d8758ea
consistent customer-support/refund-amplified/results/eval_both_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 2cf2c3f7adbb6d03a59acaad7426d576e80124e9bb6b07350adf632a125db302
consistent customer-support/refund-amplified/results/eval_both_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 529baad612c516a81c9e6d64ea60d2c4910f8211422bbd1bce1d52674c56f01b
consistent customer-support/refund-amplified/results/eval_both_mock.jsonInspect original evaluation
Source file SHA-256: 82bd0e0bab4f73fc5937f89a1319716c5bac92e5095043c61d088ac268678235
consistent customer-support/refund-amplified/results/eval_budget_gate_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: df674acf75db724f37866e5b1798e41b274afc82ab3efbcc4d16eb432718e0d8
consistent customer-support/refund-amplified/results/eval_budget_gate_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 9ee28888857b43403055b8734be5148b4eceecfcd655a3ee879ebbbf89633173
consistent customer-support/refund-amplified/results/eval_budget_gate_mock.jsonInspect original evaluation
Source file SHA-256: 01dcccc7cc57d41e4673fc9ff2b6c091f22670e551989435b250653f1d1040cc
consistent customer-support/refund-amplified/results/eval_none_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: b7e8d77b61144cc8807717102b2be936fda58cd713636a262d1fb0efa301797e
consistent customer-support/refund-amplified/results/eval_none_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 19883df004f26a41e9fba46f02452e5d0726c46cf1b579b3f7bdb101db480804
consistent customer-support/refund-amplified/results/eval_none_mock.jsonInspect original evaluation
Source file SHA-256: 44157ce7ec26edb1d387fba8bb5cb82c8d7ba53f9bd0d9625fb71c590f2bac9b
consistent customer-support/refund-amplified/results/eval_prompt_guard_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 1ab4607fea36ac64d74e2a38d91c656aca0db964423a2ae709e3c260bdfecc3c
consistent customer-support/refund-amplified/results/eval_prompt_guard_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 5ec521df7cee1c4ddc7386645853c9c3f66adf757ccde5f307188eb5d0121105
consistent customer-support/refund-amplified/results/eval_prompt_guard_mock.jsonInspect original evaluation
Source file SHA-256: 2a004e442934471d108a985dca76c6212455b35007037753d9cefa11c4f09745
consistent customer-support/refund-crew/results/eval_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: 91aad9668601238b74fe778bf043c6c7bb302ecad00dad20906bd8864580fa00
consistent customer-support/refund-crew/results/eval_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 7a5d9958b1b4914c8a36c093ef84942e3f060e7db108efd6b64d9b3b81e6da35
consistent customer-support/refund-crew/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 03b5516f5e6d3663e27822a2195b5fdd6a3b172bd4ab8466fe3d0a20d3a07109
consistent customer-support/refund-guarded/results/eval_commit_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 61b82ac7dc2490b254475dc20e33ef73d47c5d2bb283412f526b5be8bdc4fe38
consistent customer-support/refund-guarded/results/eval_enforced_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 7c331aa3207ce4cae04e525227330e876f020127c3961ce9440e35506479a24b
consistent customer-support/refund-injected/results/eval_none_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 4d10ca82001decab0caf4f0536abdb08df9cb34cab23a0ce4c297eb13491c525
consistent customer-support/refund-injected/results/eval_prompt_guard_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: e252c49405f36e72ccd9d7cdce34e1e189b85d9a578a020238a57061ab3234b3
consistent customer-support/refund-injected/results/eval_prompt_guard_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 09b8973ec39b5f32fd9f770a06dd724e1411d8b3d275b1b4d17c66b95600b072
consistent customer-support/refund-injected/results/eval_tool_guard_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 0cc45ff7c4487116c15ef1f803052586961c2aa8967fd532ea63cd9a766592a4
consistent customer-support/refund-memory/results/eval_none_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 693a3858c25784c8be873a58b8245d76a415be5bd17f4ad05fdba6e8c2242876
consistent customer-support/refund-memory/results/eval_none_deepseek-chat.jsonInspect original evaluation
Source file SHA-256: 2042a74e2852945af1fda5cbc593e730337116830d26d50d0aa7374f07d57712
consistent customer-support/refund-memory/results/eval_none_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 468d45e2af44468da2b2d5d4ec6ffb959dc13383b49f503b0986c961134566bb
consistent customer-support/refund-memory/results/eval_none_mock.jsonInspect original evaluation
Source file SHA-256: f0e22f2b1f1cb08ded55bf8e9c524bc4b6d7593dd701927765baee558360fe7e
consistent customer-support/refund-memory/results/eval_prompt_guard_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 47d36cefca4c966f8d7450cf05c463028d61d83ebae6c8c1688470bd6f036bf2
consistent customer-support/refund-memory/results/eval_prompt_guard_deepseek-chat.jsonInspect original evaluation
Source file SHA-256: 05ed60e8fe551e5f06d176008e540040e4422c2fc6f8ac11b43761c5124beab5
consistent customer-support/refund-memory/results/eval_prompt_guard_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 41378d78777acf6e51e5b9e50fe30c57d109cff187b291b5291a70e0a6338c04
consistent customer-support/refund-memory/results/eval_prompt_guard_mock.jsonInspect original evaluation
Source file SHA-256: fb1492565e44dd3d257c7c94c59d273fb610d9c838f7b6846b740b271c49591a
consistent customer-support/refund-memory/results/eval_write_gate_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 192f13c06ca9f001dd3b7fe7639dd7e2a37677b0552acd2134a196aad6d8d3ad
consistent customer-support/refund-memory/results/eval_write_gate_deepseek-chat.jsonInspect original evaluation
Source file SHA-256: cea7f9c88d556c542828962650f89f2cedc96ca029c15d796c3193a3ad3b5868
consistent customer-support/refund-memory/results/eval_write_gate_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 54cd62db5c168424e72947c5ddfb98cbc3e5fbc3a107257643fdef5222c1dcc5
consistent customer-support/refund-memory/results/eval_write_gate_mock.jsonInspect original evaluation
Source file SHA-256: 008b06c2f4464b551410b82017a92d906f5de175b9e06506e007b99f34462185
consistent customer-support/refund-resolution-agent/results/eval_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: 60876894123165226ba7cf8bbca24adf38c64152acc19132191b514c31c403b0
consistent customer-support/refund-resolution-agent/results/eval_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 9d012a99575c1205fe03bd9da517026186e67a21e1d36ce59c123fa253e7dd0f
consistent customer-support/refund-resolution-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 1cc2654616bddf383de71d3bb7f0a4c4e5035a55d9965d6c2c3f04a5b7b16732
consistent customer-support/refund-resolution-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 35cd6b0ec941db09248ab422c320dfa805f77e3aba792a4134c9535b1a07341e
consistent education-services/student-accommodation-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: a3b2b3f53fe8ecc2aab5f25746809e4d9a06972e97d5aef3e52b9193192d422a
consistent education-services/student-accommodation-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: e84ae1bfd6616ba8e05872fee263cdc842c1c3a6020c886f162a53478a57dc24
consistent education-services/student-accommodation-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 97fce9649bd0928f8b72f8f7ba9f9e42ba0bfa42e785f7642bf2fc01a0f49ba1
consistent election-administration/provisional-ballot-status-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: be1ec518e866a10282162c953895a2469a85bbb4b300b58ec22c0d0cea1bc34c
consistent election-administration/provisional-ballot-status-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 16a51306c92a949c9c8cf8ef4559bab74698991393b5788119f9af6ea0d618bb
consistent election-administration/provisional-ballot-status-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 51bcfb659ab18f656f400788441042cc27e2397f8e75bbf7e7c7e198a3b11d76
consistent employment-social-insurance/unemployment-claim-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 570ba3d62473dff10169349fcd2b669a6841b24daa64c917b44b0d9a75cc3edc
consistent employment-social-insurance/unemployment-claim-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 237a51d155f051d0433db809a56f21a35c10bb4bd49146e7d0cc73c42e46487a
consistent employment-social-insurance/unemployment-claim-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 597fc60e64d0dd72c8ce3c357cfa00222b248d02736194e992a590c4fd829f1d
consistent energy-utilities/household-energy-lifeline/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 949d282e2e5852484b3cb3b6303457368c45c8f993c12e436396e9d9eb264a89
consistent energy-utilities/household-energy-lifeline/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: e9e4517b052fcfafa45e72b4629e39fc5d9a975a945353e9503ddc5b99ea4860
consistent energy-utilities/household-energy-lifeline/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: d143b23f90683b0a2724baedccec92d1d8120c01650ec517fc746ad3a82653d0
consistent environmental-hazardous-materials/hazardous-waste-manifest-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 4e59561f6255aff4b67520baf4e6fa6b0acdfab69e8df85deaf0532b61923f07
consistent environmental-hazardous-materials/hazardous-waste-manifest-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 485066a379c5fd8d65aff29186738348fdc73b5cc67d749ce74707697e09d6df
consistent environmental-hazardous-materials/hazardous-waste-manifest-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: bb58abdc008c6801ce0c43c9db8445afd9cd3498aa24bf4dddcaa612a765d05e
consistent federal-ai-acquisition/acquisition-performance-gate/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 0a575b5d1537c054f00b9b5df1e066dc389dbd9899587bd3d2d7419f3b9820f5
consistent federal-ai-acquisition/acquisition-performance-gate/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: e26fd8f69cde9021898a3ef26a3c440124bbedcbb0ddf4125b267c1192370f83
consistent federal-taxpayer-services/irs-notice-response-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 05bb1901fd59e9851d19c190777b45d757104faa899a06dc70d708255f2cef47
consistent federal-taxpayer-services/irs-notice-response-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: ea7adf1f74725a38f00c1e5397e8d1780bcb47d0b2a105ef01a2b391739a050e
consistent federal-taxpayer-services/irs-notice-response-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 3f4ea6304d36c06ac71a21f74af99cfb3ecce576a11c7bd626f54a5e459ac2b5
consistent financial-services-fraud/fraud-alert-triage-agent/results/eval_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: 35fafc8ff70b04d65571783faaf07f20ad9a35eb603d635e87941e4d2c3fd7f4
consistent financial-services-fraud/fraud-alert-triage-agent/results/eval_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 2312b403b5fdc45309bca4731f9ecc2723feb32aa08a16e7b396ae2008809af8
consistent financial-services-fraud/fraud-alert-triage-agent/results/eval_accounts_fireworks_models_kimi-k2p6.jsonInspect original evaluation
Source file SHA-256: 9290a576995dc0911e7f59a83850e7fb86a7813e5823cd8aaa6726f9406e72d0
consistent financial-services-fraud/fraud-alert-triage-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 291b5f22665d29f9fa658cb790eb2585d9dd0f002659df93e3dd10c630ecc3e0
consistent financial-services-fraud/fraud-alert-triage-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: c7556600082fe9174b52a94d410f9506a9b5cece2615c353e49d8209455135bf
consistent food-safety-manufacturing/food-recall-traceability-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 2be677987c5370de48b853120d67b000b0ac9e620badddced7927b1d645005ee
consistent food-safety-manufacturing/food-recall-traceability-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 11a4d44d79a38735b3c11dc28018c0ecc63cf76cd55e108c01beab85cdd60979
consistent food-safety-manufacturing/food-recall-traceability-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 5ad752523ec905357689a00bb3b1fd6b5ee4bfa3d1b2867706fbb95f97ebd6fd
consistent government-transparency/foia-routing-appeal-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 1216340a7f2caea7777e9a30b57a181d49bd065b8e1947a7ffa9ebfa6354a802
consistent government-transparency/foia-routing-appeal-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 540f81cea78c1a7913d92a7a45b7ad7331c3b4c81da750c1cbef557c2d18861d
consistent government-transparency/foia-routing-appeal-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 142854640440c4351019a5686a9e426a3ff3c4d3aefb0666bf4a5e9801cc518c
consistent grid-operations/distribution-restoration-safety-gate/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: a12706064bbabd1e74aa851e640f997f640e743f3a55cdd0111ab5ef905f00d9
consistent grid-operations/distribution-restoration-safety-gate/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 7a0848f49aebcc469e5fbf3d27faa0f5fec6cc4bfcf0ef81ba1e9c032291cd61
consistent grid-operations/distribution-restoration-safety-gate/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 2fa256c5b8ddc9ad9874494993e53e846c3aeea4055029c16edfc46b0e5415d0
consistent health-data-privacy/hipaa-breach-notification-graph/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: e26d25c5ff58c0f69049e7c3b8dc6f1567ed0f00d2b94c48aa4fb30517e11396
consistent health-data-privacy/hipaa-breach-notification-graph/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 638bd1267ca338576010eb7261406774c1ea5114f2ffdbb5c7ea4f24743a92db
consistent health-insurance-appeals/denial-appeal-rights-navigator/results/eval_llama-3.3-70b-versatile.jsonInspect original evaluation
Source file SHA-256: d3d26fa7718027deec48c244d2afa6d89e6f460f47d80eeb999f6269d4e0f078
consistent health-insurance-appeals/denial-appeal-rights-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 90b2488c9bf820ac5fae16fb26f1850591c9660d949de821f8f35b1df10a3a4f
consistent health-insurance-appeals/denial-appeal-rights-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 2b88df7745905625341c6b6e31610c0d5e434919a73aa28a7c513fcbad0bac5d
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_none_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: b16c1b29f4d770eca8f68b322ae23ed7bf283078230c54c7ba30598c1263b8d9
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_none_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 94cfe5a84f01ca34b85a4e2ad2b2e161683f1f0790ca04d06479023edb230ff9
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_none_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 375a8959fe7edcfb5194aabaf8ebb6be3f44faf45a3544c2ba7193de2a2d8de5
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_none_mock.jsonInspect original evaluation
Source file SHA-256: 1648a1e5c92270c396173aa584906b0d099c5427cac498e23d2d932202e18a43
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_prompt_guard_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: e78d4a735af07fadb6ce7c26b0175f0eb75b148f7ef2a0ddeb5d880f2cdc3409
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_prompt_guard_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 83ec36c79df3f5a0a0183eda69a2e690d409608ef1376b72dd41c74a8dff5040
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_prompt_guard_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 675427600de74a3f6a3da2ba4aa79fa49d4f9b7c0e9e11aa442dbbbb0be82f8d
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_prompt_guard_mock.jsonInspect original evaluation
Source file SHA-256: 0a3ec64fe4cabec0c5b4830eceae8452203e13d16c60028eb1b6b4eca8ce5fe7
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_record_gate_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 82f1ef394177e7ac9780420d48369a775513ba5645c0fcf7aa3a5d54c19e0818
consistent healthcare-life-sciences/prior-auth-review-agent/results/eval_record_gate_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: a0b9d392f7e1a186cb61f81cf1255b46085d6912b66d0a53e31e728dae30e9e4
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_record_gate_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: f4e55e25dc510445d78886ea0fb67f57485728fb2fed929cdbbd48d6bbd8ba47
inconsistent healthcare-life-sciences/prior-auth-review-agent/results/eval_record_gate_mock.jsonInspect original evaluation
Source file SHA-256: 9d05c5e8701d89cbead2bbb401a2714487565ec08865b81d69438be889756f2e
consistent healthcare-payment/no-surprises-idr-deadline-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: a7bceb5765008729ff4f6fd3dde25833e7c4723bfd6c8a7a092ed6fcc45eaaea
consistent healthcare-payment/no-surprises-idr-deadline-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 8f261fb73e0469d3d5ef8e5c53afb667c0e37ce94b6adcc719fd9648c38a85a5
consistent healthcare-payment/no-surprises-idr-deadline-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 8f990c837b1b3139576cf0e44bd15f315ce9cf7731bdca00742a20cb48631333
consistent home-field-services/service-visit-readiness-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: e9c72dbd0bb67534178196f87424d43e24da0824aadbb9844fd0de48b758dbcc
consistent home-field-services/service-visit-readiness-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 3815d529b92864adff8b8fc6c502d8e62d1c0140a80d41b300dc189cbb3f6369
consistent home-field-services/service-visit-readiness-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: ca57dec9b9510c876717d4023535df8b4507c56513c5c9393564a1da7e3ea6e0
consistent housing-construction/permit-readiness-agent/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: d5c0c73cc1093709e55a36ebf69697491b9b37f9c4f27bf0adf5785c066b1b68
consistent housing-construction/permit-readiness-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: e43d2ce109694a2224baed4c46431b6f7453f1b3c92ad18f95fa6022e8725e73
consistent housing-construction/permit-readiness-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: d07824dbddf21aaa3495d2a78dd0b1fd5fce440b50f34308090802b68d34b02a
consistent human-resources/hiring-compliance-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 5a4ecf980de954556491af650418d034bf0648a2dfaf1b3ed7c3604a522086c9
consistent human-resources/hiring-compliance-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 4a345e3ad26d85b0dc473b927efa6792ceb1e5c8bbaf6dfe1a7ca37d0c4a7a1f
consistent human-resources/hiring-compliance-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: b3c8916680a98aba960496c58d0303f093d7d65ea99252db6292bf12d365c229
consistent identity-access/account-recovery-assurance-agent/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 8517640267e238038594c15d1817209e8104dc1113e43cc0da5bc1881c9a48e0
consistent identity-access/account-recovery-assurance-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 9e6aa7ac267a3f672fec7c13da7536dfa9e90eebfa9178f9a8850a6b8c407e34
consistent identity-access/account-recovery-assurance-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: a1946c99eb7af02d3cf3959115ce802d6a5bc0212fc6e6bea897c3d142a2cee5
consistent immigration-citizenship/uscis-case-evidence-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 571db8d13832f14e2e0d5522aa411396e55ae4ad89b4d9c535a74e7824ad36ab
consistent immigration-citizenship/uscis-case-evidence-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 49056b2a9c97aa7c827340142c36dc5b97de2859b6fe7142323929a82edc040d
consistent immigration-citizenship/uscis-case-evidence-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: f5f0d0ce9a7c0e28810dbf4688e99f093d3caff6c439009a7d08397d8887791c
consistent insurance-disaster-recovery/disaster-claim-aid-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 8c0c0978c9e0221c9c1e2c777ad92d092bbb0980f5df6554d18ecce8db25c754
consistent insurance-disaster-recovery/disaster-claim-aid-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 9bae60ca62adb6062b5d7687a190018ad5e884c66dd2c1cbd0e8933fbc254d26
consistent insurance-disaster-recovery/disaster-claim-aid-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 38311913b2eead558fe99e7cb0ddfd1a49cdb2fb056e47cb8f8e082b57330dd0
inconsistent it-operations/incident-remediation-agent/results/eval_general_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: d7ae9a24b4b4ca6b882bcb90dd7915ba5ed2463aa5a0f2bd989dc671d154a1b5
consistent it-operations/incident-remediation-agent/results/eval_general_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 97cc4c3c5ebf571a41a74307b0c7e3b97e46d947bed3279419eea089e4db29d8
inconsistent it-operations/incident-remediation-agent/results/eval_general_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 309f81794899f475819fefd5e4680e5ba3e3c4bcce3c9271d45f21b8e05428ab
inconsistent it-operations/incident-remediation-agent/results/eval_general_mock.jsonInspect original evaluation
Source file SHA-256: 88575c0f1b1dd463d65c762b6d135e907d33cfc3b346aa6af5988ccbcaabaaba
inconsistent it-operations/incident-remediation-agent/results/eval_named_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 8efe43cc65daeb1f9549c6c5c13d178c42b933767638013778f36623d6567d16
consistent it-operations/incident-remediation-agent/results/eval_named_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: adaf79906a215468379f8b2a4a3b4f79ddc098c4508cdddfac8c8b0d70bb8438
inconsistent it-operations/incident-remediation-agent/results/eval_named_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 118c4a81cc06b04ac42273229da61027dde646921a1b16489ddaf9ff50dc7e61
inconsistent it-operations/incident-remediation-agent/results/eval_named_mock.jsonInspect original evaluation
Source file SHA-256: daf467165407763763dde4ef02ff3f9d4ecd28c66ba3a0fcc67b425b97908a6c
inconsistent it-operations/incident-remediation-agent/results/eval_none_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 6948be5f3298d84234adfb3eb0a128963b3ff6718108a83ad4b81414391396f3
consistent it-operations/incident-remediation-agent/results/eval_none_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: c9e130622ec4324acfca0cd8738f9192e9bec275cd5bb17117a9cbd0cf7f854e
inconsistent it-operations/incident-remediation-agent/results/eval_none_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 939a3379b84de90c29f8c543a9573794257e1903b465bc8de8e97a15b09b8f22
inconsistent it-operations/incident-remediation-agent/results/eval_none_mock.jsonInspect original evaluation
Source file SHA-256: 8675e7ae16a7635d72124fe1cf39688eb6eca4bc5dbec31fb1477b8ecda11ff2
inconsistent it-operations/incident-remediation-agent/results/eval_scoped_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 8a043a27f9f8294a09c7e2e40c14c6bcb62d17ff4d9b9a15d6bf5162d6671fcd
consistent it-operations/incident-remediation-agent/results/eval_scoped_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: df05d8e9b386b3b635a5d1c0b56eb0712ca59dcfd7ca0f081babbcba3a560a68
inconsistent it-operations/incident-remediation-agent/results/eval_scoped_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 0e06a3d16c21b0fffa4e311534f1b86d6b10cd0617162f8d4510ce67b8a2ab94
inconsistent it-operations/incident-remediation-agent/results/eval_scoped_mock.jsonInspect original evaluation
Source file SHA-256: 8dda10604cb56cfe0084b0e60d081fb7c18c720f2989c8a4f5b12f86fb719e07
consistent it-operations/oncall-watch-agent/results/eval_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: 216eb9fd775ccb8ba75ddbd3dde26673e969ca90efc35cec41c74ffced330a9b
consistent it-operations/oncall-watch-agent/results/eval_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 4d330b549d84de9ff90271fae66b476aff380ac4606c8e30ea3ed82023c6800b
consistent it-operations/oncall-watch-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 41c73e3d07169d24465457f2c0ad67b080fedfc29539c403c501b73939056d73
consistent it-operations/oncall-watch-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: c571e25f27ac68e668ddbea6c3520ef4764d12c2adbc51f260bd83a189dcf980
consistent legal-compliance/dpa-clause-review-agent/results/eval_none_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 12c7f49b258e14383b785ededbcb10f7742415d7f86702523bd39c7e51a57bf1
consistent legal-compliance/dpa-clause-review-agent/results/eval_none_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 1bdf4e5758c4d522ca10aa9e9f956622b70fceb9fc65184676926751bc616e9e
consistent legal-compliance/dpa-clause-review-agent/results/eval_none_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 1fe5beb92a829025296c676613a28dd214d9503df65e60eefcc827d637e32d54
consistent legal-compliance/dpa-clause-review-agent/results/eval_none_mock.jsonInspect original evaluation
Source file SHA-256: 8047e695de6b16b25116441f02d2a4fd14a0bcf8cce515a68c56a29d70766e4a
consistent legal-compliance/dpa-clause-review-agent/results/eval_prompt_guard_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 3cb842351b03db357c442b63a04d78036359be5046b9708f4717afe3b7783b5b
consistent legal-compliance/dpa-clause-review-agent/results/eval_prompt_guard_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 1e6e8637b4dcca25070486cbcddb16dbf772f13b51dcfa4aaefa64c835ecfaee
consistent legal-compliance/dpa-clause-review-agent/results/eval_prompt_guard_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: f14b8797615d997696689bdeb392edc19d4dd0539a2552a4f7cfe38d9cb7f2d8
consistent legal-compliance/dpa-clause-review-agent/results/eval_prompt_guard_mock.jsonInspect original evaluation
Source file SHA-256: 1da5a51720ff8f184cee623db4632af9cd286f325ec51dec86b0c8b6c0f436ef
consistent legal-compliance/dpa-clause-review-agent/results/eval_record_gate_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 77515df1c12ed07b59fd6830490136dc69f231eb5c7fd91fc2c6a51754f972f3
consistent legal-compliance/dpa-clause-review-agent/results/eval_record_gate_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 8679aafb59b5f648fb07aae8b96b5f266338653d2fc39659b0142830155a209e
consistent legal-compliance/dpa-clause-review-agent/results/eval_record_gate_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 22d2d5568979b893dfd5c3e71116102943ce4066b2eb0b2d10c981069d704694
consistent legal-compliance/dpa-clause-review-agent/results/eval_record_gate_mock.jsonInspect original evaluation
Source file SHA-256: bca70a2ab599f04303b18bcc7432580ab2495eea43e48c3432c5250c4fd8af9f
consistent logistics-supply-chain/exception-triage-agent/results/eval_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 330baec6ed845808efad75df46ed538a61613ed8713f1802a68c17ed10cee464
consistent logistics-supply-chain/exception-triage-agent/results/eval_accounts_fireworks_models_kimi-k2p6.jsonInspect original evaluation
Source file SHA-256: bdebb922c77ef8d3c2e8266c4052be6acdd6c04b9a1e527ff089e09214fb3256
consistent logistics-supply-chain/exception-triage-agent/results/eval_meta-llama_Llama-3.3-70B-Instruct-Turbo.jsonInspect original evaluation
Source file SHA-256: f94a17c914a9d52bac2f6ece6b56fe0dfd9e9719f0c7c0d85447e0845e8e1d7f
consistent logistics-supply-chain/exception-triage-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 1530e3694ee7ac683f0a0692257de162dcc113579cbb4564bd134d14b99e4488
consistent logistics-supply-chain/exception-triage-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 428d04853a849588c12b15d1a9ee01b7dc4ffaae22582e5ec483c5f620270756
consistent logistics-supply-chain/exception-triage-drift/results/eval_clean_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: b39de40929c810e1c877afabf220b9cc98ecd7ac881f27fe49556d612a7489bd
consistent logistics-supply-chain/exception-triage-drift/results/eval_clean_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 3f5c0c7239390c70755affaa2622c32d90a66d184bb35f51947af631785037f0
consistent logistics-supply-chain/exception-triage-drift/results/eval_clean_accounts_fireworks_models_kimi-k2p6.jsonInspect original evaluation
Source file SHA-256: 12f3c6da1ff6be6660341478adcf07a7c780dc34acf3304098d843fccaf08272
consistent logistics-supply-chain/exception-triage-drift/results/eval_clean_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 13462cccd1cba76abec492fb3956f481268b26c62cc5d7c6d10925466ad6cedf
consistent logistics-supply-chain/exception-triage-drift/results/eval_clean_mock.jsonInspect original evaluation
Source file SHA-256: adef321ff627f1dc1f167a19c7552db958e6c8e6d6d4d04b8aeab9a8c0ac7a00
consistent logistics-supply-chain/exception-triage-drift/results/eval_drift_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: 062f6c719f8d960b2b478b9ccbfe4ee2663cd5f5418c0f845f9591e90f4b51a7
consistent logistics-supply-chain/exception-triage-drift/results/eval_drift_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 9f517baafcd21203a6db2d4ba957e095fff6a1c432f7883d975c22ba2f40a178
consistent logistics-supply-chain/exception-triage-drift/results/eval_drift_accounts_fireworks_models_kimi-k2p6.jsonInspect original evaluation
Source file SHA-256: bf376b1bd8ef68ebb622b6dcf197d46924b492c342c7e28d245c998d98ad2440
consistent logistics-supply-chain/exception-triage-drift/results/eval_drift_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 0274de09d1554c3562e5ec23dc101676ca18e76c807b9c7c0487b961420f093e
consistent logistics-supply-chain/exception-triage-drift/results/eval_drift_mock.jsonInspect original evaluation
Source file SHA-256: d021ee55ac5baa0760ad69803e7c16619cca7ae143e540c4af5c5d4e22d8d200
consistent logistics-supply-chain/exception-triage-drift/results/eval_freshness_gate_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 0cebe88d6f5b97e7b1120d15b7ca5dd22f9b4e5891174bf5a7ec7814bed4238b
consistent logistics-supply-chain/exception-triage-drift/results/eval_freshness_gate_mock.jsonInspect original evaluation
Source file SHA-256: f1e260e242320cb595cfda54dbbb7c7deb280c8c75c723427ebc25c198cff655
consistent logistics-supply-chain/exception-triage-drift/results/eval_prompt_guard_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 881836408a46e1c9a9a37262a709315b02b04a87f0c7cb5f29a880949b60e187
consistent logistics-supply-chain/exception-triage-drift/results/eval_prompt_guard_mock.jsonInspect original evaluation
Source file SHA-256: d2fe3269fc239c7ef187a739221e954d7e938de36c92c0aa0195756f52a3339d
consistent long-term-care/nursing-home-transfer-discharge-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: b80bc41246cfc0e4119bd603a5cfce06a0f52dc81fbac2dd89dbbb66b4691e60
consistent long-term-care/nursing-home-transfer-discharge-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 120c7dc55694bd64a2ab5e1627e2855f000b2356d8b95de95f4542be800b5e95
consistent long-term-care/nursing-home-transfer-discharge-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 70473d6a6d523a3084938017f3ac17b0a497382258666905cb2f919842be34d6
consistent manufacturing-international-trade/export-transaction-evidence-agent/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 98f6011ab20990b3c17c98c00c7d5406b016b7aa58d973c785f46492804f4527
consistent manufacturing-international-trade/export-transaction-evidence-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 46e6446c73b9448f085e098f5ced5e1e58e7bd7ce423e706d52cc52e330a024d
consistent manufacturing-international-trade/export-transaction-evidence-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 86724a4bd8532f34f28fc31284fc9fe7281fb18585ee9194f2f438a840bd1c17
consistent maritime-ports/detention-demurrage-invoice-verifier/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 52e009e3854a20c6cbb1cfda2d0199cd154b4a1103bcaa7f4c8b2f4786d87314
consistent maritime-ports/detention-demurrage-invoice-verifier/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 0f28b6367075018c34a724666cce675d6e1f7734e03044b48cae9ad7b26704f8
consistent maritime-ports/detention-demurrage-invoice-verifier/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 1dc898e88e5f60bcd4dca7ff61524755617dfe41bf77b2f005a7d274aa1236c9
consistent media-streaming/release-qc-triage-agent/results/eval_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: a9319bfa8692fb4097a062835a68517f2f648e9a437577ca65fc8c102ff00cf4
consistent media-streaming/release-qc-triage-agent/results/eval_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 0b087e6d981da63ef3b9d95dab315573426bc5be12004b7b00fdda0583ef965c
consistent media-streaming/release-qc-triage-agent/results/eval_accounts_fireworks_models_kimi-k2p6.jsonInspect original evaluation
Source file SHA-256: b5a307bf39136721393226ff6e4a4b18724d5f8701989ae3cd0fd7aec0bf02d9
consistent media-streaming/release-qc-triage-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: b851252883fd0df27e853789152571984961e952d8dd79782fffa86b69163d7c
consistent media-streaming/release-qc-triage-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 41a624bdfa2a7ff48eac4046a76493c2584cefb38d9b87d79b7a0e9edacc2178
consistent medicaid-chip/renewal-continuity-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: d57ba82f95bc7f3d2315d99a6749561d8d62dc18f1064231d2b454ce44206ff7
consistent medicaid-chip/renewal-continuity-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: ef198f0449a90a300771bb9bae747e6caeb3b55bb5d39fffb62e10ed29abc0ea
consistent medical-device-safety/adverse-event-reporting-gate/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 086ee30fd48805f026df8216a5ccc01dee9463982bdf1370a03b30481b5677b2
consistent medical-device-safety/adverse-event-reporting-gate/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 722e42806726ca8c3bcc7d967e4cfea63b3a4759da11b49c81efeab7bc042d9d
consistent medical-device-safety/adverse-event-reporting-gate/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: dbfd1ed61352336f1b5e7063f2742de245ed75ccb4e29c1e9e31429dd4875cc3
consistent mortgage-servicing/loss-mitigation-foreclosure-gate/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: d870176bec840b4f8c843b79755799cacac424b8594f6c6d2dcd96d2f3d13d2f
consistent mortgage-servicing/loss-mitigation-foreclosure-gate/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: a331693f9fb56a7f070cddf083b20498c89c41a0f7bfb5d3f80e5e77b670d06d
consistent mortgage-servicing/loss-mitigation-foreclosure-gate/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 521efc98b837f9e7c542c0c2c6fcf3b4ee1acf735bf3ea6fdb344bc3127eb3da
consistent nonprofit-grant-management/grant-obligation-evidence-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 7a36658c812b51657dab05fd4f95524f271803784c95a84316cbeb3da9741876
consistent nonprofit-grant-management/grant-obligation-evidence-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: ad4bba48c60f981be1cc14fd85ff2e22e1cc4956633667b1e4142195bca92900
consistent nonprofit-grant-management/grant-obligation-evidence-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 9404a609083565b2284b682a9dd19ead24f6d72ead744693c0996be59edae20c
consistent nuclear-operations/reactor-event-notification-gate/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 5685e1abad965aa6b318d66dbceb29f489b0c86efbc4e6c98b3baf0ce44901cc
consistent nuclear-operations/reactor-event-notification-gate/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 9e69c4ce998d1f4019ad1d7a8364e9429b3d42feb140c28e94bfab73aac8b58c
consistent nuclear-operations/reactor-event-notification-gate/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: cd01a55700d053fdfdc8666d4dce9d95dad369390f7bcfc6183645bee50c285b
consistent pharmaceutical-manufacturing/batch-disposition-gate/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: a582b2f203960ee51c7505d2a212a085e6cd90576fc09bcc30bc944e53983bdc
consistent pharmaceutical-manufacturing/batch-disposition-gate/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 1757e5b2b504970e91f70951c87edcd726d84acb8d65062b55f62e4045657a91
consistent pharmaceutical-manufacturing/batch-disposition-gate/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 6c1b8b9173947cfca1ab66efb3fde408606fc70426dee83749239e276a1ee601
consistent pharmaceutical-supply/drug-shortage-notification-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 95accc6e2479affc6843f75111b79298e3a98ac31fae2f5fd31f6c2037d49529
consistent pharmaceutical-supply/drug-shortage-notification-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 3b9997f6b882966c9bcf5933d5546e8b818d54193703b2230f9a799b61af1c19
consistent pharmaceutical-supply/drug-shortage-notification-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: d31b881520bbd94f02c3d71d0724a056c94c70f23bbe1637b2d2a4ab3520e5ba
consistent pipeline-safety/incident-notification-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 65b4c1bf177a11181a1a9e9112f6bd6e14f9f3851c1a0a6301c82b83f2c702f2
consistent pipeline-safety/incident-notification-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 22d228750ba78c438afe99aa579c48adf4263fc5c718958a21154bbb1d744d25
consistent privacy-data-governance/privacy-rights-orchestrator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 31afa96420c5f5be8cbfd35714fda8534221eab25c17c7269949d784ccb9391f
consistent privacy-data-governance/privacy-rights-orchestrator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: b97117053224d8d49516ecf67f1f397fd12e43b9c267baf4ca583309c516d9de
consistent privacy-data-governance/privacy-rights-orchestrator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 198e4504addacb352183026095de6fb9a9b414c9c55637a3cf25e6d5a1ce5da3
consistent procurement-finance/vendor-payment-review-agent/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: c6037f6d1d83364298343ca93887223f52dfddc34a272a6ef42d55a50816a2d5
consistent procurement-finance/vendor-payment-review-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 3ba761d1a73b417a36b0440661e6b50d51e883b4af47a68e15b971d9fce11d9d
consistent procurement-finance/vendor-payment-review-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: aa904351635c66393c2cbfde313ecde99212086359c995c33439cc23ba992c89
consistent public-sector/small-business-recovery-agent/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 45cbebf6daf9db7107a1f1cb0b2b17a4d7b8c539256e9084411d21fb53865196
consistent public-sector/small-business-recovery-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: e0051b0ff7006dc18145eb15d2f25c09f5d8f2f7851f00fd24c6ba83c185d4cb
consistent public-sector/small-business-recovery-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: c9ad0bbed3754b2be1007fb1439cf0a72841986d0da4842d8a1ff062449638d9
consistent public-transit-mobility/paratransit-access-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: dff1dea67be65b787d40fcb6c212a4f6a1c3df254372d0c3347d9a1c54f49bb8
consistent public-transit-mobility/paratransit-access-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: c0f3ea2c98b3b07ca994314e9343e972a07eef1d3aea48d0fc7b5dac58c6d6ef
consistent public-transit-mobility/paratransit-access-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: c8ab38e59425bb1c4bc84c7ac2bce28a60307647306f2af7b71be20cad94add9
consistent research-knowledge-work/claim-evidence-verifier/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 5f2b713c999408c9cdb3d739062887311bd927027fb4f5d349cd322e319bf746
consistent research-knowledge-work/claim-evidence-verifier/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 24effc1ec1d6591abd195aa73acc1fe56e61abd6e0af36e021a8f6e59520eb06
consistent research-knowledge-work/claim-evidence-verifier/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: be2237eecce0367dbb262f1c6bb1cab3c2cb1275ec8c6673ca4ba6e84ac8dfa9
consistent retail-workforce/shift-coverage-triage-agent/results/eval_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 6eb2e81f6025df862361e0fa2584da0b1e7f4aff54c107e5a02a73bfc7969bfb
consistent retail-workforce/shift-coverage-triage-agent/results/eval_accounts_fireworks_models_kimi-k2p6.jsonInspect original evaluation
Source file SHA-256: f9ff6d5f91ab0ade200cd1c85ed3dcb851ae2cb0b6159cc51a6349f090893203
consistent retail-workforce/shift-coverage-triage-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: cd61ce12c7f57e49fff706baea0878800ee35e74fdd996ae3b78b72a31412209
consistent retail-workforce/shift-coverage-triage-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 823ea3023661a8395046d0f25200dbe64a4063cabc3798593a81b732db97c3c9
consistent securities-cyber-disclosure/material-cyber-incident-disclosure-gate/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 671d7c4450513ada0b0b5efea2d63c18a463ed2d5b4d4772db48a072ef0f6553
consistent securities-cyber-disclosure/material-cyber-incident-disclosure-gate/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 5071d829f56f8594ee091f67877d2613d18689192464849f2ed38b0681726c92
consistent securities-cyber-disclosure/material-cyber-incident-disclosure-gate/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: e29ad975e07b3b96a7fa0cbb8031d479bea91532157ea47425929e7e673172ec
consistent security-operations/alert-triage-agent/results/eval_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: ce868d693faa9d83142557dc12ef693db43d55846759022a7fa936585465c78f
consistent security-operations/alert-triage-agent/results/eval_accounts_fireworks_models_kimi-k2p6.jsonInspect original evaluation
Source file SHA-256: 13ce5459b80bedee60ef57710b52148a7005d6063aac80b256508facd1917720
consistent security-operations/alert-triage-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 28fc54e5e8b660c76d009231be56b313735cff78d9684579acfcf6b555c2c179
consistent security-operations/alert-triage-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 1885a7a805ef26f980e6e3124ee18b5a8ab4883356adede94093e65500987d43
consistent security-operations/artifact-admission-agent/results/eval_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: 20e1ede6dac18d191cf06cb4b28be7581fe129d27a81a2c8f79f4eedb1f6ac55
consistent security-operations/artifact-admission-agent/results/eval_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 74ac268b33d0bc6ed78edbb2de6ebe8c46cbf5a4f5c820863576995d424ecc7a
consistent security-operations/artifact-admission-agent/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 54d4a271e525a0d9d3559c0d0fbb92459ba2c8606f644a88d5892f54d8e35784
consistent security-operations/artifact-admission-agent/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: cc347a3252c6e17bdc553694afe3a7cc33976c87ffd8faf403159c0f15e5e913
consistent security-operations/trifecta-exfil-agent/results/eval_none_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: 37c9a10fc536f3a47e0908170c33ea46fd43586877c598356f753bd6b934c02e
consistent security-operations/trifecta-exfil-agent/results/eval_none_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: b36ad90c7e5eeeb15ae67e0b2bda1d96bff32a03458609072baed0a9b2771541
consistent security-operations/trifecta-exfil-agent/results/eval_none_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 2453f70dc1e18a52700292d3e5c85925805544c5ba64d6f1dae9eb76c5381f0a
consistent security-operations/trifecta-exfil-agent/results/eval_none_mock.jsonInspect original evaluation
Source file SHA-256: 3329160dd3d463540c12b6bfe1bda6da86f8d4d0ce5907d8193e70ebe7e7b935
consistent security-operations/trifecta-exfil-agent/results/eval_prompt_guard_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: f406600d14126292ad27e3b417b121a982873da03b40b3d11fc9c9c91f86adfd
consistent security-operations/trifecta-exfil-agent/results/eval_prompt_guard_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: eb2e9adaf31d5019d97860c9904e11669549fd2ec20dcceba16865ba69b6add9
consistent security-operations/trifecta-exfil-agent/results/eval_prompt_guard_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: d4433dcd6a8b2ccea8c24b9a3c3d48e5dec0495eb2882d13e205668512822d8c
consistent security-operations/trifecta-exfil-agent/results/eval_prompt_guard_mock.jsonInspect original evaluation
Source file SHA-256: e159b67897a262966540bb00f60a529fa336213c73e4b3d29213b0528ae700f3
consistent security-operations/trifecta-exfil-agent/results/eval_taint_gate_Qwen_Qwen3.7-Plus.jsonInspect original evaluation
Source file SHA-256: 078b93450f5cb698e8b38c6a97038fc3c82f38bb20a6f8b97676117e0611d6c6
consistent security-operations/trifecta-exfil-agent/results/eval_taint_gate_accounts_fireworks_models_gpt-oss-120b.jsonInspect original evaluation
Source file SHA-256: 761780b336f2b3e44759cefadbf0732523b5c9263ba41d6d088d42ff3dab394c
consistent security-operations/trifecta-exfil-agent/results/eval_taint_gate_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: d8eb525b7d5db554c92d32d8a96364917cbbb1620fd3531679441030c4488efa
consistent security-operations/trifecta-exfil-agent/results/eval_taint_gate_mock.jsonInspect original evaluation
Source file SHA-256: 55494d34e96abac71f20d602a82a61fa86eff277700b7f56bb6cef58f24a7441
consistent social-security-disability/cessation-benefit-continuation-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 7381984f44841624e33aea5821729dcc79d470c9ef130b96a8e99bcf7d1e7484
consistent social-security-disability/cessation-benefit-continuation-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 4659eb9e826e518e6a4c8462d4449ec68ca81f7ad0dc634897f4381f9b0a9537
consistent tax-filing-services/tax-return-completeness-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 0908e4668f3bd80d80f5c17eeeef4bb2f4df2de5bcb0d918031532d3195b6e72
consistent tax-filing-services/tax-return-completeness-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 6ab999267de112697eac98290a4b3f988796772286327bf37de1202be8656d50
consistent tax-filing-services/tax-return-completeness-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 5ca82a78e1bd5a49bc9b7e4cfc63dc28e4f79ab0cb6fc071e9c997c47c70dc23
consistent telecommunications-emergency/communications-outage-reporting-gate/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: fd3f8beed8b56736445e10233beaf36928b616c8602db539261165965939f28a
consistent telecommunications-emergency/communications-outage-reporting-gate/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 223214e1ffcdf571f3554ffe3c19cd8625e418652a0257113940d33d5ba701b3
consistent telecommunications-emergency/communications-outage-reporting-gate/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 3d533272a50be87fccee3a993695ab1d5f0ec7eaa1c8b84337bac01e39301bd2
consistent veterans-services/veterans-claim-evidence-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 93dd7e9ff61af5e1570eba780c101ad0bb436aec28067ab55e5f591767554aba
consistent veterans-services/veterans-claim-evidence-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: e28c9f7defb955fa091e279b08e88d0c47b5951d51e70f5b37cb803c78c72c67
consistent veterans-services/veterans-claim-evidence-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 721505d5346bbff1902fbde4a6130cbb91bea605b56b92a9d071e942efed2bb9
consistent water-sanitation/drinking-water-notice-coordinator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: b010d4dbb9940f01df7a1a68c0ab12a16c72bbd63122d26eac5f8489f9a3f7b0
consistent water-sanitation/drinking-water-notice-coordinator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 67ea403e5403de933dc1d37b069a4334656c6497c0f44b9e4beeed1cc7f60fd9
consistent water-sanitation/drinking-water-notice-coordinator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: f9d64ddd8927bb813397d6c03b1aa2dea682cc17724cdad5cb9d1bf9267e0cb7
consistent workforce-mobility/occupational-license-mobility-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: 4654e9f323632bd563d4dc1eac0c5c84040a94f1aa81b5c98f5765c3b976fd5a
consistent workforce-mobility/occupational-license-mobility-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 01e6d83260c1f95441d1cfad747f8465cfd0592f17c2a1d504ead4798a3d3a0a
consistent workforce-mobility/occupational-license-mobility-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: 1940e92801f67a825ece6a901a3738fe35143cd6ac1a2c1c48a7ea48092b3dfe
consistent workplace-safety/severe-incident-reporting-navigator/results/eval_deepseek-v4-flash.jsonInspect original evaluation
Source file SHA-256: a91905dbb36a17dfcc0ba5151972edeb6df0dbb15ceff026613d8bc796a4af6f
consistent workplace-safety/severe-incident-reporting-navigator/results/eval_mistral-small-latest.jsonInspect original evaluation
Source file SHA-256: 615864f86101ccb102758d8fa81102ef46d36fb586ac98fadbfaee4046dc1497
consistent workplace-safety/severe-incident-reporting-navigator/results/eval_mock.jsonInspect original evaluation
Source file SHA-256: bf265bbde70c0473069d49dda0d1ffdee8b197bc916ddfae6cab201d9dad1182
Current-harness recomputation of stored metric summaries only, with four-decimal comparison. Historical observations are unchanged. Inconsistency may reflect missing intervals or earlier scoring/aggregation conventions; it is not evidence of fabricated execution or a new model run. Source bytes are bound for reproducibility, not provenance attestation.
Method and reproduction instructions · Machine-readable audit