《医学知识图谱质量评价规范》征求意见稿

3医学知识图谱质量评价规范GB/T42131人工智能知识图谱技术4基本要求4.1医学知识图谱质量评价应使用真实、有代表性的数据样本，同时保护涉及个人隐私的数据，遵循4.3应确保评价过程的透明性，详细记录评价步骤、指标和数4.5评价过程应与知识图谱的维护团队保持持续的交流和合作。5.2选择评价模式5.2.2结合评价需求选择评价过程中的框架和方法论，选择指标类别并设置指标权重。5.3评价结果计算45.4评价结果分析知识图谱中的数据值、关系或三元组准确、可靠、无误表示真实世界事实知识图谱中的实体、属性、关系和本体等元素是否符合逻辑规则和语义规度量实例数据与模式级别的类度量实例数据与模式级别上指定期备份知识图谱数据，并确保备份数据的安全存储，建立有效的数据恢实体和属性能否满足特定任务是否可以给特定任务提供有价值的数据，是否能够为所提供的数据进行价知识图谱中所包含的实体、属性、关系等数据的更新在多大程度上可以满），资源是否来自可信的、合规的（伦理合规、法律合规等）、有权威性或者5系统在给定时间段内处理大量的请求，支持并知识图谱内部的实体与外部知识源或数据源进行链接以建立跨数据源关联知识图谱在结构、规模和内容上的复杂程度，受节点和边的数量、它们之7.1评价报告应由报告摘要、前言、评价内容、评价结论四部分组成。7.2报告摘要应给出对评价目的、方法、主要结论的简要总结。7.3前言应说明评价的背景和目的。7.4评价内容应包含：——用于评价的数据样本：数据来源、数据类型、数据规模；7.5评价结论应包含：——结果分析和讨论总结；——质量问题和发现；——优化建议和改进策略。6A.1准确性A.1.1语义准确性mstatement=1−································································(A.1)n1——潜在错误陈述或三元组的数量；mlabelling=1−·································································(A.2)n2——不准确的注释、标签或分类；mproperty=1−·································································mproperty——属性语义准确性；n3——存在冲突的属性或属性值；A.1.2语法准确性mlegal=1−········································n4——知识图谱中非法值；mrange=1−··········································n5——知识图谱中不在合法值范围的内容。msyntactic=1−·································································(A.6)7msyntactic——违背语法规则的内容；n6——知识图谱中不在合法值范围的内容。A.2完整性A.2.1模式完整性mscℎema=······································································(A.mschemal——模式完整性；n7——所表示的类和属性的数量；A.2.2属性完整性利用属性和类型的统计分布表征属性后检测完整性，或按式（A.8）mroperty=····································································(A.8)mproperty——属性完整性；n8——表示特定属性的值的数量；A.2.3数量完整性mpopulation=···································································(A.9)n9——表示真实世界的对象的数量；A.2.4标签完整性mabelling=··································································(A.10)mlabelling——标签完整性；n10——数据集中实体标注标签的数量；8A.3.1对新加入的内容进行不一致检测按式（A.11）进行判定。mcℎeck={新加入的内容进行格式检测····················A.3.2度量实例数据与模式级别的类约束的一致性程度按式（A.12）进行判定。mclass(g)={A.3.3度量实例数据与模式级别上指定的关系限制一致的程度按式（A.13）进行判定。mTelat(g)=∑1mTelat,i(g)·····················································(A.13)A.4.1访问控制按式（A.14）进行判定。maccess={只有经过授权的或系统可以访问maccess——访问控制安全性。mbackup={数据定期备份并效数据恢复机制mbackup——数据备份和恢复安全性。A.4.3匿名化和脱敏按式（A.16）进行判定。manonymity={数据可匿名或脱敏来保护隐私manonymity——匿名化和脱敏安全性。9A.4.4数据治理和合规性按式（A.17）进行判mgoveTnance={数据治规合法··························A.5相关性A.5.1实体和属性能否满足特定任务执行mrelevancy——实体和属性特定A.5.2创建语句排名按式（A.19）进行判定。mranking={支持排名······························mranking——语句排名创建性。A.6及时性mfTequency=((0.5周期性更新······························0.5周期性更新······························mtempoTal=(({{{{mtempora时间相关性指数。A.7.1提供元数据且合规按式（A.22）进行判mmetadata=A.7.2数据来源的可靠性按式（A.23）进行判msouTce=msource——数据来源可靠性。A.8.1数据访问是否正常按式（A.24）进行判mTequest=········································n11——成功返回信息的请求数；A.8.2低延迟按式（A.25）进行判定。mavedelay=··································································(A.25)n12——每次查询响应时间之和；A.8.3高吞吐量按式（A.26）进行判定。mtℎTougℎput=································································(A.26)n13——每秒或每分钟成功处理的请求数量；A.9互操作性mformat=mformat——其他序列化格式支持性。A.9.2通过谓词位置有外部词汇的三元组的数量设置为知识图谱中所有三元组的数量，来衡量使用外mexterior(g)=···········································(A.28)mexterior（g）——外部词汇使用的数量比例；p——谓语；A.9.3通过计算类和关系分别与其他数据源的类和关系至少有一个等价链接的比率，来度量模式级别PCx——知识图谱中的一个元素，可以是类或关系；Peq——某个包括了等价关系表示的属性的集合，这种等价关系可以用标准属A.10互联性mInst=|{x∈Ig\(pg∪cg)|∃(x,p,y)∈g∧y∈u}|/