1.1 实时分期准确度测试
测试用例:
Sleepace算法准确度报告_v1.2 - 图1 产品 :F
Sleepace算法准确度报告_v1.2 - 图2 测试样本数量 :90 人次 90 个样本;
测试环境与设备数量 :3 处睡眠场景,分别对应 3 台 设备; 无线连接方式 :WiFi;
测试日期 :2020/06/17 – 2020/07/31;

测试环境及设备安装:

  1. 环境一:展厅
Sleepace算法准确度报告_v1.2 - 图3

床垫:F ,TOP-120N ,防褥疮床垫,120mm 厚

环境二:研发空地

Sleepace算法准确度报告_v1.2 - 图4

床垫:F ,SM-28N,可水洗高密度聚氨酯超薄床垫,60mm 厚

环境三:睡眠实验室

Sleepace算法准确度报告_v1.2 - 图5

床垫:F ,SMー12SU ,薄型高密度连续弹簧床垫,120mm 厚

测试方法:

通过摄像头监控数据人工标记清醒与睡着状态,与算法输出对比得出实时分期的准确率(清醒与睡着二分期);

标记时长(分钟) 准确率(%)
数据 清醒 Wake 睡着 Sleep 清醒 Wake 睡着 Sleep 全局 Total
20200616周二_A1展厅_钟礼浩 125.75 320.75 67% 100% 91%
20200616周二_A2空地_程晗 189.75 268.5 44% 99% 76%
20200616周二_A3睡眠实验室_徐志 19 382 100% 88% 89%
20200617周三_A1展厅_陈彪 75.5 446 59% 94% 89%
20200617周三_A2空地_王建泉 121.25 428 31% 99% 84%
20200617周三_A3睡眠实验室_张延庆 2.25 303 100% 100% 100%
20200618周四_A1展厅_李明 9.75 346.25 100% 99% 99%
20200618周四_A2空地_黄朝维 55 464.5 18% 97% 89%
20200618周四_A3睡眠实验室_胡德和 9.5 450.5 74% 98% 97%
20200619周五_A1展厅_李芳 10.25 442.25 78% 100% 99%
20200619周五_A2空地_陈萍莉 130.5 317.75 26% 99% 78%
20200619周五_A3睡眠实验室_田瑞英 107.75 355.75 64% 99% 91%
20200622周一_A1展厅_杨春 155.5 247.25 54% 95% 79%
20200622周一_A3睡眠实验室_胡彩云 21.25 308.75 29% 97% 93%
20200623周二_A1展厅_徐美娟 154.75 317.75 69% 97% 88%


| | —- |

| | —- |

测试记录:


20200623周二_A2空地_常莉 53.75 408 74% 99% 96%
20200623周二_A3睡眠实验室_陈雯 33.75 374 73% 85% 84%
20200624周三_A1展厅_杨博 190 262.25 72% 88% 81%
20200624周三_A2空地_赵涛 36.25 310.25 52% 98% 93%
20200624周三_A3睡眠实验室_谷志瑜 0 320.5 98% 98%
20200628周日_A1展厅_陈祯坤 0 373 98% 98%
20200628周日_A2空地_崔晓东 33 433.5 32% 95% 91%
20200628周日_A3睡眠实验室_王勇 0 441 99% 99%
20200629周一_A1展厅_彭泽龙 19 420.75 100% 97% 97%
20200629周一_A2空地_邓顺列 307.75 246.75 48% 100% 71%
20200629周一_A3睡眠实验室_任传广 31.75 476 47% 100% 97%
20200630周二_A1展厅_陈文杰 4 310 100% 95% 95%
20200630周二_A2空地_冯新平 4 348.5 69% 99% 98%
20200630周二_A3睡眠实验室_史廷俊 50.5 369 49% 96% 91%
20200701周三_A1展厅_王德权 31.25 481.25 42% 95% 92%
20200701周三_A2空地_陈小斌
20200701周三_A3睡眠实验室_付文星 25.5 352.25 32% 99% 94%
20200702周四_A1展厅_孙晓燕 76.5 325.75 95% 98% 98%
20200702周四_A2空地_曾冰钰 113.5 311 38% 100% 83%
20200702周四_A3睡眠实验室_杨杨 39.5 384 46% 96% 91%
20200703周五_A1展厅_李敏 30.25 456.25 58% 100% 97%
20200703周五_A2空地_王碧玉 61.25 413.25 42% 94% 87%
20200703周五_A3睡眠实验室_史良 140 332.5 46% 88% 75%
20200706周一_A1展厅_廖嘉祺 27 323.25 44% 100% 95%
20200706周一_A2空地_庄柏杨 5.25 292.5 100% 69% 69%
20200707周二_A1展厅_杨远瑞 29.5 365.5 39% 100% 95%
20200707周二_A2空地_刘育峰
20200707周二_A3睡眠实验室_杨杰 75 426.75 28% 100% 89%
20200708周三_A1展厅_陈鹏 99 391.75 37% 100% 87%
20200708周三_A2空地_郭继承 189.5 417.25 46% 93% 78%
20200708周三_A3睡眠实验室_谢龙 33.5 468.75 62% 99% 96%
20200709周四_A1展厅_刘小三 13.25 513.5 100% 95% 95%
20200709周四_A2空地_邓仁超 111.75 368.75 6% 100% 78%
20200709周四_A3睡眠实验室_沈劲鹏 455 97% 97%
20200710周五_A1展厅_肖达 6.75 377 100% 100% 100%
20200710周五_A2空地_冰小月 10.75 303 100% 86% 87%
20200710周五_A3睡眠实验室_梁山 4.75 376.25 100% 97% 97%


20200713周一_A1展厅_钟礼浩 88 170.25 45% 99% 81%
20200713周一_A2空地_徐志 89.25 413.5 37% 97% 86%
20200714周二_A1展厅_陈晗 55.75 404 78% 90% 89%
20200714周二_A2空地_王建泉 63 486.75 100% 96% 96%
20200714周二_A3睡眠实验室_张延庆 20 353.5 95% 93% 93%
20200715周三_A2空地_胡德和 15.5 404.25 98% 82% 82%
20200715周三_A3睡眠实验室_谷志瑜 18 391.5 63% 98% 96%
20200716周四_A1展厅_崔晓东 71.25 355.25 98% 99% 99%
20200716周四_A2空地_赵涛 56.5 371.75 39% 77% 72%
20200716周四_A3睡眠实验室_黄朝维 34 402 72% 92% 91%
20200717周五_A1展厅_李芳 25.75 434 23% 100% 95%
20200717周五_A2空地_陈萍莉 66.75 342.25 19% 98% 85%
20200717周五_A3睡眠实验室_田瑞英 31.5 404.25 87% 91% 91%
20200720周一_A1展厅_刘小三 64.5 455.25 91% 96% 96%
20200720周一_A3睡眠实验室_沈劲鹏
20200721周二_A1展厅_彭泽龙 18.75 400.75 100% 99% 99%
20200721周二_A2空地_杨杰 35.25 468.5 45% 100% 96%
20200721周二_A3睡眠实验室_邓顺列 223 310 87% 75% 80%
20200722周三_A1展厅_陈文杰 9.25 443 100% 94% 94%
20200722周三_A2空地_冯新平 40.75 275.5 32% 99% 91%
20200722周三_A3睡眠实验室_史廷俊 50.75 261 93% 94% 94%
20200723周四_A1展厅_王德权 88 398.25 55% 99% 91%
20200723周四_A2空地_付文星 40 313.5 58% 98% 94%
20200723周四_A3睡眠实验室_陈小斌 17 440.75 100% 55% 57%
20200724周五_A1展厅_徐美娟 111.5 260.5 49% 95% 81%
20200724周五_A2空地_常莉 79 334.5 44% 96% 86%
20200724周五_A3睡眠实验室_陈雯 62.25 368 100% 63% 68%
20200727周一_A1展厅_杨博 71.5 456.5 30% 97% 88%
20200727周一_A2空地_廖嘉祺 40.25 335.25 63% 99% 95%
20200727周一_A3睡眠实验室_庄柏杨 61.25 248 100% 75% 80%
20200728周二_A1展厅_杨源瑞 23.75 490.75 39% 100% 97%
20200728周二_A2空地_任传广 24.5 447.5 100% 98% 98%
20200728周二_A3睡眠实验室_王勇 44.75 394.5 85% 90% 90%
20200729周三_A1展厅_陈鹏 139.25 388 23% 100% 80%
20200729周三_A2空地_郭继承 127.5 375.75 48% 98% 86%
20200729周三_A3睡眠实验室_谢龙 42.75 468.75 100% 91% 91%


20200731周五_A1展厅_李敏 13 433.5 79% 99% 98%
20200731周五_A2空地_孙晓燕 150.75 217.5 93% 95% 94%
平均 64.55% 94.61% 89.55%


测试准确度:
清醒识别准确率:64.55%,清醒误判率:35.45%;
睡着识别准确度 :94.61%,睡着误判率:5.39%;
名词解释:
清醒识别准确率:即当用户实际处于清醒状态时设备分析为清醒;
清醒误判率:即当用户实际处于清醒状态时设备分析为睡着;
睡着识别准确度:即当用户实际处于睡着状态时设备分析为睡着;
睡着误判率:即当用户实际处于睡着状态时设备分析为清醒;

测试现场图:

Sleepace算法准确度报告_v1.2 - 图6


分期对比图:
20200616周二_A1展厅_钟礼浩


Sleepace算法准确度报告_v1.2 - 图7


Sleepace算法准确度报告_v1.2 - 图8

Sleepace算法准确度报告_v1.2 - 图9 Sleepace算法准确度报告_v1.2 - 图10 Sleepace算法准确度报告_v1.2 - 图11 Sleepace算法准确度报告_v1.2 - 图12 Sleepace算法准确度报告_v1.2 - 图13 Sleepace算法准确度报告_v1.2 - 图14 Sleepace算法准确度报告_v1.2 - 图15 Sleepace算法准确度报告_v1.2 - 图16 Sleepace算法准确度报告_v1.2 - 图17 Sleepace算法准确度报告_v1.2 - 图18 Sleepace算法准确度报告_v1.2 - 图19 Sleepace算法准确度报告_v1.2 - 图20



20200616周二_A2空地_程晗



Sleepace算法准确度报告_v1.2 - 图21

Sleepace算法准确度报告_v1.2 - 图22 Sleepace算法准确度报告_v1.2 - 图23 Sleepace算法准确度报告_v1.2 - 图24 Sleepace算法准确度报告_v1.2 - 图25 Sleepace算法准确度报告_v1.2 - 图26 Sleepace算法准确度报告_v1.2 - 图27 Sleepace算法准确度报告_v1.2 - 图28 Sleepace算法准确度报告_v1.2 - 图29 Sleepace算法准确度报告_v1.2 - 图30 Sleepace算法准确度报告_v1.2 - 图31 Sleepace算法准确度报告_v1.2 - 图32 Sleepace算法准确度报告_v1.2 - 图33


20200619周五_A3睡眠实验室_田瑞英


Sleepace算法准确度报告_v1.2 - 图34


Sleepace算法准确度报告_v1.2 - 图35

Sleepace算法准确度报告_v1.2 - 图36 Sleepace算法准确度报告_v1.2 - 图37 Sleepace算法准确度报告_v1.2 - 图38 Sleepace算法准确度报告_v1.2 - 图39 Sleepace算法准确度报告_v1.2 - 图40 Sleepace算法准确度报告_v1.2 - 图41 Sleepace算法准确度报告_v1.2 - 图42 Sleepace算法准确度报告_v1.2 - 图43 Sleepace算法准确度报告_v1.2 - 图44 Sleepace算法准确度报告_v1.2 - 图45 Sleepace算法准确度报告_v1.2 - 图46