1.1 实时分期准确度测试
测试用例:
产品 :F
测试样本数量 :90 人次 90 个样本;
测试环境与设备数量 :3 处睡眠场景,分别对应 3 台 设备; 无线连接方式 :WiFi;
测试日期 :2020/06/17 – 2020/07/31;
测试环境及设备安装:
环境一:展厅
床垫:F ,TOP-120N ,防褥疮床垫,120mm 厚
环境二:研发空地
床垫:F ,SM-28N,可水洗高密度聚氨酯超薄床垫,60mm 厚
环境三:睡眠实验室
床垫:F ,SMー12SU ,薄型高密度连续弹簧床垫,120mm 厚
测试方法:
通过摄像头监控数据人工标记清醒与睡着状态,与算法输出对比得出实时分期的准确率(清醒与睡着二分期);
标记时长(分钟) | 准确率(%) | ||||||
---|---|---|---|---|---|---|---|
数据 | 清醒 Wake | 睡着 Sleep | 清醒 Wake | 睡着 Sleep | 全局 Total | ||
20200616周二_A1展厅_钟礼浩 | 125.75 | 320.75 | 67% | 100% | 91% | ||
20200616周二_A2空地_程晗 | 189.75 | 268.5 | 44% | 99% | 76% | ||
20200616周二_A3睡眠实验室_徐志 | 19 | 382 | 100% | 88% | 89% | ||
20200617周三_A1展厅_陈彪 | 75.5 | 446 | 59% | 94% | 89% | ||
20200617周三_A2空地_王建泉 | 121.25 | 428 | 31% | 99% | 84% | ||
20200617周三_A3睡眠实验室_张延庆 | 2.25 | 303 | 100% | 100% | 100% | ||
20200618周四_A1展厅_李明 | 9.75 | 346.25 | 100% | 99% | 99% | ||
20200618周四_A2空地_黄朝维 | 55 | 464.5 | 18% | 97% | 89% | ||
20200618周四_A3睡眠实验室_胡德和 | 9.5 | 450.5 | 74% | 98% | 97% | ||
20200619周五_A1展厅_李芳 | 10.25 | 442.25 | 78% | 100% | 99% | ||
20200619周五_A2空地_陈萍莉 | 130.5 | 317.75 | 26% | 99% | 78% | ||
20200619周五_A3睡眠实验室_田瑞英 | 107.75 | 355.75 | 64% | 99% | 91% | ||
20200622周一_A1展厅_杨春 | 155.5 | 247.25 | 54% | 95% | 79% | ||
20200622周一_A3睡眠实验室_胡彩云 | 21.25 | 308.75 | 29% | 97% | 93% | ||
20200623周二_A1展厅_徐美娟 | 154.75 | 317.75 | 69% | 97% | 88% |
|
| —- |
| | —- |
测试记录:
20200623周二_A2空地_常莉 | 53.75 | 408 | 74% | 99% | 96% |
---|---|---|---|---|---|
20200623周二_A3睡眠实验室_陈雯 | 33.75 | 374 | 73% | 85% | 84% |
20200624周三_A1展厅_杨博 | 190 | 262.25 | 72% | 88% | 81% |
20200624周三_A2空地_赵涛 | 36.25 | 310.25 | 52% | 98% | 93% |
20200624周三_A3睡眠实验室_谷志瑜 | 0 | 320.5 | 98% | 98% | |
20200628周日_A1展厅_陈祯坤 | 0 | 373 | 98% | 98% | |
20200628周日_A2空地_崔晓东 | 33 | 433.5 | 32% | 95% | 91% |
20200628周日_A3睡眠实验室_王勇 | 0 | 441 | 99% | 99% | |
20200629周一_A1展厅_彭泽龙 | 19 | 420.75 | 100% | 97% | 97% |
20200629周一_A2空地_邓顺列 | 307.75 | 246.75 | 48% | 100% | 71% |
20200629周一_A3睡眠实验室_任传广 | 31.75 | 476 | 47% | 100% | 97% |
20200630周二_A1展厅_陈文杰 | 4 | 310 | 100% | 95% | 95% |
20200630周二_A2空地_冯新平 | 4 | 348.5 | 69% | 99% | 98% |
20200630周二_A3睡眠实验室_史廷俊 | 50.5 | 369 | 49% | 96% | 91% |
20200701周三_A1展厅_王德权 | 31.25 | 481.25 | 42% | 95% | 92% |
20200701周三_A2空地_陈小斌 | |||||
20200701周三_A3睡眠实验室_付文星 | 25.5 | 352.25 | 32% | 99% | 94% |
20200702周四_A1展厅_孙晓燕 | 76.5 | 325.75 | 95% | 98% | 98% |
20200702周四_A2空地_曾冰钰 | 113.5 | 311 | 38% | 100% | 83% |
20200702周四_A3睡眠实验室_杨杨 | 39.5 | 384 | 46% | 96% | 91% |
20200703周五_A1展厅_李敏 | 30.25 | 456.25 | 58% | 100% | 97% |
20200703周五_A2空地_王碧玉 | 61.25 | 413.25 | 42% | 94% | 87% |
20200703周五_A3睡眠实验室_史良 | 140 | 332.5 | 46% | 88% | 75% |
20200706周一_A1展厅_廖嘉祺 | 27 | 323.25 | 44% | 100% | 95% |
20200706周一_A2空地_庄柏杨 | 5.25 | 292.5 | 100% | 69% | 69% |
20200707周二_A1展厅_杨远瑞 | 29.5 | 365.5 | 39% | 100% | 95% |
20200707周二_A2空地_刘育峰 | |||||
20200707周二_A3睡眠实验室_杨杰 | 75 | 426.75 | 28% | 100% | 89% |
20200708周三_A1展厅_陈鹏 | 99 | 391.75 | 37% | 100% | 87% |
20200708周三_A2空地_郭继承 | 189.5 | 417.25 | 46% | 93% | 78% |
20200708周三_A3睡眠实验室_谢龙 | 33.5 | 468.75 | 62% | 99% | 96% |
20200709周四_A1展厅_刘小三 | 13.25 | 513.5 | 100% | 95% | 95% |
20200709周四_A2空地_邓仁超 | 111.75 | 368.75 | 6% | 100% | 78% |
20200709周四_A3睡眠实验室_沈劲鹏 | 455 | 97% | 97% | ||
20200710周五_A1展厅_肖达 | 6.75 | 377 | 100% | 100% | 100% |
20200710周五_A2空地_冰小月 | 10.75 | 303 | 100% | 86% | 87% |
20200710周五_A3睡眠实验室_梁山 | 4.75 | 376.25 | 100% | 97% | 97% |
20200713周一_A1展厅_钟礼浩 | 88 | 170.25 | 45% | 99% | 81% |
20200713周一_A2空地_徐志 | 89.25 | 413.5 | 37% | 97% | 86% |
20200714周二_A1展厅_陈晗 | 55.75 | 404 | 78% | 90% | 89% |
20200714周二_A2空地_王建泉 | 63 | 486.75 | 100% | 96% | 96% |
20200714周二_A3睡眠实验室_张延庆 | 20 | 353.5 | 95% | 93% | 93% |
20200715周三_A2空地_胡德和 | 15.5 | 404.25 | 98% | 82% | 82% |
20200715周三_A3睡眠实验室_谷志瑜 | 18 | 391.5 | 63% | 98% | 96% |
20200716周四_A1展厅_崔晓东 | 71.25 | 355.25 | 98% | 99% | 99% |
20200716周四_A2空地_赵涛 | 56.5 | 371.75 | 39% | 77% | 72% |
20200716周四_A3睡眠实验室_黄朝维 | 34 | 402 | 72% | 92% | 91% |
20200717周五_A1展厅_李芳 | 25.75 | 434 | 23% | 100% | 95% |
20200717周五_A2空地_陈萍莉 | 66.75 | 342.25 | 19% | 98% | 85% |
20200717周五_A3睡眠实验室_田瑞英 | 31.5 | 404.25 | 87% | 91% | 91% |
20200720周一_A1展厅_刘小三 | 64.5 | 455.25 | 91% | 96% | 96% |
20200720周一_A3睡眠实验室_沈劲鹏 | |||||
20200721周二_A1展厅_彭泽龙 | 18.75 | 400.75 | 100% | 99% | 99% |
20200721周二_A2空地_杨杰 | 35.25 | 468.5 | 45% | 100% | 96% |
20200721周二_A3睡眠实验室_邓顺列 | 223 | 310 | 87% | 75% | 80% |
20200722周三_A1展厅_陈文杰 | 9.25 | 443 | 100% | 94% | 94% |
20200722周三_A2空地_冯新平 | 40.75 | 275.5 | 32% | 99% | 91% |
20200722周三_A3睡眠实验室_史廷俊 | 50.75 | 261 | 93% | 94% | 94% |
20200723周四_A1展厅_王德权 | 88 | 398.25 | 55% | 99% | 91% |
20200723周四_A2空地_付文星 | 40 | 313.5 | 58% | 98% | 94% |
20200723周四_A3睡眠实验室_陈小斌 | 17 | 440.75 | 100% | 55% | 57% |
20200724周五_A1展厅_徐美娟 | 111.5 | 260.5 | 49% | 95% | 81% |
20200724周五_A2空地_常莉 | 79 | 334.5 | 44% | 96% | 86% |
20200724周五_A3睡眠实验室_陈雯 | 62.25 | 368 | 100% | 63% | 68% |
20200727周一_A1展厅_杨博 | 71.5 | 456.5 | 30% | 97% | 88% |
20200727周一_A2空地_廖嘉祺 | 40.25 | 335.25 | 63% | 99% | 95% |
20200727周一_A3睡眠实验室_庄柏杨 | 61.25 | 248 | 100% | 75% | 80% |
20200728周二_A1展厅_杨源瑞 | 23.75 | 490.75 | 39% | 100% | 97% |
20200728周二_A2空地_任传广 | 24.5 | 447.5 | 100% | 98% | 98% |
20200728周二_A3睡眠实验室_王勇 | 44.75 | 394.5 | 85% | 90% | 90% |
20200729周三_A1展厅_陈鹏 | 139.25 | 388 | 23% | 100% | 80% |
20200729周三_A2空地_郭继承 | 127.5 | 375.75 | 48% | 98% | 86% |
20200729周三_A3睡眠实验室_谢龙 | 42.75 | 468.75 | 100% | 91% | 91% |
20200731周五_A1展厅_李敏 | 13 | 433.5 | 79% | 99% | 98% |
---|---|---|---|---|---|
20200731周五_A2空地_孙晓燕 | 150.75 | 217.5 | 93% | 95% | 94% |
平均 | 64.55% | 94.61% | 89.55% |
测试准确度:
清醒识别准确率:64.55%,清醒误判率:35.45%;
睡着识别准确度 :94.61%,睡着误判率:5.39%;
名词解释:
清醒识别准确率:即当用户实际处于清醒状态时设备分析为清醒;
清醒误判率:即当用户实际处于清醒状态时设备分析为睡着;
睡着识别准确度:即当用户实际处于睡着状态时设备分析为睡着;
睡着误判率:即当用户实际处于睡着状态时设备分析为清醒;
测试现场图:
分期对比图:
20200616周二_A1展厅_钟礼浩
20200616周二_A2空地_程晗
20200619周五_A3睡眠实验室_田瑞英