safety-utcustom-train-SF-RGBD-b5開源模型 - 用於RGBD圖像安全與危險區域識別

首頁

Safety Utcustom Train SF RGBD B5

由sam1120開發

基於nvidia/mit-b5微調的安全視覺分割模型，專注於RGBD圖像中的安全與危險區域識別

圖像分割

Transformers

開源協議:其他 #RGBD安全檢測 #高精度分割 #工業場景適用

下載量 17

發布時間 : 2/6/2024

模型概述

該模型是基於MIT-B5架構的改進版本，專門用於處理RGBD圖像數據，能夠有效識別圖像中的安全區域和危險區域。在安全類別識別上達到55.78%的準確率，危險類別識別準確率高達99.47%。

模型特點

高精度危險區域檢測

在危險區域識別上達到99.47%的準確率和98.14%的交併比

RGBD圖像處理能力

專門優化用於處理包含深度信息的RGBD圖像數據

平衡性能表現

在整體準確率(98.18%)和類別平衡性(安全類別47.45%交併比)間取得良好平衡

模型能力

圖像分割

安全區域識別

危險區域檢測

RGBD圖像處理

使用案例

工業安全監控

工廠危險區域即時監測

用於監控工廠環境中的危險區域，及時預警人員接近

可準確識別99%以上的危險區域

智能安防系統

公共場所安全監控

識別公共場所中的潛在危險區域

平衡識別安全與危險區域

🚀 safety-utcustom-train-SF-RGBD-b5

本模型是 nvidia/mit-b5 在 sam1120/safety-utcustom-TRAIN 數據集上的微調版本。它在評估集上取得了以下結果：

損失：0.0867
平均交併比（Mean Iou）：0.7280
平均準確率（Mean Accuracy）：0.7762
總體準確率（Overall Accuracy）：0.9818
未標記類別的準確率（Accuracy Unlabeled）：nan
安全類別的準確率（Accuracy Safe）：0.5578
不安全類別的準確率（Accuracy Unsafe）：0.9947
未標記類別的交併比（Iou Unlabeled）：nan
安全類別的交併比（Iou Safe）：0.4745
不安全類別的交併比（Iou Unsafe）：0.9814

🚀 快速開始

本模型是基於 nvidia/mit-b5 在特定數據集上微調得到的圖像分割模型，可用於相關視覺任務。

🔧 技術細節

訓練超參數

訓練過程中使用了以下超參數：

學習率（learning_rate）：4e-06
訓練批次大小（train_batch_size）：15
評估批次大小（eval_batch_size）：15
隨機種子（seed）：42
優化器（optimizer）：Adam，其中 betas=(0.9, 0.999)，epsilon=1e-08
學習率調度器類型（lr_scheduler_type）：線性
學習率調度器預熱比例（lr_scheduler_warmup_ratio）：0.05
訓練輪數（num_epochs）：120

訓練結果

訓練損失	輪數	步數	安全類別準確率	未標記類別準確率	不安全類別準確率	安全類別交併比	未標記類別交併比	不安全類別交併比	驗證損失	平均準確率	平均交併比	總體準確率
0.789	0.91	10	0.0203	nan	0.8957	0.0095	0.0	0.8722	0.9555	0.4580	0.2939	0.8698
0.7579	1.82	20	0.0117	nan	0.9614	0.0069	0.0	0.9338	0.8322	0.4866	0.3136	0.9334
0.7103	2.73	30	0.0051	nan	0.9893	0.0043	0.0	0.9604	0.6729	0.4972	0.3216	0.9602
0.676	3.64	40	0.0021	nan	0.9969	0.0020	0.0	0.9675	0.5336	0.4995	0.3232	0.9675
0.5955	4.55	50	0.0001	nan	0.9993	0.0001	0.0	0.9698	0.4440	0.4997	0.3233	0.9698
0.5691	5.45	60	0.0000	nan	0.9997	0.0000	0.0	0.9702	0.3812	0.4999	0.3234	0.9702
0.5067	6.36	70	0.0	nan	0.9996	0.0	0.0	0.9701	0.3590	0.4998	0.3234	0.9701
0.4656	7.27	80	0.0	nan	0.9999	0.0	0.0	0.9703	0.3247	0.4999	0.3234	0.9703
0.4227	8.18	90	0.0	nan	0.9998	0.0	0.0	0.9702	0.3171	0.4999	0.3234	0.9702
0.3898	9.09	100	0.0004	nan	0.9996	0.0004	0.0	0.9701	0.3122	0.5000	0.3235	0.9701
0.3513	10.0	110	0.0	nan	0.9999	0.0	0.0	0.9703	0.2876	0.4999	0.3234	0.9703
0.4157	10.91	120	0.0000	nan	0.9998	0.0000	0.0	0.9703	0.2820	0.4999	0.3234	0.9703
0.3317	11.82	130	0.0	nan	0.9999	0.0	0.0	0.9703	0.2693	0.4999	0.3234	0.9703
0.321	12.73	140	0.0	nan	0.9999	0.0	0.0	0.9704	0.2647	0.4999	0.3235	0.9704
0.2887	13.64	150	0.0	nan	0.9999	0.0	0.0	0.9704	0.2539	0.5000	0.3235	0.9704
0.3008	14.55	160	0.0	nan	0.9999	0.0	0.0	0.9704	0.2536	0.5000	0.3235	0.9704
0.2853	15.45	170	0.0	nan	0.9999	0.0	0.0	0.9704	0.2397	0.5000	0.3235	0.9704
0.2684	16.36	180	0.0	nan	0.9999	0.0	0.0	0.9704	0.2321	0.5000	0.3235	0.9704
0.2585	17.27	190	0.0000	nan	0.9999	0.0000	0.0	0.9704	0.2208	0.5000	0.3235	0.9704
0.2088	18.18	200	0.0084	nan	0.9997	0.0083	0.0	0.9704	0.2011	0.5041	0.3262	0.9704
0.2518	19.09	210	0.0468	nan	0.9989	0.0451	0.0	0.9707	0.2026	0.5228	0.3386	0.9707
0.218	20.0	220	0.0879	nan	0.9984	0.0834	nan	0.9714	0.1889	0.5431	0.5274	0.9715
0.2046	20.91	230	0.1931	nan	0.9969	0.1752	nan	0.9730	0.1847	0.5950	0.5741	0.9732
0.2147	21.82	240	0.2042	nan	0.9968	0.1850	nan	0.9733	0.1766	0.6005	0.5791	0.9734
0.188	22.73	250	0.2020	nan	0.9972	0.1849	nan	0.9735	0.1726	0.5996	0.5792	0.9737
0.2175	23.64	260	0.1898	nan	0.9974	0.1748	nan	0.9734	0.1706	0.5936	0.5741	0.9735
0.2059	24.55	270	0.3006	nan	0.9962	0.2670	nan	0.9754	0.1689	0.6484	0.6212	0.9756
0.1776	25.45	280	0.2870	nan	0.9967	0.2587	nan	0.9755	0.1612	0.6418	0.6171	0.9757
0.1585	26.36	290	0.4254	nan	0.9944	0.3593	nan	0.9773	0.1537	0.7099	0.6683	0.9776
0.1588	27.27	300	0.2798	nan	0.9970	0.2548	nan	0.9756	0.1527	0.6384	0.6152	0.9758
0.153	28.18	310	0.4288	nan	0.9946	0.3646	nan	0.9776	0.1452	0.7117	0.6711	0.9779
0.1623	29.09	320	0.4401	nan	0.9945	0.3726	nan	0.9778	0.1442	0.7173	0.6752	0.9781
0.1603	30.0	330	0.4050	nan	0.9958	0.3562	nan	0.9781	0.1407	0.7004	0.6671	0.9784
0.1694	30.91	340	0.4585	nan	0.9948	0.3911	nan	0.9786	0.1343	0.7266	0.6849	0.9789
0.1585	31.82	350	0.3861	nan	0.9962	0.3433	nan	0.9779	0.1353	0.6912	0.6606	0.9782
0.1342	32.73	360	0.4963	nan	0.9939	0.4132	nan	0.9789	0.1338	0.7451	0.6961	0.9792
0.1358	33.64	370	0.5048	nan	0.9937	0.4182	nan	0.9789	0.1342	0.7493	0.6986	0.9793
0.1493	34.55	380	0.4809	nan	0.9946	0.4080	nan	0.9791	0.1297	0.7377	0.6936	0.9794
0.1435	35.45	390	0.5658	nan	0.9923	0.4518	nan	0.9794	0.1271	0.7791	0.7156	0.9797
0.1305	36.36	400	0.4157	nan	0.9968	0.3758	nan	0.9793	0.1225	0.7062	0.6776	0.9796
0.1496	37.27	410	0.5385	nan	0.9934	0.4420	nan	0.9796	0.1237	0.7659	0.7108	0.9799
0.1445	38.18	420	0.5763	nan	0.9924	0.4615	nan	0.9798	0.1207	0.7843	0.7206	0.9801
0.1307	39.09	430	0.4853	nan	0.9956	0.4244	nan	0.9803	0.1194	0.7404	0.7023	0.9806
0.1379	40.0	440	0.5722	nan	0.9922	0.4557	nan	0.9795	0.1174	0.7822	0.7176	0.9798
0.1202	40.91	450	0.5399	nan	0.9943	0.4544	nan	0.9805	0.1143	0.7671	0.7175	0.9809
0.1239	41.82	460	0.5580	nan	0.9932	0.4558	nan	0.9800	0.1150	0.7756	0.7179	0.9803
0.1183	42.73	470	0.4777	nan	0.9961	0.4236	nan	0.9805	0.1129	0.7369	0.7021	0.9808
0.1202	43.64	480	0.5933	nan	0.9928	0.4793	nan	0.9806	0.1119	0.7930	0.7300	0.9810
0.1276	44.55	490	0.5425	nan	0.9942	0.4561	nan	0.9806	0.1131	0.7683	0.7183	0.9809
0.1172	45.45	500	0.6272	nan	0.9898	0.4700	nan	0.9787	0.1135	0.8085	0.7244	0.9791
0.1288	46.36	510	0.4236	nan	0.9974	0.3898	nan	0.9802	0.1105	0.7105	0.6850	0.9804
0.1185	47.27	520	0.6035	nan	0.9914	0.4711	nan	0.9796	0.1130	0.7975	0.7254	0.9800
0.1045	48.18	530	0.5750	nan	0.9930	0.4679	nan	0.9804	0.1102	0.7840	0.7241	0.9807
0.1211	49.09	540	0.5812	nan	0.9929	0.4715	nan	0.9804	0.1069	0.7870	0.7260	0.9808
0.1206	50.0	550	0.5221	nan	0.9953	0.4528	nan	0.9811	0.1071	0.7587	0.7169	0.9814
0.1193	50.91	560	0.4956	nan	0.9961	0.4398	nan	0.9811	0.1053	0.7459	0.7105	0.9814
0.1116	51.82	570	0.5257	nan	0.9951	0.4528	nan	0.9809	0.1043	0.7604	0.7169	0.9812
0.1218	52.73	580	0.5936	nan	0.9922	0.4724	nan	0.9801	0.1078	0.7929	0.7262	0.9804
0.1284	53.64	590	0.5872	nan	0.9924	0.4696	nan	0.9801	0.1054	0.7898	0.7248	0.9804
0.096	54.55	600	0.5451	nan	0.9942	0.4580	nan	0.9806	0.1028	0.7697	0.7193	0.9809
0.1091	55.45	610	0.6014	nan	0.9917	0.4725	nan	0.9798	0.1022	0.7965	0.7261	0.9802
0.1068	56.36	620	0.4926	nan	0.9962	0.4374	nan	0.9810	0.1015	0.7444	0.7092	0.9813
0.106	57.27	630	0.5713	nan	0.9937	0.4731	nan	0.9809	0.1011	0.7825	0.7270	0.9812
0.1009	58.18	640	0.4512	nan	0.9969	0.4089	nan	0.9805	0.1028	0.7240	0.6947	0.9807
0.1018	59.09	650	0.6053	nan	0.9919	0.4779	nan	0.9801	0.1022	0.7986	0.7290	0.9805
0.1012	60.0	660	0.5167	nan	0.9949	0.4427	nan	0.9805	0.1016	0.7558	0.7116	0.9808
0.1052	60.91	670	0.5464	nan	0.9943	0.4604	nan	0.9808	0.0999	0.7703	0.7206	0.9811
0.1229	61.82	680	0.5706	nan	0.9939	0.4750	nan	0.9810	0.0993	0.7822	0.7280	0.9814
0.0963	62.73	690	0.5746	nan	0.9936	0.4754	nan	0.9809	0.0974	0.7841	0.7282	0.9813
0.1115	63.64	700	0.5239	nan	0.9955	0.4562	nan	0.9813	0.0974	0.7597	0.7187	0.9816
0.1025	64.55	710	0.5845	nan	0.9935	0.4813	nan	0.9811	0.0964	0.7890	0.7312	0.9814
0.0916	65.45	720	0.5493	nan	0.9947	0.4685	nan	0.9813	0.0962	0.7720	0.7249	0.9816
0.1055	66.36	730	0.5273	nan	0.9953	0.4571	nan	0.9812	0.0947	0.7613	0.7191	0.9815
0.1081	67.27	740	0.6093	nan	0.9919	0.4813	nan	0.9802	0.0964	0.8006	0.7308	0.9806
0.1039	68.18	750	0.5405	nan	0.9945	0.4573	nan	0.9807	0.0950	0.7675	0.7190	0.9811
0.106	69.09	760	0.5564	nan	0.9943	0.4682	nan	0.9810	0.0939	0.7753	0.7246	0.9813
0.0912	70.0	770	0.5377	nan	0.9949	0.4612	nan	0.9811	0.0936	0.7663	0.7212	0.9814
0.0951	70.91	780	0.5600	nan	0.9941	0.4689	nan	0.9809	0.0938	0.7771	0.7249	0.9813
0.0998	71.82	790	0.5573	nan	0.9944	0.4705	nan	0.9812	0.0928	0.7759	0.7258	0.9815
0.0889	72.73	800	0.5398	nan	0.9949	0.4628	nan	0.9812	0.0931	0.7674	0.7220	0.9815
0.0906	73.64	810	0.5151	nan	0.9958	0.4528	nan	0.9813	0.0928	0.7555	0.7171	0.9816
0.0911	74.55	820	0.5682	nan	0.9938	0.4722	nan	0.9809	0.0924	0.7810	0.7265	0.9812
0.0907	75.45	830	0.4864	nan	0.9965	0.4365	nan	0.9812	0.0929	0.7415	0.7089	0.9815
0.1117	76.36	840	0.5239	nan	0.9956	0.4576	nan	0.9814	0.0934	0.7598	0.7195	0.9817
0.0812	77.27	850	0.5279	nan	0.9956	0.4605	nan	0.9814	0.0915	0.7617	0.7210	0.9817
0.0888	78.18	860	0.5615	nan	0.9942	0.4720	nan	0.9811	0.0915	0.7778	0.7266	0.9814
0.09	79.09	870	0.5414	nan	0.9948	0.4628	nan	0.9811	0.0920	0.7681	0.7220	0.9814
0.1052	80.0	880	0.5866	nan	0.9932	0.4790	nan	0.9808	0.0917	0.7899	0.7299	0.9812
0.0867	80.91	890	0.5252	nan	0.9955	0.4573	nan	0.9813	0.0912	0.7603	0.7193	0.9816
0.0942	81.82	900	0.5091	nan	0.9959	0.4490	nan	0.9813	0.0925	0.7525	0.7152	0.9815
0.0917	82.73	910	0.5454	nan	0.9950	0.4682	nan	0.9814	0.0908	0.7702	0.7248	0.9817
0.103	83.64	920	0.5452	nan	0.9949	0.4672	nan	0.9813	0.0912	0.7701	0.7243	0.9816
0.0939	84.55	930	0.5539	nan	0.9947	0.4717	nan	0.9814	0.0900	0.7743	0.7265	0.9817
0.0892	85.45	940	0.5330	nan	0.9954	0.4635	nan	0.9815	0.0900	0.7642	0.7225	0.9818
0.0899	86.36	950	0.5756	nan	0.9938	0.4778	nan	0.9811	0.0905	0.7847	0.7295	0.9814
0.0877	87.27	960	0.5771	nan	0.9937	0.4787	nan	0.9811	0.0893	0.7854	0.7299	0.9814
0.0851	88.18	970	0.5087	nan	0.9961	0.4512	nan	0.9814	0.0897	0.7524	0.7163	0.9817
0.0857	89.09	980	0.5363	nan	0.9953	0.4644	nan	0.9814	0.0894	0.7658	0.7229	0.9817
0.0821	90.0	990	0.5333	nan	0.9953	0.4623	nan	0.9814	0.0895	0.7643	0.7218	0.9817
0.0931	90.91	1000	0.5581	nan	0.9944	0.4718	nan	0.9812	0.0895	0.7763	0.7265	0.9815
0.0787	91.82	1010	0.5525	nan	0.9946	0.4689	nan	0.9812	0.0889	0.7735	0.7251	0.9815
0.0865	92.73	1020	0.5659	nan	0.9941	0.4746	nan	0.9812	0.0883	0.7800	0.7279	0.9815
0.0939	93.64	1030	0.5583	nan	0.9945	0.4723	nan	0.9813	0.0891	0.7764	0.7268	0.9816
0.0874	94.55	1040	0.5258	nan	0.9955	0.4580	nan	0.9813	0.0893	0.7607	0.7197	0.9816
0.0927	95.45	1050	0.5319	nan	0.9953	0.4608	nan	0.9813	0.0894	0.7636	0.7211	0.9816
0.0808	96.36	1060	0.5444	nan	0.9949	0.4665	nan	0.9813	0.0897	0.7696	0.7239	0.9816
0.0924	97.27	1070	0.5445	nan	0.9950	0.4671	nan	0.9814	0.0892	0.7697	0.7243	0.9817
0.08	98.18	1080	0.5522	nan	0.9947	0.4703	nan	0.9813	0.0884	0.7735	0.7258	0.9816
0.0798	99.09	1090	0.0880	0.7300	0.7842	0.9815	nan	0.5745	0.9939	nan	0.4788	0.9812
0.0789	100.0	1100	0.0877	0.7231	0.7668	0.9817	nan	0.5383	0.9952	nan	0.4647	0.9814
0.0801	100.91	1110	0.0885	0.7232	0.7677	0.9816	nan	0.5404	0.9951	nan	0.4650	0.9813
0.1043	101.82	1120	0.0891	0.7242	0.7697	0.9816	nan	0.5445	0.9950	nan	0.4670	0.9813
0.0893	102.73	1130	0.0882	0.7263	0.7728	0.9817	nan	0.5508	0.9949	nan	0.4712	0.9814
0.0923	103.64	1140	0.0892	0.7134	0.7504	0.9815	nan	0.5048	0.9960	nan	0.4457	0.9812
0.0915	104.55	1150	0.0884	0.7293	0.7795	0.9817	nan	0.5646	0.9944	nan	0.4772	0.9814
0.0859	105.45	1160	0.0880	0.7340	0.7941	0.9815	nan	0.5949	0.9932	nan	0.4869	0.9811
0.0872	106.36	1170	0.0872	0.7298	0.7815	0.9817	nan	0.5688	0.9942	nan	0.4783	0.9814
0.0845	107.27	1180	0.0881	0.7310	0.7843	0.9817	nan	0.5746	0.9940	nan	0.4806	0.9813
0.0842	108.18	1190	0.0869	0.7285	0.7766	0.9818	nan	0.5584	0.9947	nan	0.4755	0.9815
0.0906	109.09	1200	0.0875	0.7277	0.7754	0.9818	nan	0.5560	0.9947	nan	0.4740	0.9815
0.0953	110.0	1210	0.0878	0.7289	0.7777	0.9818	nan	0.5608	0.9946	nan	0.4764	0.9815
0.0988	110.91	1220	0.0880	0.7303	0.7809	0.9818	nan	0.5674	0.9944	nan	0.4790	0.9815
0.0894	111.82	1230	0.0869	0.7300	0.7801	0.9818	nan	0.5657	0.9945	nan	0.4785	0.9815
0.0788	112.73	1240	0.0868	0.7283	0.7758	0.9818	nan	0.5569	0.9948	nan	0.4750	0.9815
0.0793	113.64	1250	0.0870	0.7281	0.7758	0.9818	nan	0.5569	0.9947	nan	0.4747	0.9815
0.084	114.55	1260	0.0874	0.7295	0.7809	0.9817	nan	0.5675	0.9943	nan	0.4777	0.9814
0.0832	115.45	1270	0.0875	0.7277	0.7760	0.9817	nan	0.5574	0.9946	nan	0.4739	0.9814
0.0833	116.36	1280	0.0873	0.7274	0.7755	0.9817	nan	0.5563	0.9947	nan	0.4735	0.9814
0.0786	117.27	1290	0.0867	0.7277	0.7754	0.9818	nan	0.5561	0.9947	nan	0.4740	0.9815
0.0839	118.18	1300	0.0865	0.7285	0.7779	0.9817	nan	0.5613	0.9945	nan	0.4755	0.9814
0.0847	119.09	1310	0.0877	0.7293	0.7816	0.9816	nan	0.5691	0.9941	nan	0.4773	0.9813
0.0933	120.0	1320	0.0867	0.7280	0.7762	0.9818	nan	0.5578	0.9947	nan	0.4745	0.9814