遗传算法优化小波阈值对水质光谱数据的去噪研究

大气与环境光学学报 ›› 2021, Vol. 16 ›› Issue (5): 432-442.

遗传算法优化小波阈值对水质光谱数据的去噪研究

肖渝, 黄丽雯, 汤斌∗, 肖棋森, 赵明富, 李奉笑

重庆理工大学光纤传感与光电检测重庆市重点实验室, 重庆 400054

收稿日期:2020-09-08 修回日期:2021-08-16 出版日期:2021-09-28 发布日期:2021-09-28
通讯作者: E-mail: tangbin@cqut.edu.cn E-mail:E-mail: tangbin@cqut.edu.cn
作者简介:肖渝 (1996 - ), 重庆人, 硕士研究生, 主要从事紫外-可见光谱水质参数检测方面的研究。 E-mail: xyshaw0321@163.com
基金资助:
Supported by Youth Program of National Natural Science Foundation of China (国家自然科学基金青年基金项目, 61805029), Scientific Research Foundation of Chongqing Education Commission of China (重庆市教委科研基金项目, KJQN201905605)

Denoising of Water Quality Spectral Data by Optimizing Wavelet Threshold Based on Genetic Algorithm

XIAO Yu, HUANG Liwen, TANG Bin∗, XIAO Qisen, ZHAO Mingfu, LI Fengxiao

Received:2020-09-08 Revised:2021-08-16 Published:2021-09-28 Online:2021-09-28
Supported by:
Youth Program of National Natural Science Foundation of China;Scientific Research Foundation of Chongqing Education Commission of China

摘要/Abstract

摘要： 针对紫外-可见光谱法水质检测系统易受到仪器本身和外界环境的噪声干扰, 所测得的光谱数据存在大量系统和杂散光噪声的问题, 在对紫外-可见光谱法水质检测系统的噪声源分析的基础上提出将遗传算法应用于小波阈值优化的去噪方法, 并与小波软阈值、 SG 平滑和中值滤波方法进行了对比。为评价去噪效果, 对同一浓度的邻苯二甲酸氢钾标液的紫外-可见光谱数据进行去噪实验。在采用遗传算法选取小波最优阈值对标液进行去噪处理的同时, 还采用传统小波软阈值去噪、 SG 平滑和中值滤波去噪作为对比。为验证该算法的实际可行性, 进一步用这四种方法对某地排水沟和某污水处理厂排水口的实际水样光谱进行去噪处理。实验结果表明: 基于遗传算法的小波阈值去噪效果良好, 相较于传统的小波软阈值去噪、 SG 平滑和中值滤波的方法, 信噪比分别提高了 2.2994、 5.7066、 2.6155 dB, 均方根误差分别减小了 0.0028、 0.0087、 0.0033, 峰值信噪比分别提高了 2.0837、 5.2569、 2.7375 dB。基于遗传算法的小波阈值去噪算法不仅抑制了光谱数据中的噪声, 同时也提高了系统精度, 为紫外-可见光谱法水质光谱去噪处理提供了一种新的解决办法。

关键词: 紫外-可见光谱法, 水质检测, 遗传算法, 小波阈值去噪

Abstract: Aiming at the problem that the ultraviolet-visible (UV-Vis) spectroscopy water quality detection system is susceptible to the noise interference from the instrument itself and the external environment, and there are a large number of system and stray light noise in the measured spectrum data, based on the analysis of the noise source of the water quality detection system by UV-Vis spectroscopy, a denoising method using genetic algorithm to optimize wavelet threshold is proposed and compared with the wavelet soft threshold, SG smoothing and median filtering methods. In order to evaluate the denoising effect, denoising experiments are carried out on the UV-Vis spectrum data of potassium hydrogen phthalate standard solution with the same concentration. The genetic algorithm is used to select the wavelet optimal threshold for denoising, and at the same time, the traditional wavelet soft threshold denoising, SG smoothing denoising and median filter denoising are also used for comparison. In order to verify the practical feasibility of the algorithm, the four methods are further used to denoise the spectra of actual water sample from a domestic sewage and outlets of a sewage treatment plant. The experimental results show that the wavelet threshold denoising effect based on genetic algorithm is obvious. Compared with the traditional wavelet soft threshold denoising, SG smoothing and median filtering methods, the signal-to-noise ratio of the new denoising method has been improved by 2.2994, 5.7066 and 2.6155 dB respectively, the root mean square error has been increased by 0.0028, 0.0087 and 0.0033, and the peak signal-to-noise ratio has increased by 2.0837, 5.2569 and 2.7375 dB. It is shown that the wavelet threshold denoising based on genetic algorithm not only suppresses the noise in spectral data, but also improves the system accuracy, which provides a new solution for water quality spectral denoising by ultraviolet-visible spectroscopy.

Key words: ultraviolet-visible spectroscopy, water quality detection, genetic algorithm, wavelet soft threshold denoising

中图分类号:

X832

肖渝, 黄丽雯, 汤斌∗, 肖棋森, 赵明富, 李奉笑. 遗传算法优化小波阈值对水质光谱数据的去噪研究[J]. 大气与环境光学学报, 2021, 16(5): 432-442.

XIAO Yu, HUANG Liwen, TANG Bin∗, XIAO Qisen, ZHAO Mingfu, LI Fengxiao. Denoising of Water Quality Spectral Data by Optimizing Wavelet Threshold Based on Genetic Algorithm[J]. Journal of Atmospheric and Environmental Optics, 2021, 16(5): 432-442.

参考文献

[1]买巍,赵晓明,张健飞,徐志伟,李政.紫外可见光谱结合多元分析法在线检测混合染料溶液化学需氧量[J].光谱学与光谱分析,2017,37(07):2105-2109.
[2]汤斌, 魏彪, 吴德操,等. 一种紫外-可见光谱法检测水质COD的浊度影响实验研究[J]. 光谱学与光谱分析, 2014, 34(11).
[3]汤斌, 魏彪, 毛本将,等. 紫外-可见吸收光谱法水质检测系统的噪声分析与处理研究[J]. 激光与光电子学进展, 2014, 51(004):197-203.
[4]范贤光,王秀芬,王昕,许英杰,阙靖,王小东,何浩,李韦,左勇.基于特征提取的低信噪比拉曼光谱去噪方法研究[J].光谱学与光谱分析,2016,36(12):4082-4087.
[5]杨丽薇,高晓清,蒋俊霞,吕清泉,李振朝.基于小波变换与神经网络的光伏电站短期功率预测[J].太阳能学报,2020,41(07):152-157.
[6]董鑫,李国龙,何坤,贾亚超,徐凯,李彪.谱图小波阈值降噪及其在滚刀主轴振动信号分析中的应用[J].机械工程学报,2020,56(11):96-107.
[7]周先春, 吴婷, 石兰芳,等. 一种基于曲率变分正则化的小波变换图像去噪方法[J]. 电子学报, 2018, 46(003):621-628.
[8]Navdeep Prashar,Meenakshi Sood,Shruti Jain. Dual-tree complex wavelet transform technique-based optimal threshold tuning system to deliver denoised ECG signal[J]. Transactions of the Institute of Measurement and Control,2020,42(4).
[9]沙宇洋,席丽霞,张晓光,唐先锋,张文博.基于小波阈值去噪的偏振模色散测量[J].中国激光,2018,45(11):226-231.
[10]余腾,胡伍生,吴杰,李海锋,乔燕.基于小波阈值去噪与EMD分解方法提取润扬大桥振动信息[J].振动与冲击,2019,38(12):264-270.
[11]Fábio M. Bayer,Alice J. Kozakevicius,Renato J. Cintra. An iterative wavelet threshold for signal denoising[J]. Signal Processing,2019,162.
[12]李新春, 吴秋铜. 基于改进遗传算法的小波阈值语音去噪[J]. 激光杂志, 2015, 000(001):62-65.
[13]毛亚纯,丁瑞波,刘善军,包妮沙.可见光-近红外光谱的低品位斑岩型铜矿反演模型[J].光谱学与光谱分析,2020,40(08):2474-2478.
[14]李子文,李宗朋,买书魁,盛晓慧,尹建军,刘国荣,王成涛,张海红,辛立斌,王健.最小二乘支持向量机的核桃露饮品中脂肪成分的定量分析[J].光谱学与光谱分析,2019,39(12):3916-3920.
[15]X.J. Luo,Lukumon O. Oyedele,Anuoluwapo O. Ajayi,Olugbenga O. Akinade,Hakeem A. Owolabi,Ashraf Ahmed. Feature extraction and genetic algorithm enhanced adaptive deep neural network for energy consumption prediction in buildings[J]. Renewable and Sustainable Energy Reviews,2020,131.
[16]Shabbou Sajadi,Abdolhossein Fathi. Genetic algorithm based local and global spectral features extraction for ear recognition[J]. Expert Systems With Applications,2020,159.
[17]Vibhor Kumar Bhardwaj,Surita Maini. Estimation of absolute distance and high-frequency vibration from the modulated SM-OFI signal using compound mutated genetic algorithm[J]. Optics and Lasers in Engineering,2020,134.