A hyperspectral unmixing approach for ink mismatch detection in unbalanced clusters  

作　　者：Faryal Aurooj Nasir Salman Liaquat Khurram Khurshid Nor Muzlifah Mahyuddin 

机构地区：[1]Department of Electrical Engineering,Institute of Space Technology,Islamabad 44000,Pakistan [2]School of Electrical and Electronic Engineering,Universiti Sains Malaysia,Penang 14300,Malaysia

出　　处：《Journal of Information and Intelligence》2024年第2期177-190,共14页信息与智能学报（英文）

摘　　要：Detecting ink mismatch is a significant challenge in verifying the authenticity of documents,especially when dealing with uneven ink distribution.Conventional imaging methods frequently fail to distinguish visually similar inks.Our study presents a novel hyperspectral unmixing approach to detect ink mismatches in unbalanced clusters.The proposed method identifies unique spectral characteristics of different inks employing k-means clustering and Gaussian mixture models(GMMs)to perform color segmentation on different ink types and utilizes elbow estimation and silhouette coefficient to evaluate the number of inks estimation precisely.For a more accurate estimation of quantity,which is generally not an attribute of clustering methods,we employed entropy calculations in the red,green,and blue depth channels for precise abundance estimation of ink.This unique combination of basic techniques in conjunction exhibits better efficacy in performing ink unmixing and provides a real-world document forensic solution compared to current methods that rely on assumptions like prior knowledge of the inks used in a document and deep learning-based methods that rely heavily on abundant training datasets.We evaluate our approach on the ivision handwritten hyperspectral images dataset(iVision HHID),which is a comprehensive and rich dataset that surpasses the commonly-used UWA writing inks hyperspectral images(WIHSI)database in size and diversity.This study has accomplished the unmixing task with three main challenges:unmixing of diverse ink spectral signatures(149 spectral bands instead of 33 bands in the previous dataset),without using prior knowledge and assumptions about the number of inks used in the questioned document,and not requiring large training data for performing unmixing.Furthermore,the security of the proposed document authentication methodology to address the likelihood of forgeries or manipulations in questioned documents is enhanced as compared to previous works relying on known inks and known spectrum.Randomization

关 键 词：k-means clustering Gaussian mixture model(GMM) Hyper spectral imaging(HSI) iVision handwritten hyperspectral images dataset(HHID) Document forensics 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]