Micro-expression Recognition Based on Differential Energy Maps and CGBP

YU Ming; WANG Yingzi; YU Yang; LIU Yi

doi:10.3969/j.issn.0258-2724.2016.06.024

Volume 29 Issue 6

Nov. 2016

Turn off MathJax

Article Contents

Abstract

References

Journal of Southwest Jiaotong University > 2016 > 29(6): 1222-1229.

YANG Bing, CAI Ruiqing, TANG Chi, MA Jianlin, HUHE Aode. Experimental Research on Onset of Muddy Clay Exposed to Unidirectional Flow[J]. Journal of Southwest Jiaotong University, 2012, 25(4): 586-590. doi: 10.3969/j.issn.0258-2724.2012.04.008

Citation:

YU Ming, WANG Yingzi, YU Yang, LIU Yi. Micro-expression Recognition Based on Differential Energy Maps and CGBP[J]. Journal of Southwest Jiaotong University, 2016, 29(6): 1222-1229. doi: 10.3969/j.issn.0258-2724.2016.06.024

Citation:

PDF( 0 KB)

Micro-expression Recognition Based on Differential Energy Maps and CGBP

doi: 10.3969/j.issn.0258-2724.2016.06.024

Received Date: 20 May 2015
Publish Date: 25 Dec 2016

Abstract

Abstract

Micro-expression is a kind of facial expression which is autonomous and cannot be disguised. It has a close relation with credibility. Moreover,it has only a short duration and hard to be recognized. A micro-expression recognition algorithm based on the differential energy maps and centralized Gabor binary patterns (CGBP) was presented. Firstly, this algorithm uses the difference among micro-expression sequence images to calculate the energy maps and obtain the phase changes of facial muscle. Secondly, CGBP operators that combines Gabor and centralized binary patterns was proposed to extract micro-expression features. Finally, ELM classifier was used to classify micro-expressions. Experimental results on CASME micro-expression database show that compared with the state-of-the-art LBP-TOP, DTSA3, Gabor, VLBP, and CBP-TOP algorithms, this proposed method can obtain better spatial and temporal texture features and achieve higher recognition rate, which reaches 86.54% averagely.
- image processing,
- micro-expressions recognition,
- difference energy image,
- centralized Gabor binary patterns,
- extreme learning machine (ELM) classifier

FullText(HTML)

References(20)

References

贲晛烨,杨明强,张鹏,等. 微表情自动识别综述[J]. 计算机辅助设计与图形学学报,2014,26(9):1385-1395. BEN Xianye, YANG Mingqiang, ZHANG Peng, et al. Survey on automatic micro expression recognition methods[J]. Journal of Computer-Aided Design Computer Graphics, 2014, 26(9):1385-1395.

YAN W J, WANG S J, LIU Y J, et al. For micro-expression recognition:database and suggestions[J]. Neurocomputing, 2014, 136:82-87.

EKMAN P. Telling lies:clues to deceit in the marketplace, politics, and marriage[M]. Revised Edition. New York:WW Norton Company, 2009:123-161.

EKMAN P. Lie catching and microexpressions:the philosophy of deception[M]. Oxford:Oxford University Press, 2009:118-133.

POLIKOVSKY S, KAMEDA Y, OHTA Y. Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor[C]//3rd International Conference on Imaging for Crime Detection and Prevention(ICDP 2009). London:IEEE Computer Society Press, 2009:1-6.

SHREVE M, GODAVARTHY S, GOLDGOF D, et al. Macro-and micro-expression spotting in long videos using spatio-temporal strain[C]//2011 IEEE International Conference on Automatic Face Gesture Recognition and Workshops (FG 2011). Santa Barbara:IEEE Computer Society Press, 2011:51-56.

FRANK M G, HERBASZ M, SINUK K, et al. I see how you feel:training laypeople and professionals to recognize fleeting emotions[C]//The Annual Meeting of the International Communication Association. New York:, 2009:1-35.

于明,胡全胜,阎刚,等. 基于LGBP特征和稀疏表示的人脸表情识别[J]. 计算机工程与设计,2013,34(5):1787-1791. YU Ming, HU Quansheng, YAN Gang, et al. Facial expression recognition based on LGBP features and sparse representation[J]. Computer Engineering and Design, 2013, 34(5):1787-1791.

EKMAN P, FRIESEN W V. Nonverbal leakage and clues to deception[J]. Psychiatry, 1969, 32(1):88-106.

PORTER S, BRINKE L. The truth about lies:what works in detecting high-stakes deception?[J]. Legal and Criminological Psychology, 2010, 15(1):57-75.

SHREVE M, GODAVARTHY S, MANOHAR V, et al. Towards macro-and micro-expression spotting in video using strain patterns[C]//2009 Workshop on Applications of Computer Vision (WACV). Snowbird:IEEE Computer Society Press, 2009:1-6.

PFISTER T, LI X, ZHAO G, et al. Recognising spontaneous facial micro-expressions[C]//Proceedings of IEEE International Conference on Computer Vision (ICCV). Barcelona:IEEE Computer Society Press, 2011:1449-1456.

WU Q, SHEN X, FU X. The machine knows what you are hiding:an automatic micro-expression recognition system[C]//Affective Computing and Intelligent Interaction. Berlin:Springer Berlin Heidelberg, 2011:152-162.

YAN W J, WU Q, LIU Y J, et al. CASME database:a dataset of spontaneous micro-expressions collected from neutralized faces[C]//Proceedings of the 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition(FG). Shanghai:IEEE Computer Society Press, 2013:1-7.

BASHIR K, XIANG T, GONG S. Feature selection on gait energy image for human identification[C]//Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing.:IEEE, 2008:985-988.

吴奇,申寻兵,傅小兰. 微表情研究及其应用[J]. 心理科学进展,2010,18(9):1359-1368. WU Qi, SHEN Xunbing, FU Xiaolan. The research and application of micro-exprsion[J]. Advances in Psychological Science, 2010, 18(9):1359-1368.

FU X, WEI W. Centralized binary patterns embedded with image euclidean distance for facial expression recognition[C]//Proceedings of the Fourth International Conference on Natural Computation(ICNC'08). Jinan:IEEE Computer Society Press, 2008, 4:115-119.

YAN K, CHEN Y, ZHANG D. Gabor surface feature for face recognition[C]//Proceedings of First Asian Conference on Pattern Recognition (ACPR). Beijing:IEEE Computer Society Press, 2011:288-292.

RAVI J, TEVARAMANI S S, RAJA K B. Face recognition using DT-CWT and LBP features[C]//Proceedings of International Conference on Computing, Communication and Applications (ICCCA). Dindigul, Tamilnadu:IEEE Computer Society Press, 2012:1-6.

HUANG G B, ZHOU H, DING X, et al. Extreme learning machine for regression and multiclass classification[J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B:Cybernetics, 2012, 42(2):513-529.

Relative Articles

[1]	WANG Yaodong, ZHU Liqiang, YU Zujun, SHI Hongmei, SHE Changmei. Intelligent Tunnel Crack Recognition Based on Automatic Sample Labeling[J]. Journal of Southwest Jiaotong University, 2023, 58(5): 1001-1008, 1036. doi: 10.3969/j.issn.0258-2724.20210092
[2]	CHEN Xiaobo, LIANG Shurong, KE Jia, CHEN Ling, HU Yu. Traffic Data Imputation Based on Graph Regularization and Schatten-p Norm Minimization[J]. Journal of Southwest Jiaotong University, 2022, 57(6): 1326-1333. doi: 10.3969/j.issn.0258-2724.20210295
[3]	ZHU Jun, CHEN Yidong, ZHANG Yunhao, HUANG Huaping, WU Sihao, ZHAO Li. Visualization Method for Fast Fusion of Panorama and Point Cloud Data in Network Environment[J]. Journal of Southwest Jiaotong University, 2022, 57(1): 18-27. doi: 10.3969/j.issn.0258-2724.20200360
[4]	LENG Biao, ZHANG Yi, YANG Hui, HOU Gaopeng. Rapid Recognition of Rock Mass Fractures in Tunnel Faces[J]. Journal of Southwest Jiaotong University, 2021, 56(2): 246-252, 322. doi: 10.3969/j.issn.0258-2724.20190749
[5]	LUO Wenting, LI Zhongyi, LI Lin, GAN Hong, GUO Jiangang. Automated Lane Marking Identification Based on Improved Canny Edge Detection Algorithm[J]. Journal of Southwest Jiaotong University, 2018, 53(6): 1253-1260. doi: 10.3969/j.issn.0258-2724.2018.06.022
[6]	LIU Jin, JIN Weidong. Fast Method for 2D Threshold Segmentation Algorithm Based on Inter-class and Intra-class Variances[J]. Journal of Southwest Jiaotong University, 2014, 27(5): 913-919. doi: 10.3969/j.issn.0258-2724.2014.05.026
[7]	PENG Bo, WANG Kelvin C.P., CHEN Cheng, JIANG Yangsheng. 3D Pavement Crack Image Detection Based on Anisotropy Measure[J]. Journal of Southwest Jiaotong University, 2014, 27(5): 888-895. doi: 10.3969/j.issn.0258-2724.2014.05.023
[8]	HAO Zhen-Hai, YANG Xin-Yong, HUANG Ku-Guo. Recognition Technology of Dynamic Magnetic Interference Based on Differential Magnetic Compasses[J]. Journal of Southwest Jiaotong University, 2010, 23(3): 445-450. doi: 10. 3969/ j. issn. 0258-2724.
[9]	ZHANG Haibo, WANG Xiaofei, HUANG Youpeng, LUO Wei. Secret Image Sharing Based on Self-adaptive Multi-pixel Encoding[J]. Journal of Southwest Jiaotong University, 2009, 22(3): 448-454.
[10]	TAO Ran, LÜ, Hongxia, CHEN Guangxiu. Model and Algorithm for Making Locomotive Working Diagram Based on Multiple Traveling Salesmen Problem[J]. Journal of Southwest Jiaotong University, 2006, 19(5): 653-657.
[11]	WANG Xiaohong, WANG Xiaoru, LI Qunzhan. Algorithm for Visualization of Classification Results of Two-Category Data[J]. Journal of Southwest Jiaotong University, 2006, 19(3): 329-334.
[12]	YANG Ning-xue, GONG Hui. Extension of Search Strategies on Ideal AND/OR Graphs[J]. Journal of Southwest Jiaotong University, 2005, 18(1): 49-52.
[13]	GAO Pin-xian, WU Chuan-hui, GAO Xiang-ling. Analysis and Application of Dynamic Spectrum of Friction-Induced Noise[J]. Journal of Southwest Jiaotong University, 2004, 17(6): 788-791.
[14]	LI Li, ZHAI Dong-hai, JIN Fan. Graph-Based Algorithm for Mining Frequent Closed Itemsets[J]. Journal of Southwest Jiaotong University, 2004, 17(3): 385-389.
[15]	NIShao-quan, L Hong-xia, YANGMing-lun. Research on Design of Train Diagram-Making System of Railways in China[J]. Journal of Southwest Jiaotong University, 2003, 16(3): 332-335.

Supplements(0)

Cited By

Cited by

Periodical cited type(4)

1.	王一鸣，尹海伟，孔繁花，苏杰. 顾及屋顶绿化的城市三维生态网络构建——以南京市中心城区为例. 生态学报. 2023(22): 9121-9132 .
2.	江维薇，李文涛，肖衡林. 澜沧江流域糯扎渡水库消落带植被的物种组成、空间分布特征及地形解释. 湖泊科学. 2022(06): 2025-2039 .
3.	韩博. 基于遥感影像的北方乡村景观空间格局特征研究. 科技通报. 2018(11): 168-171 .
4.	秦学军. 大数据分析下园林景观空间格局梯度优化仿真. 计算机仿真. 2018(12): 195-198 .

Other cited types(2)

Proportional views

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Get Citation

PDF

XML

Article views(525) PDF downloads(191)

Micro-expression Recognition Based on Differential Energy Maps and CGBP

doi: 10.3969/j.issn.0258-2724.2016.06.024