Overview of Error Concealment for Video Transmission
-
摘要: 讨论了视频差错掩盖研究的发展过程和现状.介绍了常见的空域和时域差错掩盖算法,特别是基于边缘检测的空域自适应差错掩盖算法、基于运动向量外插的时域差错掩盖算法、多步多权值块变形差错掩盖算法以及基于失真度估计的SVC质量分级自适应差错掩盖算法.分析了这些算法在不同有损传输环境下的差错掩盖性能和适用环境.预测了差错掩盖技术可能的发展趋势.Abstract: The history and present situation of researches on video error concealment were discussed.Several representative spatial and temporal error concealment algorithms were presented with an emphasis on edge detection based adaptive spatial error concealment,motion vectors extrapolation based error concealment,multi-step multi-weighted block-warping error concealment,and distortion based adaptive SVC FGS error concealment.Their applicability and performances in different error-prone transmission environments were analyzed.The development trend of the video error concealment technologies was predicted.
-
Key words:
- video coding /
- video transmission /
- error control /
- error concealment
-
MEISINGER K,KAUP A.Spatial error concealment of corrupted image data using frequency selective extrapolation[C]∥Proceedings of IEEE International Conference on Acoustics,Speech,and Signal Processing(ICASSP).Erlangen:IEEE Press,2004:209-212.[2] WANG Yao,ZHU Qinfan,SHAW L.Maximally smooth image recovery in transform coding[J].IEEE Trans.on Communications,1993,41(10):1554-1551.[3] ZHOU W,WANG Yao,ZHU Qinfan.Second-order derivative-based smoothness measure for error concealment in DCT-based codecs[J].IEEE Transactions on Circuits and Systems for Video Technology,1998,8(6):713-718.[4] KIM Y,CHOE Y.Candidate motion vectors for error concealment of video signals[J].IEICE Trans.Info. Syst.2001,E84-D(3):427-431.[5] 吕静,王海婴,常侃.基于纹理方向预测的空域差错隐藏方案[J].北京邮电大学学报,2006,29(5):31-34.L Jing,WANG Haiying,CHANG Kai.A spatial error concealment scheme based on prediction of texture direction[J].The Journal of China Universities of Posts and Telecommunications.2006,29(5):31-34.[6] PENG Qiang,YANG Tianwu,ZHU Cangqian.Block-based temporal error concealment for video packet using motion vector extrapolation[C]∥Proceedings of ICCCAS'02.Chengdu:IEEE Press,2002,I:10-14.[7] 马鑫,杨小康,宋利.自适应时域差错掩盖方法[J].中国图象图形学报,2007,12(10):1782-1785.MA Xin,YANG Xiaokang,SONG Li.An adaptive temporal error concealment technique[J].Journal of Image and Graphics,2007,12(10):1782-1785.[8] ATZORI L.NATALE D,PERRA C.A spatio-temporal concealment technique using boundary matching algorithm and mesh-based warpng (BMA-MBW)[J].IEEE Trans.on Multimedia,2001,3(3):326-338.[9] ZHENG J,CHAU L.Efficient motion vector recovery algorithm for H.264 based on a polynomial model[J].IEEE Trans.on Multimedia,2005,7(3):507-513.[10] PONGPADPINIT W,PEARMAIN A.Recovery of motion vectors for error concealment based on an edge-detection approach[J].IEE Proc.-Vis.Image Signal Process,2006,153(1):63-69.[11] CHEN M,CHENC,CHI M.Temporal error concealment algorithm by recursive block-matching principle[J].IEEE Trans.on Circuits and Systems for Video Technol,2005,15(11):1385-1393.[12] 徐燕凌,周源华.H.264视频码流时域误码掩盖算法的改进[J].上海交通大学学报,2005,39(9):1530-1533.XU Yanling,ZHOU Yuanhua.Improvements of temporal error concealment schemes for H.264 video streams[J].Journal of Shanghai Jiaotong University,2005,39(9):1530-1533.[13] 段大高,李文正,莫倩.一种基于H.264 Intra帧的错误隐藏算法[J].通信技术,2008,41(4):168-170.DUAN Dagao,LI Wenzheng,MO Qian.An novel error concealment algorithm for H.264 intra frame[J].Communications Technology.2008,41(4):168-170.[14] WANG Zhou,YU Yinglin,ZHANG D.Best neighborhood matching:an information loss restoration technique for block-based image coding systems[J].IEEE Transactions on Image Processing,1998,7(7):1056-1061.[15] SALAMA P,SHROFF N B,DELP E J.Error concealment in MPEG video streams over ATM networks[J].IEEE Journal on Selected Areas in Communications,2000,18(6):1129-1144.[16] SALAMA P,SHROFF N B,DELP E J.Error concealment in encoded video streams[C]∥Signal Recovery Techniques for Image and Video Compression and Transmission.University Park:Springer,1998:200-233.[17] KWOK W,SUN H.Multidirectional interpolation for spatial error concealment[J].IEEE Trans.on Consumer Electronics,1993,39(3):455 460.[18] AGRAFIOTIS D,BULL D R,CANAGARAJAH C N.Enhanced error concealment with mode selection[J].IEEE Trans.on Circuits and Systems for Video Technology,2006,16(8):960-973.[19] RONGFU Z,YUANHUA Z,XIAODONG H.Content-adaptive spatial error concealment for video communication[J].IEEE Trans.on Consumer Electronics,2004,50(1):335-341.[20] HASKELL P,MESSERSCHMITT D.Resynchronization of motion compensated video affected by ATM cell loss[C]∥Proceedings of IEEE International Conference on Acoustics,Speech,and Signal Processing(ICASSP).San Francisco:IEEE Press,1992,3:545-548.[21] SUH J W,HO Y S.Error concealment based on directional interpolation[J].IEEE Trans.on Consumer Electronics.1997,43(3):295-302.[22] LAM W M,REIBMAN A R,LIU B.Recovery of lost or erroneously received motion vectors[C]∥Proceedings of IEEE International Conference on Acoustics,Speech,and Signal Processing(ICASSP).Minneapolis:IEEE Press,1993,5:417-420.[23] KIM Y G,CHOE Y.An iterative temporal error concealment algorithm for degraded video signals[J].IEICE Trans.Communications,2001,E84-B(4):941-951.[24] 彭强,诸昌钤.基于边框匹配的视频差错掩盖技术[J].西南交通大学学报,2004,39(1):99-103.PENG Qiang,ZHU Changqian.Video error concealment technique based on side matching[J].Journal of Southwest Jiaotong University.2004,39(1):99-103.[25] 杨天武,彭强,诸昌钤.视频差错掩盖的两步多权值边框匹配算法[J].中国图像图形学报,2004,9(5):636-640.YANG Tianwu,PENG Qiang,ZHU Changqian.A two-step multi-weighted boundary-matching algorithm for video error concealment[J].Journal of Image and Graphics.2004,9(5):636-640.[26] BACCICHET P,BAGNI D,CHIMIENTI A.Frame concealment for H.264/AVC decoders[J].IEEE Trans.on Consumer Electronics,2005,51(1):227-233.[27] 陈建乐,刘济林,陈国斌.一种针对整帧图像丢失的错误隐藏算法[J].中国图象图形学报,2007,12(1):38-42.CHEN Jianle,LIU Jilin,CHEN Guobin.An error concealment algorithm for whole frame Loss[J].Journal of Image and Graphics,2007,12(1):38-42.[28] PENG Qiang,YANG Tianwu,ZHU.Block-based temporal error concealment for video packet using motion vector extrapolation[C] //Proceedings of ICCCAS'02.Chengdu:IEEE Press,2002,2:10-14.[29] 杨天武,彭强,诸昌钤.基于块运动变形的时域差错掩盖[J].小型微型计算机系统,2007,28(1):155-158.YANG Tianwu,PENG Qiang,ZHU Changqian.Temporal error concealment based on block-warping[J].Journal of Chinses Computer Systems,2007,28(1):155-158.[30] 徐燕凌,周源华.H.264视频码流时域误码掩盖算法的改进[J].上海交通大学学报,2005,39(9):1530-1533.XU Yanling,ZHOU Yuanhua.Improvements of temporal error concealment schemes for H.264 video streams[J].Journal of Shanghai Jiaotong University.2005,39(9):1530-1533.[31] 高绍帅,涂国防.基于H.263视频解码的错误检测和掩盖[J].通信学报,2001,22(12):82-87.GAO Shaoshuai,TU Guofang.H.263 video decode based error check and concealment[J].Journal of Communications,2001,22(12):82-87.[32] 冯摈,朱光喜,刘文予.基于H.264/AVC的时空域差错隐藏方案[J].通信学报,2007,28(4):72-79.FENG Bin,ZHU Guangxi,LIU Wenyu.Spatio-temporal error concealment scheme based on H.264/AVC[J].Journal of Communications.2007,28(4):72-79.[33] GALLENT M,KOSSENTINI F.Rate-distortion optimized layered coding with unequal error protection for robust internet video[J].IEEE Trans.Circuits Systems Video Technol,2001,11(3):357-372.[34] ZHANG R,REGUNATHAN S L,ROSE K.Switched error concealment and robust coding decisions in scalable video coding[C]∥Proc.of Int.Conf.on Image Processing.Vancouver:IEEE Press,2000:380-383.[35] DENG Yun,PENG Qiang,ZHU Changqian,A distortion estimation-based adaptive error concealment algorithm for snr enhancement layer[C]∥The IET Communications Conference on Wireless,Mobile and Sensor Networks 2007.Shanghai:[s.n.],2007:367-370.[36] Pei Soochang,Chou Yuzuong.Novel error concealment method with adaptive prediction to the abrupt and gradual scene changes[J].IEEE Trans.on Multimedia,2004,6(1):158-173.[37] 阎金,全子一.可分级视频编码中整帧丢失差错隐藏算法的研究[J].计算机应用研究,2007,26(6):187-189.YAN Jin,QUAN Ziyi.Research on frame loss error concealment for SVC[J].Application Research of Computers,2007,26(6):187-189.[38] 庞林娟,郁梅,蒋刚毅.基于H.264的立体视频右图像整帧丢失错误隐藏算法[J].中国图象图形学报,2006,11(11):1584-1587.PANG Linjuan,YU Mei,JIANG Gangyi.An error concealment algorithm based on H.264 for entire right frame loss in stereoscopic video sequence[J].Journal of Image and Graphics,2006,11(11):1584-1587.
点击查看大图
计量
- 文章访问数: 1577
- HTML全文浏览量: 71
- PDF下载量: 81
- 被引次数: 0