WANG Cai-ling, HU Bing-liang, WANG Hong-wei, LIU Xue-bin, CHEN Xiao-lai, LI Pu. Platform design for massive hyperspectral data processing based on internet cluster[J]. Journal of Applied Optics, 2013, 34(4): 604-608.
Citation: WANG Cai-ling, HU Bing-liang, WANG Hong-wei, LIU Xue-bin, CHEN Xiao-lai, LI Pu. Platform design for massive hyperspectral data processing based on internet cluster[J]. Journal of Applied Optics, 2013, 34(4): 604-608.

Platform design for massive hyperspectral data processing based on internet cluster

More Information
  • In some large-scale image processing systems, multiple servers can achieve parallel processing image data stream to complete the complex data operations by building server cluster network. An Ethernet-based server cluster for huge hyperspectral image processing system was designed based on image characteristics. In order to achieve parallel processing, the task decomposition, algorithm pipelined processing and network load balancing were used in software design. The system is used in a hyperspectral image data processing system and the date rate can achieve 6 000 Mbps.
  • [1]母杰, 饶长辉,李梅,等.基于FPGA和DSP的自适应光学系统在线性能评估的嵌入式处理平台设计[J].光电工程,2012,39(6):34-40.
    MU Jie, RAO Chang-hui ,LI Mei, et al. The embedded processing platform design based on FPGA and DSP of an adaptive optics system on-line performance evaluation[J]. OptoElectronic Engineering,2012,39(6):34-40.(in Chinese with an English abstract).
    [2]李长森,马骉,李婷.基于FPGA的图像信息处理平台设计[J].航天控制,2011(12):68-71.
    LI Chang-sen, MA Biao, LI Ting. An image processing platform design based on FPGA[J].Aerospace Control,2011(12):68-71. (in Chinese with an English abstract).
    [3]倪颖杰,王律科,张军.基于高性能数据挖掘的网络海量信息处理平台[J].计算机工程与科学,2009,31(z1):129-132.
    NI Ying-jie, WANG Lü-ke, ZHANG Jun. The network massive information processing platform based on high performance data mining[J].2009.31(z1):129-132.
    [4]莫泽尧,袁国兴.消息传递并行编译环境MPI[M].北京:科学出版社,2001.
    MO Ze-yao,YUAN Guo-xing.Message passing parallel compiler environment MPI[M]. Beijing:Science Press,2001.(in Chinese).
    [5]都志辉.高性能并行计算编程技术MPI并行程序设计[M].北京:清华大学出版社,2001.
    DU Zhi-hui.Parallel computing programming technology of MPI parallel program design of high performance[M].Beijing:Tsinghua Univerisity Press,2001. (in Chinese).
    [6]张林波,迟学斌,莫则尧,等.并行计算导论[M]. 北京:清华大学出版社,2006.
    ZHANG Lin-bo,CHI Xue-bin,MO Ze-yao,et al. Introduction to parallel computing[M]. Beijing:Tsinghua Univerisity Press,2006. (in Chinese).
  • Related Articles

    [1]LIU Tong, SUI Xiubao, CHEN Qian, CHEN Xingliao. Scale-separated non-uniformity correction algorithm based on spatio-temporal rolling guidance filter[J]. Journal of Applied Optics, 2025, 46(2): 309-318. DOI: 10.5768/JAO202546.0202003
    [2]LI Bing, HU Haocheng, MIN Rui, CAO Liangcai. Correction method of imaging luminance measurement device[J]. Journal of Applied Optics, 2022, 43(1): 9-16. DOI: 10.5768/JAO202243.0101002
    [3]SU Yuyang, WANG Zhile, LU Min, ZOU Wei. Nonuniformity analysis and correction of DMD imaging in infrared target simulation system[J]. Journal of Applied Optics, 2020, 41(5): 1074-1081. DOI: 10.5768/JAO202041.0506002
    [4]Zhang Baoyi, Mu Wei, Wang Hu, Yao Linhai, Liu Tong. Design and realization of on-line testing device of portable photoelectric tracking system[J]. Journal of Applied Optics, 2018, 39(2): 187-191. DOI: 10.5768/JAO201839.0201005
    [5]Meng Siqi, Ren Kan, Lu Dongming, Gu Guohua, Chen Qian. A non-uniformity correction algorithm of infrared image sequences based on constant-statistics[J]. Journal of Applied Optics, 2017, 38(2): 304-308. DOI: 10.5768/JAO201738.0206002
    [6]Zhu Hui, Zhang Yong, Chen Zhi-xue, Dong Qi-lin, Liu Wan-gang, Luo Bei-bei. Infrared real-time calibration technology based on temperature control blackbody[J]. Journal of Applied Optics, 2014, 35(5): 884-890.
    [7]KONG Peng, HOU Min, LUO Bei-bei, YANG Dong, YI Xing-guo, LIU Wan-gang, ZHANG Wei. Real-time non-uniformity correction algorithm for infraredsearch and track system[J]. Journal of Applied Optics, 2014, 35(2): 327-331.
    [8]ZHU Zhen-min, ZHONG Lu-sheng, TU Hai-yan, JIN Xiao-long. Comparison experiment of color correction for color vision device[J]. Journal of Applied Optics, 2013, 34(6): 968-973.
    [9]JIN Wei-qi, CAO Yang, LIU Chong-liang, LIU Xiu, DONG Li-quan, ZHANG Chang-quan. Uncooled infrared focal plane array detector module with the self-adaptive non-uniformity correction function[J]. Journal of Applied Optics, 2009, 30(2): 348-352.
    [10]ZHANG Yong, BAI Gui-ming, ZHU Hui. Non-uniformity correction for scanning thermal imager[J]. Journal of Applied Optics, 2008, 29(2): 170-173.

Catalog

    Article views (2236) PDF downloads (356) Cited by()

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return