時間序列數據壓縮

Abstract

近年來，廣泛的智能電錶已經廣泛應用於各個領域的時間序列工程參數化;導致處理大數據的問題。大量的數據需要被傳輸，存儲，處理和檢索。存儲和訪問這些大數據在時間，空間和帶寬上變得昂貴。研究的目的是找出解決問題的辦法。研究中開發的一個解決方案是壓縮/解壓縮工程參數。變量的數據格式有三（03）部分：128位全局唯一標識符（GUID），64位時間戳參數和64位浮點值參數。已經應用和實現了三種編碼/解碼算法。這些方法已經將原始歷史數據大小減少了40％，以及存儲成本。算法的性能：壓縮比，節省百分比和壓縮/減壓時間和速度已被測量。解壓縮過程已被證明比基於歷史數據的壓縮過程更快。

In recent years, numerous smart meters have been widely installed to aggregate time series engineering parameters over fields; it has led to problems of handling big data. The huge volumes of data need to be transmitted, stored, processed as well as retrieved. Storing and accessing these big data have become expensive in time, space and bandwidth. The aim of the study is to find a solution for the problems. One solution developed in the study is to compress/decompress the engineering parameters. The data format of the variables has three (03) portions: 128-bit Global Unique Identifier (GUID), 64-bit time stamp parameter, and 64-bit floating point value parameter. Three encoding/decoding algorithms have been applied and implemented. The approaches have reduced the original historical data size 40% off as well as the storage cost. The algorithms’ performances: the compression ratio, the saving percentage and the compression/decompression time and speed have been measured. The decompression process has been proved faster than the compression process based on the historical data.