針對感測資料之即時查詢資料壓縮方法與其在GPU環境的實作

一個智慧電網系統—In-Snergy，它搜集使用者的電器用電資料並將其儲存在資料庫中。資料庫中搜集來的感測資料每天不斷增加。這些資料的儲存對伺服器造成不小的負荷。本論文提出一個對感測資料的壓縮方法。首先我們把感測資料分割成很多區段，然後我們壓縮這些區段並將壓縮後的區段存在資料庫中。那些儲存在資料庫中的壓縮檔可以用特定的SQL查詢。本論文提出三種方法來壓縮這些區段，分別為字典法、平移法以及漸增法。我們依據這些區段的資料特性，選擇適合的壓縮法來壓縮。在我們的實作中，壓縮後的資料表只有原本資料表29.44%的大小，而壓縮後資料表的索引所佔體積只有原本索引的3.87%. 由於本論文提出的壓縮方法太耗時，因此我們使用CUDA來加速它。在我們使用四張GPU的實作中，各個部份的執行速度為CPU版本的22到191倍。

關鍵字

資料壓縮；即時查詢；資料庫

並列摘要

In-Snergy, a type of smart grid system, collects the electricity usage of the users’ appliances. The collected sensor data stored in the database increases day by day. These data becomes a huge load of the server storage. We propose a compression method for the sensor data. First, we divide the massive sensor data into many segments. Then we compress these segments and store the compressed segments in the database. The compressed data in the database can be queried by specific SQL. To compress the segments of the sensor data, we propose three kinds of compression methods—the dictionary method, the shift method and the incremental method. Based on the property of the segments, we choose the appropriate method to compress the segments. In our implementation, the size of compressed table is 29.44% of the size of the original table. The size of the database index of the compressed table is 3.87% of the index size of the original table. Because the process of compression is time-consuming, we use CUDA to accelerate the compression process. The speedup of each part of the process is 22 to 191 times in a 4-GPU environment.

並列關鍵字

data compression ； GPU ； database

參考文獻

[8] Advanced Compression White Paper. Retrieved from Oracle:

[11] R. F. Rice and R. Plaunt, , “Adaptive Variable-Length Coding for Efficient Compression of Spacecraft Television Data,” IEEE Transactions on Communications, vol. 16(9), pp. 889–897, Dec. 1971.

[13] Cloud computing:

[14] Cloud database:

[15] Google App Engine Datastore:

國際替代計量

針對感測資料之即時查詢資料壓縮方法與其在GPU環境的實作

全文下載

主題瀏覽