Sensor data compression based on MapReduce

(整期优先)网络出版时间:2014-01-11
/ 1
Acompressionalgorithmisproposedinthispaperforreducingthesizeofsensordata.Byusingadictionary-basedlosslesscompressionalgorithm,sensordatacanbecompressedefficientlyandinterpretedwithoutdecompressing.Thecorrelationbetweenredundancyofsensordataandcompressionratioisexplored.Further,aparallelcompressionalgorithmbasedonMapReduce[1]isproposed.Meanwhile,datapartitionerwhichplaysanimportantroleinperformanceofMapReduceapplicationisdiscussedalongwithperformanceevaluationcriteriaproposedinthispaper.Experimentsdemonstratethatrandomsamplerissuitableforhighlyredundantsensordataandtheproposedcompressionalgorithmscancompressthosehighlyredundantsensordataefficiently.