Full metadata record
DC FieldValueLanguage
dc.contributor.authorKu, Chan-Ien_US
dc.contributor.authorLuo, Guo-Hengen_US
dc.contributor.authorChang, Che-Pinen_US
dc.contributor.authorYuan, Shyan-Mingen_US
dc.date.accessioned2015-07-21T08:31:00Z-
dc.date.available2015-07-21T08:31:00Z-
dc.date.issued2013-01-01en_US
dc.identifier.issn1949-0828en_US
dc.identifier.urihttp://dx.doi.org/10.1109/CSE.2013.52en_US
dc.identifier.urihttp://hdl.handle.net/11536/125062-
dc.description.abstractThe Hadoop Distributed File System (HDFS) is used to solve the storage problem of huge data, but does not provide a handling mechanism of duplicate files. In this study, the middle layer file system in the HBASE virtual architecture is used to do File Deduplicate in HDFS, with two architectures proposed according to different requires of the applied requirement reliability, therein one is RFD-HDFS (Reliable File Deduplicated HDFS) which is not permitted to have any errors and the other is FD-HDFS (File Deduplicated HDFS) which can tolerate very few errors. In addition to the advantage of the space complexity, the marginal benefits from it are explored. Assuming a popular video is uploaded to HDFS by one million users, through the Hadoop replication, they are divided into three million files to store, that is a practice wasting disk space very much and only by the cloud to remove repeats for effectively loading. By that, only three file spaces are taken up, namely the 100% utility of removing duplicate files reaches. The experimental architecture is a cloud based documentation system, like the version of EndNote Cloud, to simulate the cluster effect of massive database when the researcher synchronized the data with cloud storage.en_US
dc.language.isoen_USen_US
dc.subjectHDFSen_US
dc.subjectData Deduplicationen_US
dc.subjectCloud Computingen_US
dc.subjectSingle instance storageen_US
dc.titleFile Deduplication with Cloud Storage File Systemen_US
dc.typeProceedings Paperen_US
dc.identifier.doi10.1109/CSE.2013.52en_US
dc.identifier.journal2013 IEEE 16TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE 2013)en_US
dc.citation.spage280en_US
dc.citation.epage287en_US
dc.contributor.department資訊工程學系zh_TW
dc.contributor.departmentDepartment of Computer Scienceen_US
dc.identifier.wosnumberWOS:000351950300042en_US
dc.citation.woscount0en_US
Appears in Collections:Conferences Paper