Improving database performance and space efficiency in deduplicated and snapshotable memory systems
Abstract/Contents
- Abstract
- In-memory databases have become increasingly important and prevalent because of the reduced cost of DRAM and the increasing demand for performance. Different from disk-oriented databases, in-memory databases treat main memory as the major storage for most or all of its data. This new storage organization faces several challenges, including DRAM scaling slowdown, concurrency control bottleneck, and index performance dilemma. To address these challenges, this thesis resorts to the recently proposed memory architecture called HICAMP. The HICAMP memory provides fine-grain data duplication, lightweight memory snapshots, and DAG structures in hardware. These features enable new ways to design and implement in-memory databases. This thesis introduces HicampDB, an in-memory database built from scratch to leverage HICAMP's architecture features. HicampDB organizes its storage and index on the HICAMP DAGs to benefit from the efficient tree traversal and data deduplication. HicampDB's bitmap index supports online updates while preserving high compaction ratio. Thanks to the hardware memory snapshots, HicampDB transactions run in full isolation and require no locking or database partitioning. The hybrid conflict detection used in HicampDB avoids the scalability bottleneck of OCC systems. In the experiments, HicampDB demonstrates 10x higher space efficiency, 16x better access speed, and 70% lower memory bandwidth consumption for database index. On the TPC-C benchmark, HicampDB shows near-linear scaling to 32 cores and 4.8x higher throughput when comparing with a state-of-the-art in-memory database.
Description
| Type of resource | text |
|---|---|
| Form | electronic; electronic resource; remote |
| Extent | 1 online resource. |
| Publication date | 2016 |
| Issuance | monographic |
| Language | English |
Creators/Contributors
| Author | Wang, Bo, (Computer systems engineer) |
|---|---|
| Primary advisor | Cheriton, David R |
| Thesis advisor | Cheriton, David R |
| Thesis advisor | Garcia-Molina, Hector |
| Thesis advisor | Horowitz, Mark |
| Advisor | Garcia-Molina, Hector |
| Advisor | Horowitz, Mark |
| Associated with | Stanford University, Department of Electrical Engineering. |
Subjects
| Genre | Theses |
|---|
Bibliographic information
| Statement of responsibility | Bo Wang. |
|---|---|
| Note | Submitted to the Department of Electrical Engineering. |
| Thesis | Thesis (Ph.D.)--Stanford University, 2016. |
| Location | electronic resource |
Access conditions
- Copyright
- © 2016 by Bo Wang
- License
- This work is licensed under a Creative Commons Attribution Non Commercial 3.0 Unported license (CC BY-NC).
Also listed in
Loading usage metrics...