Have abstraction and eat performance too : optimized heterogeneous computing with parallel patterns
Abstract/Contents
- Abstract
- High performance in modern computing platforms requires programs to be parallel, distributed, and run on heterogeneous hardware. However programming such architectures is extremely difficult due to the need to implement the application using multiple programming models and combine them together in ad-hoc ways. High-level programming frameworks based on parallel patterns have recently become a popular solution to raise the level of abstraction and provide implicitly parallel execution on a variety of architectures. Portable performance is often still difficult to achieve however due to the system's inability to optimize programs across data structure abstractions and nested parallelism. In this dissertation, I introduce the Delite Multiloop Language (DMLL), a new intermediate language based on common parallel patterns that captures the necessary semantic knowledge to efficiently target distributed heterogeneous architectures. Combined with a straightforward array-based data structure model, the language semantics naturally capture a set of powerful transformations over nested parallel patterns that restructure computation to enable distribution and optimize for heterogeneous devices. These transformations enable improved single-threaded performance, greater parallel scalability, smaller memory footprints, transparently targeting distributed memory architectures, and automated data movement and distribution. I also present experimental results for a range of applications spanning multiple domains and demonstrate highly efficient execution compared to manually-optimized counterparts in alternative systems.
Description
| Type of resource | text |
|---|---|
| Form | electronic; electronic resource; remote |
| Extent | 1 online resource. |
| Publication date | 2018 |
| Issuance | monographic |
| Language | English |
Creators/Contributors
| Associated with | Brown, Kevin James | |
|---|---|---|
| Associated with | Stanford University, Department of Electrical Engineering. | |
| Primary advisor | Olukotun, Oyekunle Ayinde | |
| Thesis advisor | Olukotun, Oyekunle Ayinde | |
| Thesis advisor | Kozyrakis, Christoforos, 1974- | |
| Thesis advisor | Ré, Christopher | |
| Advisor | Kozyrakis, Christoforos, 1974- | |
| Advisor | Ré, Christopher |
Subjects
| Genre | Theses |
|---|
Bibliographic information
| Statement of responsibility | Kevin James Brown. |
|---|---|
| Note | Submitted to the Department of Electrical Engineering. |
| Thesis | Thesis (Ph.D.)--Stanford University, 2018. |
| Location | electronic resource |
Access conditions
- Copyright
- © 2018 by Kevin James Brown
- License
- This work is licensed under a Creative Commons Attribution Non Commercial 3.0 Unported license (CC BY-NC).
Also listed in
Loading usage metrics...