Research on modern computer architecture optimization techniques: implementation and measurements for big data processing
| dc.contributor.author | He, Yan | |
| dc.contributor.supervisor | Weber, Jens | |
| dc.date.accessioned | 2021-09-11T19:37:42Z | |
| dc.date.available | 2021-09-11T19:37:42Z | |
| dc.date.copyright | 2021 | en_US |
| dc.date.issued | 2021-09-11 | |
| dc.degree.department | Department of Computer Science | en_US |
| dc.degree.level | Master of Science M.Sc. | en_US |
| dc.description.abstract | With the rapid development of big data computing, our programmers need to improve the efficiency of big data processing. In our daily development process, we normally focus on bug-free deployment and often overlook another aspect of software engineering, performance optimization. Actually, a great deal of programming effort is required to achieve good performance. Many techniques are having the potential to significantly improve software performance. To achieve efficiency, I firstly conclude some optimization techniques dealing with memory-bound issues then moving to parallel programming to deal with compute-bound problems. As an example, we apply as many techniques that I mention in the report to a popular algorithm implementation, PageRank based on C++17. By providing constant feedback from performance measurement and profiling, we can see a drastic speed up after implementing all these optimization techniques. I also experiment with a real-world graph dataset provided by IMDb which can rank the top movies, and also evaluate performance before and after optimization. This report hopefully can provide potential future direction towards applying different optimization techniques to various big data processing applications. | en_US |
| dc.description.scholarlevel | Graduate | en_US |
| dc.identifier.uri | http://hdl.handle.net/1828/13378 | |
| dc.language.iso | en | en_US |
| dc.rights | Available to the World Wide Web | en_US |
| dc.subject | big data | en_US |
| dc.subject | data locality | en_US |
| dc.subject | OpenMP | en_US |
| dc.subject | GPU computing | en_US |
| dc.subject | profile data | en_US |
| dc.subject | CUDA | en_US |
| dc.subject | PageRank | en_US |
| dc.subject | movie reference | en_US |
| dc.subject | single-threaded optimization | en_US |
| dc.subject | multi-core optimization | en_US |
| dc.title | Research on modern computer architecture optimization techniques: implementation and measurements for big data processing | en_US |
| dc.type | project | en_US |