Predicting the programming language of questions and snippets of stack overflow using natural language processing
| dc.contributor.author | Alrashedy, Kamel | |
| dc.contributor.supervisor | Srinivasan, Venkatesh | |
| dc.contributor.supervisor | Gulliver, T. Aaron | |
| dc.date.accessioned | 2018-09-11T18:10:19Z | |
| dc.date.available | 2018-09-11T18:10:19Z | |
| dc.date.copyright | 2018 | en_US |
| dc.date.issued | 2018-09-11 | |
| dc.degree.department | Department of Computer Science | en_US |
| dc.degree.level | Master of Science M.Sc. | en_US |
| dc.description.abstract | Stack Overflow is the most popular Q&A website among software developers. As a platform for knowledge sharing and acquisition, the questions posted in Stack Over- flow usually contain a code snippet. Stack Overflow relies on users to properly tag the programming language of a question and assumes that the programming language of the snippets inside a question is the same as the tag of the question itself. In this the- sis, a classifier is proposed to predict the programming language of questions posted in Stack Overflow using Natural Language Processing (NLP) and Machine Learning (ML). The classifier achieves an accuracy of 91.1% in predicting the 24 most popular programming languages by combining features from the title, body and code snippets of the question. We also propose a classifier that only uses the title and body of the question and has an accuracy of 81.1%. Finally, we propose a classifier of code snip- pets only that achieves an accuracy of 77.7%.Thus, deploying ML techniques on the combination of text and code snippets of a question provides the best performance. These results demonstrate that it is possible to identify the programming language of a snippet of only a few lines of source code. We visualize the feature space of two programming languages Java and SQL in order to identify some properties of the information inside the questions corresponding to these languages. | en_US |
| dc.description.scholarlevel | Graduate | en_US |
| dc.identifier.uri | http://hdl.handle.net/1828/10054 | |
| dc.language | English | eng |
| dc.language.iso | en | en_US |
| dc.rights | Available to the World Wide Web | en_US |
| dc.subject | Stack overflow | en_US |
| dc.subject | knowledge sharing | en_US |
| dc.subject | Natural Language Processing | en_US |
| dc.subject | Machine Learning | en_US |
| dc.title | Predicting the programming language of questions and snippets of stack overflow using natural language processing | en_US |
| dc.type | Thesis | en_US |