Studies on applications of neural networks in modeling sparse datasets and in the analysis of dynamics of CA3 in hippocampus
| dc.contributor.author | Keshavarz Hedayati, Babak | |
| dc.contributor.supervisor | Dimopoulos, Nikitas J. | |
| dc.date.accessioned | 2019-04-23T17:49:55Z | |
| dc.date.available | 2019-04-23T17:49:55Z | |
| dc.date.copyright | 2019 | en_US |
| dc.date.issued | 2019-04-23 | |
| dc.degree.department | Department of Electrical and Computer Engineering | en_US |
| dc.degree.level | Doctor of Philosophy Ph.D. | en_US |
| dc.description.abstract | Neural networks are an important tool in the field of data science as well as in the study of the very structures they were inspired from i.e. the human nervous system. In this dissertation, we studied the application of neural networks in data modeling as well as their role in studying the properties of various structures in the nervous system. This dissertation has two foci: one relates to developing methods that help improve \gls{generalization} in data models and the other is to study the possible effects of the structure on the function. As the first focus of this dissertation, we proposed a set of heuristics that improve the \gls{generalization} capability of the neural network models in regression and classification problems. To do so, we explored applying apprioi information in the form of \gls{regularization} of the behavior of the models. We used smoothness and self-consistency as the two regularized attributes that were enforced on the behavior of the neural networks in our model. We used our proposed heuristics to improve the performance neural network ensembles in regression problems (more specifically in quantitative structure–activity relationship (QSAR) modeling problems). We demonstrated that these heuristics result in significant improvements in the performance of the models we used. In addition, we developed an anomaly detection method to identify and exclude the outliers among unknown cases presented to the model. This was to ensure that the data model only made a prediction about the outcome of the unknown cases that were within its domain of applicability. This filtering resulted in further improvement of the performance of the model in our experiments. Furthermore, and through some modifications, we extended the application of our proposed heuristics to classification problems. We evaluated the performance of the resulting classification models over several datasets and demonstrated that the \gls{regularization}s we employed in our heuristics, had a positive effect on the performance of the data model across various classification problems as well. In the second part of this dissertation, we focused on studying the relationship between the structure and the functionality in the nervous system. More specifically, whether or not the structure implies functionality. In studying these possible effects, we elected to study CA3b in Hippocampus. For this reason, we used current related literature to derive a physiologically plausible model of CA3b. To make our proposed model as close as possible to its counterpart in the nervous system, we used large scale neural simulations, in excess of 45,000 neurons, in our experiments. We used the collective firings of all the neurons in our proposed structure to produce a time series signal. We considered this time-series signal which is a way to demonstrate the overall output of the structure should it be monitored by an EEG probe as the output of the structure. In our simulations, the structure produced and maintained a low frequency rhythm. We believe that this rhythm is similar to the Theta rhythm which occurs naturally in CA3b. We used the fundamental frequency of this rhythm in our experiments to quantify the effects of modifications in the structure. That is, we modified various properties of our CA3b and measured the changes in the fundamental frequency of the signal. We conducted various experiments on the structural properties (the length of axons of the neurons, the density of connections around the neurons, etc.) of the simulated CA3b structure. Our results show that the structure was very resilient to such modifications. Finally, we studied the effects of lesions in such a resilient structure. For these experiments, we introduced two types of lesions: many lesions of small radius and a few lesions with large radii. We then increased the severity of these lesions by increasing the number of lesions in the case of former and increasing the radius of lesions in the case of the latter. Our results showed that many small lesions in the structure have a more pronounced effect on the fundamental frequency compared to the few lesions with large radii. | en_US |
| dc.description.scholarlevel | Graduate | en_US |
| dc.identifier.bibliographicCitation | B. K. Hedayati, R. Parra-Hernandez, E. M. Laxdal, N. J. Dimopoulos, P. Alexiou and V. J. Demopoulos, "An improved neural network ensemble model of Aldose Reductase inhibitory activity," The 2012 International Joint Conference on Neural Networks (IJCNN), Brisbane, QLD, 2012, pp. 1-7 | en_US |
| dc.identifier.bibliographicCitation | T.Vallianatou, B. Hedayati, N. Dimopoulos, A. Tsantili-Kakoulidou “Neural Networks-based models in QSAR of PPAR-α ligands. Comparison with linear PLS models” VIII Joint Meeting on Medicinal Chemistry, Lublin Poland, July 2013 | en_US |
| dc.identifier.bibliographicCitation | T.Vallianatou, B. Hedayati, N. Dimopoulos, A. Tsantili-Kakoulidou “Comparison of the performance of Neural Network and PLS models in the prediction of PPAR-α and –γ agonism” 5th BBBB International Conference, Athens, September 2013. | en_US |
| dc.identifier.bibliographicCitation | Keshavarz Hedayati, Babak ; Dimopoulos, Nikitas ; Babul, Arif ; Yeung, Arnold ; Virji-Babul, Naznin , “Neural Network-Based Classification of Concussed and Control Groups from EEG”, poster presentation at 37th annual conference of the IEEE Engineering in Medicine and Biology Science | en_US |
| dc.identifier.bibliographicCitation | B. Keshavarz-Hedayati, P. Guangyuan, A. Jooya and N. J. Dimopoulos, "In-training and post-training generalization methods: The case of ppar — α and ppar — γ agonists," 2015 International Joint Conference on Neural Networks (IJCNN), Killarney, 2015, pp. 1-7 | en_US |
| dc.identifier.bibliographicCitation | B. Keshavarz-Hedayati and N. J. Dimopoulos, "Sensitivity and similarity regularization in dynamic selection of ensembles of neural networks," 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, 2017, pp. 3953-3958 | en_US |
| dc.identifier.bibliographicCitation | Keshavarz-Hedayati, Babak & Dimopoulos, Nikitas & Babul, Arif.,” A Study on the Effects of Lesions on CA3b in Hippocampus” , Advances in Neural Networks , Chapter 55, ISNN 2017 | en_US |
| dc.identifier.uri | http://hdl.handle.net/1828/10742 | |
| dc.language | English | eng |
| dc.language.iso | en | en_US |
| dc.rights | Available to the World Wide Web | en_US |
| dc.subject | neural networks | en_US |
| dc.subject | data modeling | en_US |
| dc.subject | hippocampus | en_US |
| dc.subject | regularization | en_US |
| dc.subject | regression | en_US |
| dc.subject | classification | en_US |
| dc.title | Studies on applications of neural networks in modeling sparse datasets and in the analysis of dynamics of CA3 in hippocampus | en_US |
| dc.type | Thesis | en_US |