Towards a big data analytics platform with Hadoop/MapReduce framework using simulated patient data of a hospital system

dc.contributor.authorChrimes, Dillon
dc.contributor.supervisorKuo, Alex (Mu - Hsing)
dc.date.accessioned2016-11-28T22:23:28Z
dc.date.available2016-11-28T22:23:28Z
dc.date.copyright2016en_US
dc.date.issued2016-11-28
dc.degree.departmentSchool of Health Information Science
dc.degree.levelMaster of Science M.Sc.en_US
dc.description.abstractBackground: Big data analytics (BDA) is important to reduce healthcare costs. However, there are many challenges. The study objective was high performance establishment of interactive BDA platform of hospital system. Methods: A Hadoop/MapReduce framework formed the BDA platform with HBase (NoSQL database) using hospital-specific metadata and file ingestion. Query performance tested with Apache tools in Hadoop’s ecosystem. Results: At optimized iteration, Hadoop distributed file system (HDFS) ingestion required three seconds but HBase required four to twelve hours to complete the Reducer of MapReduce. HBase bulkloads took a week for one billion (10TB) and over two months for three billion (30TB). Simple and complex query results showed about two seconds for one and three billion, respectively. Interpretations: BDA platform of HBase distributed by Hadoop successfully under high performance at large volumes representing the Province’s entire data. Inconsistencies of MapReduce limited operational efficiencies. Importance of the Hadoop/MapReduce on representation of health informatics is further discussed.en_US
dc.description.proquestcode0566en_US
dc.description.proquestcode0769en_US
dc.description.proquestcode0984en_US
dc.description.proquestemaildillon.chrimes@viha.caen_US
dc.description.scholarlevelGraduateen_US
dc.identifier.bibliographicCitationChrimes, D., Kuo, M-H., Moa, B., & Hu, W. (2016)a. Towards a Real-time Big Data Analytics Platform for Health Applications. International Journal of Big Data Intelligence. In Press.en_US
dc.identifier.bibliographicCitationChrimes, D., Moa, B., Zamani, H., & Kuo, M-H. (2016)b. Interactive Healthcare Big Data Analytics Platform under Simulated Performance. 2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress, 811-818.en_US
dc.identifier.bibliographicCitationKuo, M.-H., Chrimes, D., Moa, B., & Hu, X. (2015). Design and Construction of a Big Data Analytics Framework for Health Applications. IEEE Proceedings International Conference on Smart City/SocialCom/SustainCom together with DataCom 2015 and SC2 2015, Chengdu, China. 631-636.en_US
dc.identifier.urihttp://hdl.handle.net/1828/7645
dc.languageEnglisheng
dc.language.isoenen_US
dc.rightsAvailable to the World Wide Weben_US
dc.subjectBig Dataen_US
dc.subjectBig Data Analyticsen_US
dc.subjectBig Data Toolsen_US
dc.subjectBig Data Visualizationsen_US
dc.subjectHadoop Ecosystemen_US
dc.subjectHealth Big Dataen_US
dc.subjectHospital Systemsen_US
dc.subjectInteractive Big Dataen_US
dc.subjectPatient Dataen_US
dc.subjectSimulationsen_US
dc.titleTowards a big data analytics platform with Hadoop/MapReduce framework using simulated patient data of a hospital systemen_US
dc.typeThesisen_US

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Chrimes_Dillon_MSc_2016.pdf
Size:
3.16 MB
Format:
Adobe Portable Document Format
Description:
Design, Construction, and Operational Findings of a Big Data Analytics Platform for Healthcare Application
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.74 KB
Format:
Item-specific license agreed upon to submission
Description: