 |
 |
|
DataSys 2023 Congress
June 26, 2023 to June 30, 2023 - Nice, Saint-Laurent-du-Var, France
- AICT 2023, The Nineteenth Advanced International Conference on Telecommunications
- ICIW 2023, The Eighteenth International Conference on Internet and Web Applications and Services
- ICIMP 2023, The Eighteenth International Conference on Internet Monitoring and Protection
- SMART 2023, The Twelfth International Conference on Smart Cities, Systems, Devices and Technologies
- IMMM 2023, The Thirteenth International Conference on Advances in Information Mining and Management
- INFOCOMP 2023, The Thirteenth International Conference on Advanced Communications and Computation
- MOBILITY 2023, The Thirteenth International Conference on Mobile Services, Resources, and Users
- SPWID 2023, The Ninth International Conference on Smart Portable, Wearable, Implantable and Disability-oriented Devices and Systems
- ACCSE 2023, The Eighth International Conference on Advances in Computation, Communications and Services
ComputationWorld 2023 Congress
June 26, 2023 to June 30, 2023 - Nice, Saint-Laurent-du-Var, France
- SERVICE COMPUTATION 2023, The Fifteenth International Conference on Advanced Service Computing
- CLOUD COMPUTING 2023, The Fourteenth International Conference on Cloud Computing, GRIDs, and Virtualization
- FUTURE COMPUTING 2023, The Fifteenth International Conference on Future Computational Technologies and Applications
- COGNITIVE 2023, The Fifteenth International Conference on Advanced Cognitive Technologies and Applications
- ADAPTIVE 2023, The Fifteenth International Conference on Adaptive and Self-Adaptive Systems and Applications
- CONTENT 2023, The Fifteenth International Conference on Creative Content Technologies
- PATTERNS 2023, The Fifteenth International Conference on Pervasive Patterns and Applications
- COMPUTATION TOOLS 2023, The Fourteenth International Conference on Computational Logics, Algebras, Programming, Tools, and Benchmarking
- BUSTECH 2023, The Thirteenth International Conference on Business Intelligence and Technology
NetWare 2023 Congress
September 25, 2023 to September 29, 2023 - Porto, Portugal
- SENSORCOMM 2023, The Seventeenth International Conference on Sensor Technologies and Applications
- SENSORDEVICES 2023, The Fourteenth International Conference on Sensor Device Technologies and Applications
- SECURWARE 2023, The Seventeenth International Conference on Emerging Security Information, Systems and Technologies
- AFIN 2023, The Fifteenth International Conference on Advances in Future Internet
- CENICS 2023, The Sixteenth International Conference on Advances in Circuits, Electronics and Micro-electronics
- ICQNM 2023, The Seventeenth International Conference on Quantum, Nano/Bio, and Micro Technologies
- FASSI 2023, The Ninth International Conference on Fundamentals and Advances in Software Systems Integration
- GREEN 2023, The Eighth International Conference on Green Communications, Computing and Technologies
NexTech 2023 Congress
September 25, 2023 to September 29, 2023 - Porto, Portugal
- UBICOMM 2023, The Seventeenth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies
- ADVCOMP 2023, The Seventeenth International Conference on Advanced Engineering Computing and Applications in Sciences
- SEMAPRO 2023, The Seventeenth International Conference on Advances in Semantic Processing
- AMBIENT 2023, The Thirteenth International Conference on Ambient Computing, Applications, Services and Technologies
- EMERGING 2023, The Fifteenth International Conference on Emerging Networks and Systems Intelligence
- DATA ANALYTICS 2023, The Twelfth International Conference on Data Analytics
- GLOBAL HEALTH 2023, The Twelfth International Conference on Global Health Challenges
- CYBER 2023, The Eighth International Conference on Cyber-Technologies and Cyber-Systems
TrendNews 2023 Congress
September 25, 2023 to September 29, 2023 - Porto, Portugal
- CORETA 2023, Advances on Core Technologies and Applications
- DIGITAL 2023, Advances on Societal Digital Transformation
SocSys 2023 Congress
November 13, 2023 to November 17, 2023 - Valencia, Spain
SoftNet 2023 Congress
November 13, 2023 to November 17, 2023 - Valencia, Spain
- ICSEA 2023, The Eighteenth International Conference on Software Engineering Advances
- ICSNC 2023, The Eighteenth International Conference on Systems and Networks Communications
- CENTRIC 2023, The Sixteenth International Conference on Advances in Human-oriented and Personalized Mechanisms, Technologies, and Services
- VALID 2023, The Fifteenth International Conference on Advances in System Testing and Validation Lifecycle
- SIMUL 2023, The Fifteenth International Conference on Advances in System Simulation
- SOTICS 2023, The Thirteenth International Conference on Social Media Technologies, Communication, and Informatics
- INNOV 2023, The Twelfth International Conference on Communications, Computation, Networks and Technologies
- HEALTHINFO 2023, The Eighth International Conference on Informatics and Assistive Technologies for Health-Care, Medical Support and Wellbeing
IARIA Congress 2023, The 2023 IARIA Annual Congress on Frontiers in Science, Technology, Services, and Applications
November 13, 2023 to November 17, 2023 - Valencia, Spain
|
|
|
|
|
|
ThinkMind // INNOV 2015, The Fourth International Conference on Communications, Computation, Networks and Technologies // View article innov_2015_2_50_70126
Using High Performance Parallel Data Warehouse (HPDW) Big Data Analytical Platform for Big Data Analysis
 Authors:
Boon Keong Seah Keywords: big data; hadoop; hive; parallel process; infiniband; RDBMS; MPP; streaming data; data warehouse; cube; Extract Transform Load (ETL); OLAP; business intelligence; data marts Abstract:
Data warehouse has been traditionally implemented in Relational Database Management System (RDBMS) from operational data store up until the data marts and OLAP (online analytical processing) cubes for data analysis. However, the process of analyzing big data based on RDBMS is a time consuming process. In addition, with the advent of IoT, social media and other means of big data incorporation, the challenge pose to process the enormous streaming data with the need to obtain the data analysis at hand with near real time requires a need of new platform to address this. Big data incorporation for data analysis is important as it will enlarge the scope of analysis such as weather, devices information, real-time data for data correlation with existing historical data. Presently, RDBMS is not developed for handling large data set and also with ability to perform join queries between historical and streaming data for more data insight. In this paper, we introduce HPDW appliance which is a new big data platform encompassing from stream and batch data process and data query through JDBC, ODBC and integrated multi-data source BI dashboarding and data scientist tool. As it is an appliance, the nodes and all respective components required are pre-configured, hence data scientist or BI analysis will focus on using the big data for analysis and not on the setup of the big data infrastructure which will be time consuming. HPDW appliance is developed based on Massive Parallel Process (MPP) to achieve the in-memory speed it requires which uses Hadoop Distributed File System (HDFS) as the storage layer and high network speed Infiniband for node connectivity. In this paper, we describe experimental results related with the performance of its query processing. We compare the performance results on a physical cluster between RDBMS against HPDW system by varying the size of the data warehouse for fact table queries ranging from 7GB to 23GB data size. Our experiment results show that HPDW system can process the same SQL query with respect to RDBMS much faster, up to 11-200 times faster. In addition, we also show the data analysis results and data mining that can be performed on HPDW. Pages: 32 to 39 Copyright: Copyright (c) IARIA, 2015 Publication date: November 15, 2015 Published in: conference ISSN: 2326-9286 ISBN: 978-1-61208-444-2 Location: Barcelona, Spain Dates: from November 15, 2015 to November 20, 2015
|
|
SERVICES  CONTACT
2010 - 2022 © ThinkMind. All rights reserved.
Read Terms of Service and Privacy Policy. |
|
|
|
