A Method of HBase Multi-Conditional Query for Ubiquitous Sensing Applications.

Sensors (Basel)

School of Information Science and Engineering, Fujian University of Technology, Fuzhou 350118, China.

Published: September 2018

Big data gathered from real systems, such as public infrastructure, healthcare, smart homes, industries, and so on, by sensor networks contain enormous value, and need to be mined deeply, which depends on a data storing and retrieving service. HBase is playing an increasingly important part in the big data environment since it provides a flexible pattern for storing extremely large amounts of unstructured data. Despite the fast-speed reading by RowKey, HBase does not natively support multi-conditional query, which is a common demand and operation in relational databases, especially for data analysis of ubiquitous sensing applications. In this paper, we introduce a method to construct a linear index by employing a Hilbert space-filling curve. As a RowKey generating schema, the proposed method maps multiple index-columns into a one-dimensional encoded sequence, and then constructs a new RowKey. We also provide a -tree-based optimization to reduce the computational cost of encoding query conditions. Without using a secondary index mode, experimental results indicate that the proposed method has better performance in multi-conditional queries.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC6164097PMC
http://dx.doi.org/10.3390/s18093064DOI Listing

Publication Analysis

Top Keywords

multi-conditional query
8
ubiquitous sensing
8
sensing applications
8
big data
8
proposed method
8
data
5
method
4
method hbase
4
hbase multi-conditional
4
query ubiquitous
4

Similar Publications

Backward induction-based deep image search.

PLoS One

September 2024

Department of Industrial Engineering, Yonsei University, Seoul, Republic of Korea.

Conditional image retrieval (CIR), which involves retrieving images by a query image along with user-specified conditions, is essential in computer vision research for efficient image search and automated image analysis. The existing approaches, such as composed image retrieval (CoIR) methods, have been actively studied. However, these methods face challenges as they require either a triplet dataset or richly annotated image-text pairs, which are expensive to obtain.

View Article and Find Full Text PDF

A vehicle license plate data access model based on the jump hash consistency algorithm.

PLoS One

October 2023

China-Singapore Tianjin Eco-city Technology Innovation Bureau, Tianjin, 300480, China.

The massive amount of vehicle plate data generated by intelligent transportation systems is widely used in the field of urban transportation information system construction and has a high scientific research and application value. The adoption of big data platforms to properly preserve, process, and exploit these valuable data resources has become a hot research area in recent years. To address the problems of implementing complex multi-conditional comprehensive query functions and flexible data applications in the key-value database storage environment of a big data platform, this paper proposes a data access model based on the jump hash consistency algorithm.

View Article and Find Full Text PDF

A multi-scale map of protein assemblies in the DNA damage response.

Cell Syst

June 2023

University of California San Diego, Department of Medicine, San Diego, CA 92093, USA; The Cancer Cell Map Initiative, San Francisco and La Jolla, CA, USA. Electronic address:

The DNA damage response (DDR) ensures error-free DNA replication and transcription and is disrupted in numerous diseases. An ongoing challenge is to determine the proteins orchestrating DDR and their organization into complexes, including constitutive interactions and those responding to genomic insult. Here, we use multi-conditional network analysis to systematically map DDR assemblies at multiple scales.

View Article and Find Full Text PDF

A Method of HBase Multi-Conditional Query for Ubiquitous Sensing Applications.

Sensors (Basel)

September 2018

School of Information Science and Engineering, Fujian University of Technology, Fuzhou 350118, China.

Big data gathered from real systems, such as public infrastructure, healthcare, smart homes, industries, and so on, by sensor networks contain enormous value, and need to be mined deeply, which depends on a data storing and retrieving service. HBase is playing an increasingly important part in the big data environment since it provides a flexible pattern for storing extremely large amounts of unstructured data. Despite the fast-speed reading by RowKey, HBase does not natively support multi-conditional query, which is a common demand and operation in relational databases, especially for data analysis of ubiquitous sensing applications.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!