Unsupervised KPIs-Based Clustering of Jobs in HPC Data Centers.

Sensors (Basel)

Information & Computing Lab, AtlanTTIC Research Center, Universidade de Vigo, 36310 Vigo, Spain.

Published: July 2020

Performance analysis is an essential task in high-performance computing (HPC) systems, and it is applied for different purposes, such as anomaly detection, optimal resource allocation, and budget planning. HPC monitoring tasks generate a huge number of key performance indicators (KPIs) to supervise the status of the jobs running in these systems. KPIs give data about CPU usage, memory usage, network (interface) traffic, or other sensors that monitor the hardware. Analyzing this data, it is possible to obtain insightful information about running jobs, such as their characteristics, performance, and failures. The main contribution in this paper was to identify which metric/s (KPIs) is/are the most appropriate to identify/classify different types of jobs according to their behavior in the HPC system. With this aim, we had applied different clustering techniques (partition and hierarchical clustering algorithms) using a real dataset from the Galician computation center (CESGA). We concluded that (i) those metrics (KPIs) related to the network (interface) traffic monitoring provided the best cohesion and separation to cluster HPC jobs, and (ii) hierarchical clustering algorithms were the most suitable for this task. Our approach was validated using a different real dataset from the same HPC center.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7435729PMC
http://dx.doi.org/10.3390/s20154111DOI Listing

Publication Analysis

Top Keywords

network interface
8
interface traffic
8
hierarchical clustering
8
clustering algorithms
8
real dataset
8
hpc
6
jobs
5
unsupervised kpis-based
4
clustering
4
kpis-based clustering
4

Similar Publications

Background: High-throughput behavioral analysis is important for drug discovery, toxicological studies, and the modeling of neurological disorders such as autism and epilepsy. Zebrafish embryos and larvae are ideal for such applications because they are spawned in large clutches, develop rapidly, feature a relatively simple nervous system, and have orthologs to many human disease genes. However, existing software for video-based behavioral analysis can be incompatible with recordings that contain dynamic backgrounds or foreign objects, lack support for multiwell formats, require expensive hardware, and/or demand considerable programming expertise.

View Article and Find Full Text PDF

Epithelia are multicellular sheets that form barriers defining the internal and external environments. The constant stresses acting at this interface require that epithelial sheets are mechanically robust and provide a selective barrier to the hostile exterior. These properties are mediated by cellular junctions which are physically linked with heavily crosslinked cytoskeletal networks.

View Article and Find Full Text PDF

Selective activation of mesoscale functional circuits via multichannel infrared stimulation of cortical columns in ultra-high-field 7T MRI.

Cell Rep Methods

January 2025

Department of Neurosurgery of the Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou 310029, China; Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China; National Key Laboratory of Brain and Computer Intelligence, Zhejiang University, Hangzhou 310058, China; Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou 310027, China; MOE Frontier Science Center for Brain Science and Brain-Machine Integration, School of Brain Science and Brain Medicine, Zhejiang University, Hangzhou 310012, China. Electronic address:

To restore vision in the blind, advances in visual cortical prosthetics (VCPs) have offered high-channel-count electrical interfaces. Here, we design a 100-fiber optical bundle interface apposed to known feature-specific (color, shape, motion, and depth) functional columns that populate the visual cortex in humans, primates, and cats. Based on a non-viral optical stimulation method (INS, infrared neural stimulation; 1,875 nm), it can deliver dynamic patterns of stimulation, is non-penetrating and non-damaging to tissue, and is movable and removable.

View Article and Find Full Text PDF

Foaming ink for 3D-printing of ultralight and hyperelastic graphene architectures: Multiscale design and ultra-efficient electromagnetic interference shielding.

J Colloid Interface Sci

January 2025

School of Chemical Engineering and Light Industry, Guangdong University of Technology, Guangzhou 510006 China; Guangdong Provincial Laboratory of Chemistry and Fine Chemical Engineering Jieyang Center, School of Advanced Manufacturing, Guangdong University of Technology, Jieyang 515200 China. Electronic address:

Extrusion-based printing of macroscopic architectures layer-by-layer offers new opportunities for constructing customized electromagnetic interference (EMI) shielding materials. However, current research primarily focuses on improving the printability of material inks by increasing contents and adding various modifiers, controllable construction of ultralight and robust macro-architectures with structural design at both macro- and micro-scales is still challenging. Herein, we develop a graphene oxide foaming ink enriched with air bubbles for direct-ink writing, enabling the creation of macroscopic graphene architectures with arbitrary geometries.

View Article and Find Full Text PDF

Objective: Among all BCI paradigms, motion imagery (MI) has gained favor among researchers because it allows users to control external devices by imagining movements rather than actually performing actions. This property holds important promise for clinical applications, especially in areas such as stroke rehabilitation. Electroencephalogram (EEG) signals and functional near-infrared spectroscopy (fNIRS) signals are two of the more popular neuroimaging techniques for obtaining MI signals from the brain.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!