The term precision of a value describes the total number of significant digits that are used to express that value. False precision is presented in data, where the sampling and chosen data file format coding return values with extra non-valid digits. The proper precision in value thus depends on so-called magnitude in digital data coding. The presence of the false precision is file format dependent. The amount of dataset points could be decreased by removing false precision (where it is present) to almost 10% of the raw measurement without loss of information.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.jchromb.2015.11.044 | DOI Listing |
Publication Analysis
Top Keywords
false precision
16
file format
8
precision
5
false
4
precision mass
4
mass domain
4
domain hplc-hrms
4
data
4
hplc-hrms data
4
data representation
4
Similar Publications
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!