In common usage and statistics, data (US: /ˈdætə/; UK: /ˈdeɪtə/) is a collection of discrete or continuous values that convey information, describing the quantity, quality, fact, statistics, other basic units of meaning, or simply sequences of symbols that may be further interpreted formally. A datum is an individual value in a collection of data. Data is usually organized into structures such as tables that provide additional context and meaning, and which may themselves be used as data in larger structures. Data may be used as variables in a computational process.[1][2] Data may represent abstract ideas or concrete measurements.[3] Data is commonly used in scientific research, economics, and in virtually every other form of human organizational activity. Examples of data sets include price indices (such as consumer price index), unemployment rates, literacy rates, and census data. In this context, data represents the raw facts and figures which can be used in such a manner in order to capture the useful information out of it.
Data is collected using techniques such as measurement, observation, query, or analysis, and is typically represented as numbers or characters which may be further processed. Field data is data that is collected in an uncontrolled in-situ environment. Experimental data is data that is generated in the course of a controlled scientific experiment. Data is analyzed using techniques such as calculation, reasoning, discussion, presentation, visualization, or other forms of post-analysis. Prior to analysis, raw data (or unprocessed data) is typically cleaned: Outliers are removed and obvious instrument or data entry errors are corrected.
Data can be seen as the smallest units of factual information that can be used as a basis for calculation, reasoning, or discussion. Data can range from abstract ideas to concrete measurements, including but not limited to, statistics. Thematically connected data presented in some relevant context can be viewed as information. Contextually connected pieces of information can then be described as data insights or intelligence. The stock of insights and intelligence that accumulates over time resulting from the synthesis of data into information, can then be described as knowledge. Data has been described as "the new oil of the digital economy".[4][5] Data, as a general concept, refers to the fact that some existing information or knowledge is represented or coded in some form suitable for better usage or processing.
Advances in computing technologies have led to the advent of big data, which usually refers to very large quantities of data, usually at the petabyte scale. Using traditional data analysis methods and computing, working with such large (and growing) datasets is difficult, even impossible. (Theoretically speaking, infinite data would yield infinite information, which would render extracting insights or intelligence impossible.) In response, the relatively new field of data science uses machine learning (and other artificial intelligence (AI)) methods that allow for efficient applications of analytic methods to big data.
Etymology and terminology
The Latin word Lua error in Module:Unicode_data at line 15: attempt to call field 'length' (a nil value). is the plural of Lua error in Module:Unicode_data at line 15: attempt to call field 'length' (a nil value)., "(thing) given", neuter past participle of Lua error in Module:Unicode_data at line 15: attempt to call field 'length' (a nil value)., "to give".[6] The first English use of the word "data" is from the 1640s. The word "data" was first used to mean "transmissible and storable computer information" in 1946. The expression "data processing" was first used in 1954.[6]
When "data" is used more generally as a synonym for "information", it is treated as a mass noun in singular form. This usage is common in everyday language and in technical and scientific fields such as software development and computer science. One example of this usage is the term "big data". When used more specifically to refer to the processing and analysis of sets of data, the term retains its plural form. This usage is common in natural sciences, life sciences, social sciences, software development and computer science, and grew in popularity in the 20th and 21st centuries. Some style guides do not recognize the different meanings of the term, and simply recommend the form that best suits the target audience of the guide. For example, APA style as of the 7th edition requires "data" to be treated as a plural form.[7]
Meaning
Data, information, knowledge, and wisdom are closely related concepts, but each has its role concerning the other, and each term has its meaning. According to a common view, data is collected and analyzed; data only becomes information suitable for making decisions once it has been analyzed in some fashion.[8] One can say that the extent to which a set of data is informative to someone depends on the extent to which it is unexpected by that person. The amount of information contained in a data stream may be characterized by its Shannon entropy.
Knowledge is the awareness of its environment that some entity possesses, whereas data merely communicate that knowledge. For example, the entry in a database specifying the height of Mount Everest is a datum that communicates a precisely-measured value. This measurement may be included in a book along with other data on Mount Everest to describe the mountain in a manner useful for those who wish to decide on the best method to climb it. An awareness the characteristics represented by these data is knowledge.
Data is often assumed to be the least abstract concept, information the next least, and knowledge the most abstract.[9] In this view, data becomes information by interpretation; e.g., the height of Mount Everest is generally considered "data", a book on Mount Everest geological characteristics may be considered "information", and a climber's guidebook containing practical information on the best way to reach Mount Everest's peak may be considered "knowledge". "Information" bears a diversity of meanings that ranges from everyday usage to technical use. This view, however, has also been argued to reverse how data emerges from information, and information from knowledge.[10] Generally speaking, the concept of information is closely related to notions of constraint, communication, control, data, form, instruction, knowledge, meaning, mental stimulus, pattern, perception, and representation. Beynon-Davies uses the concept of a sign to differentiate between data and information; data is a series of symbols, while information occurs when the symbols are used to refer to something.[11][12]
Before the development of computing devices and machines, people had to manually collect data and impose patterns on it. Since the development of computing devices and machines, these devices can also collect data. In the 2010s, computers are widely used in many fields to collect data and sort or process it, in disciplines ranging from marketing, analysis of social services usage by citizens to scientific research. These patterns in data are seen as information that can be used to enhance knowledge. These patterns may be interpreted as "truth" (though "truth" can be a subjective concept) and may be authorized as aesthetic and ethical criteria in some disciplines or cultures. Events that leave behind perceivable physical or virtual remains can be traced back through data. Marks are no longer considered data once the link between the mark and observation is broken.[13]
Mechanical computing devices are classified according to how they represent data. An analog computer represents a datum as a voltage, distance, position, or other physical quantity. A digital computer represents a piece of data as a sequence of symbols drawn from a fixed alphabet. The most common digital computers use a binary alphabet, that is, an alphabet of two characters typically denoted "0" and "1". More familiar representations, such as numbers or letters, are then constructed from the binary alphabet. Some special forms of data are distinguished. A computer program is a collection of data, which can be interpreted as instructions. Most computer languages make a distinction between programs and the other data on which programs operate, but in some languages, notably Lisp and similar languages, programs are essentially indistinguishable from other data. It is also useful to distinguish metadata, that is, a description of other data. A similar yet earlier term for metadata is "ancillary data." The prototypical example of metadata is the library catalog, which is a description of the contents of books.
Data documents
Template:LibraryandInformation-TopicSidebar Whenever data needs to be registered, data exists in the form of a data document. Kinds of data documents include:
- data repository
- data study
- data set
- software
- data paper
- database
- data handbook
- data journal
Some of these data documents (data repositories, data studies, data sets, and software) are indexed in Data Citation Indexes, while data papers are indexed in traditional bibliographic databases, e.g., Science Citation Index.
Data collection
Gathering data can be accomplished through a primary source (the researcher is the first person to obtain the data) or a secondary source (the researcher obtains the data that has already been collected by other sources, such as data disseminated in a scientific journal). Data analysis methodologies vary and include data triangulation and data percolation.[14] The latter offers an articulate method of collecting, classifying, and analyzing data using five possible angles of analysis (at least three) to maximize the research's objectivity and permit an understanding of the phenomena under investigation as complete as possible: qualitative and quantitative methods, literature reviews (including scholarly articles), interviews with experts, and computer simulation. The data is thereafter "percolated" using a series of pre-determined steps so as to extract the most relevant information.
Data longevity and accessibility
An important field in computer science, technology, and library science is the longevity of data. Scientific research generates huge amounts of data, especially in genomics and astronomy, but also in the medical sciences, e.g. in medical imaging. In the past, scientific data has been published in papers and books, stored in libraries, but more recently practically all data is stored on hard drives or optical discs. However, in contrast to paper, these storage devices may become unreadable after a few decades. Scientific publishers and libraries have been struggling with this problem for a few decades, and there is still no satisfactory solution for the long-term storage of data over centuries or even for eternity.
Data accessibility. Another problem is that much scientific data is never published or deposited in data repositories such as databases. In a recent survey, data was requested from 516 studies that were published between 2 and 22 years earlier, but less than 1 out of 5 of these studies were able or willing to provide the requested data. Overall, the likelihood of retrieving data dropped by 17% each year after publication.[15] Similarly, a survey of 100 datasets in Dryad found that more than half lacked the details to reproduce the research results from these studies.[16] This shows the dire situation of access to scientific data that is not published or does not have enough details to be reproduced.
A solution to the problem of reproducibility is the attempt to require FAIR data, that is, data that is Findable, Accessible, Interoperable, and Reusable. Data that fulfills these requirements can be used in subsequent research and thus advances science and technology.[17]
In other fields
Although data is also increasingly used in other fields, it has been suggested that the highly interpretive nature of them might be at odds with the ethos of data as "given". Peter Checkland introduced the term capta (from the Latin capere, “to take”) to distinguish between an immense number of possible data and a sub-set of them, to which attention is oriented.[18] Johanna Drucker has argued that since the humanities affirm knowledge production as "situated, partial, and constitutive," using data may introduce assumptions that are counterproductive, for example that phenomena are discrete or are observer-independent.[19] The term capta, which emphasizes the act of observation as constitutive, is offered as an alternative to data for visual representations in the humanities.
Data-driven activities
The adjective data-driven is a neologism applied to an activity compelled by data, rather than by intuition or by personal experience. Examples include:
- Data-driven programming, computer programming in which program statements describe data to be matched and the processing required
- Data-driven journalism, a journalistic process based on analyzing and filtering large data sets,
- Data-driven testing, computer software testing done using a table of conditions directly as test inputs and verifiable outputs
- Data-driven learning, a learning approach driven by research-like access to data
- Data-driven science, an interdisciplinary field of scientific methods to extract knowledge from data
- Data-driven control systems, systems of automatic control based on system identification
- Data-driven security, a form of model-driven security
- Data-driven marketing, a form of digital marketing
- Data-driven company, a form of company management based at data analysis
See also
- Biological data
- Computer data processing
- Computer memory
- Dark data
- Data (computer science)
- Data acquisition
- Data analysis
- Data bank
- Data cable
- Data curation
- Data domain
- Data element
- Data farming
- Data governance
- Data integrity
- Data maintenance
- Data management
- Data mining
- Data modeling
- Data point
- Data preservation
- Data protection
- Data publication
- Data remanence
- Data science
- Data set
- Data structure
- Data visualization
- Data warehouse
- Database
- Datasheet
- Digital privacy
- Environmental data rescue
- Fieldwork
- Information engineering
- Machine learning
- Open data
- Scientific data archiving
- Secondary Data
- Statistics
References
- ↑ OECD Glossary of Statistical Terms. OECD. 2008. p. 119. ISBN 978-92-64-025561.
- ↑ "Statistical Language - What are Data?". Australian Bureau of Statistics. 2013-07-13. Archived from the original on 2019-04-19. Retrieved 2020-03-09.
- ↑ "Data vs Information - Difference and Comparison | Diffen". www.diffen.com. Retrieved 2018-12-11.
- ↑ Yonego, Joris Toonders (July 23, 2014). "Data Is the New Oil of the Digital Economy". Wired – via www.wired.com.
- ↑ "Data is the new oil". July 16, 2018. Archived from the original on 2021-10-27.
{{cite web}}:|archive-date=/|archive-url=timestamp mismatch (help) - ↑ 6.0 6.1 "data | Origin and meaning of data by Online Etymology Dictionary". www.etymonline.com.
- ↑ American Psychological Association (2020). "6.11". Publication Manual of the American Psychological Association: the official guide to APA style. American Psychological Association. ISBN 9781433832161.
- ↑ "Joint Publication 2-0, Joint Intelligence" (PDF). Joint Chiefs of Staff, Joint Doctrine Publications. Department of Defense. 23 October 2013. pp. I-1. Retrieved July 17, 2018.
- ↑ Akash Mitra (2011). "Classifying data for successful modeling". Archived from the original on 2017-11-07. Retrieved 2017-11-05.
- ↑ Tuomi, Ilkka (2000). "Data is more than knowledge". Journal of Management Information Systems. 6 (3): 103–117. doi:10.1080/07421222.1999.11518258.
- ↑ P. Beynon-Davies (2002). Information Systems: An introduction to informatics in organisations. Basingstoke, UK: Palgrave Macmillan. ISBN 0-333-96390-3.
- ↑ P. Beynon-Davies (2009). Business information systems. Basingstoke, UK: Palgrave. ISBN 978-0-230-20368-6.
- ↑ Sharon Daniel. The Database: An Aesthetics of Dignity.
- ↑ Mesly, Olivier (2015). Creating Models in Psychological Research. États-Unis : Springer Psychology : 126 pages. ISBN 978-3-319-15752-8
- ↑ Vines, Timothy H.; Albert, Arianne Y. K.; Andrew, Rose L.; Débarre, Florence; Bock, Dan G.; Franklin, Michelle T.; Gilbert, Kimberly J.; Moore, Jean-Sébastien; Renaut, Sébastien; Rennison, Diana J. (2014-01-06). "The availability of research data declines rapidly with article age". Current Biology. 24 (1): 94–97. doi:10.1016/j.cub.2013.11.014. ISSN 1879-0445. PMID 24361065. S2CID 7799662.
- ↑ Roche, Dominique G.; Kruuk, Loeske E. B.; Lanfear, Robert; Binning, Sandra A. (2015). "Public Data Archiving in Ecology and Evolution: How Well Are We Doing?". PLOS Biology. 13 (11): e1002295. doi:10.1371/journal.pbio.1002295. ISSN 1545-7885. PMC 4640582. PMID 26556502.
- ↑ Eisenstein, Michael (April 2022). "In pursuit of data immortality". Nature. 604 (7904): 207–208. Bibcode:2022Natur.604..207E. doi:10.1038/d41586-022-00929-3. ISSN 1476-4687. PMID 35379989. S2CID 247954952.
- ↑ P. Checkland and S. Holwell (1998). Information, Systems, and Information Systems: Making Sense of the Field. Chichester, West Sussex: John Wiley & Sons. pp. 86–89. ISBN 0-471-95820-4.
- ↑ Johanna Drucker (2011). "Humanities Approaches to Graphical Display". Digital Humanities Quarterly. 005 (1).
External links
- Data is a singular noun (a detailed assessment)
Template:Statistics Lua error in Module:Authority_control at line 186: attempt to index field 'wikibase' (a nil value).