Proceedings of the 11th International Conference on Conceptions of Library and Information Science, Oslo Metropolitan University, May 29 - June 1, 2022
Interrogating paradata
Olle Sköld, Lisa Börjesson, and Isto Huvila
Introduction. The concept of paradata has received increasing attention in recent information scholarship. The literature however shows considerable disagreement about what paradata is and how it can be purposive. The aim of this paper is to facilitate the use of the resources and analytical impetuses offered by the concept of paradata by providing an explanation to what paradata is in operational terms.
Method. The examination of paradata is based on a scoping review of 53 scholarly texts that varyingly engage with the concept.
Analysis. The reviewed texts were analysed using a concept-analysis framework focusing principally on discerning the main descriptive features of paradata and prevalent instances of use and usefulness.
Results. The paper shows what the key elements, relationships, use-cases and uncertainties of paradata are.
Conclusions. Findings support a media-archaeological view of born-digital artifacts, and bibliographical archaeology is shown to provide a programmatic approach in identifying significant archaeological characteristics among artifacts that have yet to be exhaustively studied.nificant archaeological characteristics among artifacts that have yet to be exhaustively studied.
DOI: https://doi.org/10.47989/colis2206
Introduction
A key driver of information research is the interest to understand and describe information phenomena. Recent information-research scholarship (Dahlström and Hansson, 2019; Huvila, et al., 2021a; Huvila, et al., 2021b; Huvila and Sköld, 2021) shows an increasing interest in paradata, a term that signifies information about the means (procedures, tools, activities) by which a certain body of information came into being (Sköld, et al., forthcoming).
There are several indications that paradata might prove to be a useful addition to the core conceptual cadre of information research. One such indication is the slightly differing emphasis, meaning and disciplinary connotations of paradata compared to closely related and impactful notions like metadata and provenance (Börjesson, et al., 2020). Another sign pointing to the conceptual and analytical offerings of paradata is how the notion is put to use in non-information research settings (see e.g., Berg and Goorman, 1999; Baker and Yarmey, 2009; Wallis, et al., 2013). The potential usefulness of paradata in information research notwithstanding, the literature shows considerable disagreement about what paradata is and how it can be purposive (Gant and Reilly, 2018; Huggett, 2020; also cf. Bentkowska-Kafel, et al., 2012; Huvila, 2012). Notable uncertainties exist regarding the principal characteristics of paradata and its supposed applications, users and makers. A key first step in facilitating the use of the resources and analytical impetuses offered by the current state-of-the-art of paradata inquiry in information research and associated scholarly and professional fields is to examine and attempt to clarify the concept by drawing on the many instances of use and deliberation of paradata. As of now, this has not yet been accomplished.
The purpose of this paper is to provide an explanation to what paradata is in operational terms by conducting a concept analysis of paradata as it emerges in multi-field research use. Through this examination the paper also seeks to facilitate further exploration of the range of possible applications, practical uses and theoretical offerings of paradata in information research. The empirical basis of the paper is a scoping review (Munn, et al., 2018; Pham, et al., 2014) of 53 scholarly texts (journal articles, articles from conference proceedings, book chapters), drawn from two domains—archaeology and cultural-heritage studies—where, in contrast to information research, paradata has been discussed already for some time. Moreover, in these specific domains, the earlier discussion on the concept resonates closely with how paradata could be meaningfully framed in information research. In this way, a survey of literature in archaeology and cultural-heritage studies provides a good starting point for exploring the potential relevance of paradata in information research. The reviewed texts were facilitating the use of the resources and analytical impetuses offered by the current state- of-the-art of paradata (Baldwin and Rose, 2009; Nuopponen, 2010b). The relevance of inquiring into the notion of paradata is theoretically underpinned by Moore's (2004) rendering of concepts in research practice as the perpetuators of productive ambiguity between global (abstractions, theory) and local (specific manifestations, connections, experiences) realizations, all impacted by certain pre-theoretical commitments. As such, concepts play a key role in the meaning-making efforts of the scholarly narrative and are non-monolithic; they can have varying meanings even within a tightly delimited cluster of scientific outlets (Abbott, 1988; Maines, 1993) but are nevertheless knowable and definable phenomena (Rodgers and Knafl, 1993; Nuopponen, 2010a) if investigated in situ.
Descriptions of information processes
Process information is described and termed differently between and across disciplines and research interests. This image is also evident in information research where conceptual heterogeneity is a well-documented state of affairs owing to historical, epistemological and organizational factors (Nolin and Åström, 2010) like the not seldom close relationship between information research and archival studies (Figuerola, et al., 2017; Tuomaala, et al., 2014). Paradata aside, provenance is a common concept with connections to the aforementioned archival sphere that denotes process information. These terms share a main characteristic with the, in information research and otherwise, well-established notion of metadata and other information-about-information terms insofar as they express the features of and connections between complex informational phenomena and more abstracted descriptions thereof (see e.g., Pomerantz, 2015). The information-process concepts are distinguished by describing the creation and curatorial histories of an information phenomena (Börjesson, et al., 2020) that in many cases, but not necessarily so, emanate from scholarly inquiries or exist within the auspices of a GLAM institution or other heritage contexts (Fear and Donaldson, 2012; Huvila, et al., 2021a; Kreuter and Casas-Cordero, 2010; Sweeney, 2008).
Huggett (2012) employs the term provenance to refer to information that can mitigate the custodial and re-use challenges posed by the contextual boundedness of research data and segments it into agent- (the creators and manipulators of data), object-, (data and data- manipulation origins) and process-centred (the elements and actions of data generation) classes of provenances. Provenance is a concept that additionally has a strong and long- standing position in archives and records management (Bearman and Lytle, 1985), and that more recently has seen use in data-creation path modelling (Curcin, 2017; De Oliveira, et al., 2015). Provenance in the archival sense does not have an undisputed definition or origin (Ridener, 2009), but is used to describe the individual or organizational actor whose activities the record in question is created as a part of. Besides creation, provenance signifies the procedures of record keeping and so ties into the notion of original order—an in archival theory and practice influential idea that much record-keeping value stems from maintaining the structure in which records were put by their creators and curators (MacNeil, 2008). Provenance is useful for appraisal and the identification of archival value (Tschan, 2002), and for arranging, acquiring and retrieving records (Sweeney, 2008).
The concept of paradata emerged in survey research as 'auxiliary data describing the [survey] process' (Couper, 2000, p. 393). Survey paradata can be digital audit trails, interview lengths and survey-management information and encompasses both automatically captured trace data from survey-conduct and response activities and other forms of manually generated data (Kreuter and Casas-Cordero, 2010; West, 2011). The usefulness of paradata in survey research is attributed to the possibilities it affords for evaluating and developing computer- assisted survey approaches and for interpreting present and historic survey results (Couper and Kreuter, 2013; Nicolaas, 2011). In this, the concept of paradata echoes one of the main offerings of provenance: descriptions of information processes partially solve the elementary problem of information provision in scholarly and GLAM-connected reuse scenarios by bridging to some extent the epistemic and sociotechnical horizons of the data creators and manipulators with that of the data reusers (Borgman, 2012; Kim and Yoon, 2017). Paradata has also seen use in archaeology and cultural-heritage studies especially in relation to matters of research-data reuse and heritage-data management. It should be noted that there exists, in addition to those that have been discussed here, other concepts like provenience (Buchanan, 2016), pipelines (Mudge, 2012) and workflows (Davidson and Freire, 2008) that explain information about information processes with slightly varying emphases, connotations and disciplinary affiliations (see also Huvila, et al., 2021a; Reilly, et al., 2021).
Study approach
This paper is based on an analysis of 53 scholarly texts from the fields of archaeology and cultural heritage research. Scoping-review methodology inspired the paper's data collection procedures and the writings on concept analysis supplemented the qualitative analysis of the resulting corpus.
Collecting the corpus
The scoping review is a fairly recent approach to synthesizing evidence in the literature that was developed from systematic-review methods (Munn, et al., 2018). The scoping review maintains the importance of transparent and structured literature-search paths and corpus selection (DiCenso, et al., 2010), but diverges from the systematic review by being adapted to first-step explorations (Munn, et al., 2018) of unchartered and heterogeneous topics (Pham, et al., 2014) where the literature that has widespread characteristics and qualities (Peters, et al., 2015). A more specific use of the scoping review is to clarify how concepts are used in research praxis (Munn, et al., 2018), which makes it suitable for the purposes of this study.
Data collection proceeded by adapting the scoping-review procedures suggested by Arksey, et al. (2002; as described in Tricco, et al., 2016 and Pham, et al., 2014).
Literature searches were conducted to find studies that could be evaluated for inclusion in the corpus using Web of Science, Scopus, Google Scholar and the OPAC of the Uppsala University Library—search engines that together offer good coverage of the archaeology- and cultural- heritage studies literature. The searches were conducted in November-December 2019 with the addition of a complementary search round taking place in December 2021. Eligibility criteria for inclusion in the corpus included language requirements (English), academic requirements (peer review), a non-trivial engagement with the concept of paradata and the removal of duplicates. The study selection process resulted in a corpus of 53 English- language scholarly texts including book chapters (6), papers from conference proceedings (13) and journal papers (34) published between 2008–2021. The texts included in the corpus can be found in the reference list of this paper, highlighted with an asterisk.
Analysing the corpus
Main focus | Subfocus | Subfocus description |
---|---|---|
The descriptive features of paradata | Prevalent descriptions | What paradata is described to be |
Key instances | The empirical referents of paradata | |
Creators, users, means and methods | The supposed creators and users of paradata; the means and methods of paradata creation | |
The use(s) of paradata | Purposes | The purposes of paradata and paradata use |
Paradata-solvable problems | Problems foregrounded where paradata is a solution | |
Use-cases | Examples of paradata-use activities |
The analysis of the literature corpus was informed by concept analysis and proceeded from an analytical scheme (see Table 1). The analytical scheme was developed on the basis of common points of focus in the literatures of concept analysis (Nuopponen, 2010b; Nuopponen, 2010a; Nuopponen, 2011) and previous research on paradata and data descriptions (Faniel, et al., 2013; Huggett, 2012). The analytical focuses in Table 1 are expanded upon in Table 2, which summarizes the concept of paradata as it emerged in the studied corpus in terms of the elements of paradata, paradata use-praxis, key relationships of paradata and the principal uncertainties of paradata. The coding of the literature corpus drew on grounded theory (Charmaz, 1983) and the method of constant comparison (Corbin and Strauss, 1990).
Limitations
Several limitations should be noted. The limited number of scholarly texts analysed and the disciplinary delimitations to archaeology and cultural heritage studies makes the results of this study unable to support any wider-ranging conclusions. The selection of search engines and search parameters did impact the study's results. So did also the focus on English- language literature and the study's analytical approach (Table 1) including its discursive rather than descriptive interests. Limitations notwithstanding, the usefulness of the study lies in it taking the first steps towards understanding the concept of paradata as it emerges in scholarly operations and what this means for useful appropriation of the notion in information research. In this way the present paper fulfils one of the main roles of the scoping review: to offer results that can be used to inform the design and direction of subsequent research.
Paradata in research-use
The descriptive features of paradata
Prevalent descriptions of paradata
The concept of paradata is described and exemplified across the studied corpus in ways that show important commonalities. The majority of authors assert, or at minimum firmly indicate, that the concept of paradata is an information phenomenon that—whether or not its creation and use is discussed in past, present, or future terms—explains occurrences that have taken place in time gone by. The past occurrences that make up the informational centre-point of paradata, what paradata is about, are differently termed. The most common renderings in the corpus are that paradata describes what is termed processes (Bentkowska-Kafel and Denard, 2012b; Denard, 2012; Demetrescu, 2015; Havemann, 2012; Havemann, et al., 2009; Gasparetto and Baratin, 2021; Huvila, 2021; ten Harkel and Fisher, 2021) or otherwise coined sequential and goal-oriented series of physical and mental actions and applications of technological, methodological, or other means (Carboni, et al., 2016; De Reu, et al., 2013; Reilly, et al., 2016; Saygi, et al., 2018; von Schwerin, et al., 2016). Given the nature of the corpus, these processes and event chains are always tied to research ventures and are, also, thoroughly productive: paradata here arise as an information phenomenon that describes processes that put into existence some scholarly product, e.g., scientific publications (Cook, 2019), 3D heritage models (Giles, et al., 2012), or museum artefacts (Havemann, 2012).
The analysis shows that similarly there is much agreement among the authors about what foci paradata must encompass in order to adequately describe productive scholarly processes.
Carboni, et al. (2016, p. 57) express a prevailing position by writing that ideal paradata can convey 'reliable knowledge of the essential parameters that have gone into the creation and delivery of [a scholarly product]'. Key essential parameters of productive scholarly processes in the studied corpus are the cornerstones of intellectual work (the collection, processing and analysis of data; interpretative, creative and evaluative activities; Beacham, 2011; Bentkowska-Kafel, 2013; De Reu, et al., 2013; Demetrescu, 2015; Denard, 2012; Tamborrino and Wendrich, 2017; von Schwerin, et al., 2016) and the network of resources drawn upon in this work. Examples of such resources are domain and project-related knowledge, specifications of technical means employed, datasets, the finished scholarly product itself and other important information sources (Arnold, 2008; Beacham, 2011; Carboni, et al., 2016; De Reu, et al., 2013; Denard, 2012; Tamborrino and Wendrich, 2017).
Prevalent instances of paradata
Beyond what paradata is about, the corpus also shows different roads taken to describe in detail what the information phenomena of paradata is. Aside from the implicit assumption that paradata is indeed data, paradata is varyingly characterized as documentation (Bentkowska-Kafel and Denard, 2012b; Denard, 2012), records (Westwood, 2016) and information (Beacham, 2011; Tamborrino and Wendrich, 2017). While it is difficult to identify what the significance of such terminological choices are in relation to paradata, it can be inferred that they can be tied to deliberations of whether useful paradata can be structured or unstructured, accidentally or deliberately recorded, embedded or stand-alone. The studied corpus holds no consensus here, and paradata is described as existing alongside all axes together (Beacham, 2011; Huvila, et al., 2021a; Lo Turco, et al., 2019; Reilly, et al., 2021; Westwood, 2016). This ambiguity is further illustrated by the plurality of prominent instances of paradata, the empirical referents of the concept, found in the studied texts. The empirical referents are of many types and characteristics but have certain similarities: they are multimodal (texts, images, maps, computer models; Cook, 2019; Carnall, 2016; Tamborrino and Wendrich, 2017; see Havemann, 2012 for many examples) and can be both rigorously structured (Abate, et al., 2017) and free-form (Arnold, 2008) but are always intimately tied to the type(s) of data processed in pursuit of the research objective and the domain of inquiry in question. The strong affiliation between paradata and the research framework from which it emerges is also described as a value-adding relationship. All authors in the corpus agree that paradata increases and sustains over time and multiple (re)use-scenarios the usefulness of the scholarly product whose inception and creation the paradata describes. The scholarly product likewise is a non-interchangeable resource important resource for making sense of the paradata set, and it is repeatedly suggested that they should be stored, disseminated and interlinked in a manner that maximizes their reciprocity (Beacham, 2011; Giles, et al., 2012; Reilly, et al., 2016).
Paradata creators, users and the means and methods of paradata creation
There is little variation across the studied corpus regarding who the creators and users of paradata are described to be. The supposed creators of paradata are human actors connected to the scholarly product whose inception the paradata is describing, either in researcher (Carboni, et al., 2016; Iadanza, et al., 2019; McEwen Arnold and Lafreniere, 2018) or other professional capacities (Bogucka and Jahnke, 2018; Llamas, et al., 2017; Lo Turco, et al., 2019). Paradata users are discussed in a similar fashion: '[e]xperts and non-experts' (Di Giulio, et al., 2017, p. 251) including researchers (De Reu, et al., 2013; Giles, et al., 2012; Lercari, et al., 2018), professionals and other stakeholders in associated domains (Abate, et al., 2017; Carnall, 2016; Lo Turco, et al., 2019) and members of the public (Champion, 2016; Havemann, et al., 2009; Schofield, et al., 2018) are the main groups of paradata users mentioned.
The analysis however shows a greater diversity regarding the means and methods employed in paradata creation. The most abstract instances of paradata creation are described as a manual documentation of work processes that is followed by linking the paradata to the scholarly product it pertains to (Abate, et al., 2017; Abdelmonem, et al., 2017; Havemann, 2012; Iadanza, et al., 2019). The authors reflect on a series of documentary means to achieve such purposes. In group working environments, Lercari, et al. (2018) propose the keeping of a communal diary; Bentkowska-Kafel and Denard (2012) encourage writing lab notebooks. Carboni, et al. (2016) suggest the use of pipelines, workflow diagrams and metadata forms to create paradata in a project with multiple actors. Giles, et al. (2012) put forward a holistic paradata-creation approach that captures the intellectual processes of the research team by using means and methods adapted to the stages of research work and the various research materials in focus therein. The important step of linking paradata and scholarly products is in the corpus often enacted via markup technologies that allow specific paradata segments to be tied to relevant instances of the scholarly product (Havemann, et al., 2009; McEwen Arnold and Lafreniere, 2018; Tamborrino and Wendrich, 2017). Additional means and methods of paradata creation discussed are the tracking and recording functionalities afforded by the computer tools used to gather, curate, analyse and communicate research data and results (Bentkowska-Kafel and Denard, 2012a; Bentkowska-Kafel and Denard, 2012b). It is also pointed out that paradata is automatically created during the course of computer-assisted processing of research data (Westwood, 2016). The resulting traces and artefacts are frequently accessible using present-day means, but can become more or differently visible by the way of technological development which, in turn, can create more opportunities for re- framings and re-interpretation (Westwood, 2016).
The use(s) of paradata
The analysis shows three interconnected main modes of paradata use(s) that encompass with notable congruence the authors' expressions of the purposes for turning to paradata, paradata- solvable problems and paradata use-cases (see Table 1). All modes of paradata use are rooted in the umbrella notion of paradata as something that can be used to attain transparency (e.g., Bentkowska-Kafel and Denard, 2012b; Champion, 2016; Champion and Rahaman, 2019; Reilly, et al., 2016; Saygi, et al., 2018; Schreibman and Papadopoulos, 2019). Transparency as it emerges in the studied corpus signifies the conditions that allow consumers of scholarly products to become cognizant of their production processes, that is, means used, methods employed, assumptions and prioritizations made and—for the producers of scholarly products—sufficient resources and know-how to convey the cornerstones of their intellectual work and the network of resources employed in it using documentation and description (cf. above).
Paradata use can further research robustness
The first mode of paradata use centres on research robustness. Within this mode it is argued that the transparency afforded by paradata-use offers opportunities for data producers to better make visible the methodological rigour and reliability of research studies (Abate, et al., 2017; Abdelmonem, et al., 2017; Beacham, 2011) including the settings of relevant hardware and software tools (Borrero and Stroth, 2020; Bozorgi and Lischer-Katz, 2020; Štular, et al., 2021). Beyond describing the key components of scholarly production and the resources drawn upon in that, paradata is also used to communicate underpinning hypotheses, interpretations and their degrees of uncertainty (Denard, 2012; Giles, et al., 2012; Parisi, et al., 2019; Prizeman, et al., 2020; Reilly, et al., 2016; von Schwerin, et al., 2016). Demetrescu (2015), Arnold (2008) and others argue that the use of paradata is not only descriptive but also to some degree prescriptive; the steps involved in documenting paradata in a research project can work as a device for articulating and reflecting on what assumptions, disciplinary idiosyncrasies and special-case interests and factual information that research design and carry-through are based on. Such use of paradata is implied to be a countermeasure to the 'intellectual opaqueness' (Reilly, et al., 2016, p. 39) of scholarly products by showcasing them as the result of work practices that are both deductive and inductive, rule-bound and contextually adapted (Abdelmonem, et al., 2017; Beacham, 2011; Schofield, et al., 2018; von Schwerin, et al., 2016).
Paradata use can afford data evaluation and assessment
The second mode of paradata use is closely connected to research robustness and focuses on data evaluation and assessment. Here it is implied that paradata is an affordance for users to query and appraise research data they are interested in (Carboni, et al., 2016; Champion and Rahaman, 2019; Fisher, et al., 2021; Rahaman, 2018) via data reliability (Demetrescu, 2015; Kansa, et al., 2020) and authenticity checks (Havemann, 2012). Other examples are comparisons of research designs and data analyses across multiple studies (Giles, et al., 2012) and reviews of research findings (Denard, 2012). This use of paradata in the corpus is also tied to research accountability. Paradata is described as the path towards data users being able to interrogate the bases that producers of scholarly texts, models, or other products use to found claims and considerations (Carnall, 2016; Denard, 2012; Richards-Rissetto and Landau, 2019). Another practical outcome often mentioned by the authors is how the use of paradata for the purposes of evaluation and assessment can improve the re-use potential and sustainability of scholarly products (Champion and Rahaman, 2019; De Reu, et al., 2013; Lercari, et al., 2018). Referencing 3D documentation of cultural-heritage information, Carboni, et al. (2016, p. 57) proposes that sufficient paradata could make such scholarly products be 'on par with traditional bibliographic resources' in terms of their reusability. Westwood (2016) adds to this line of reasoning and highlights that paradata-afforded reuse potential comprises both human and computer-driven re-readings.
Paradata use can facilitate cross-boundary communication
The third mode of paradata use revealed by the analysis has to do with paradata as a vehicle for communication. This rendering of paradata-use emanates from the idea that paradata can facilitate reciprocal and productive relations between the users and producers of scholarly products (Bogucka and Jahnke, 2018; Carnall, 2016; Cook, 2019). The communicative challenge that paradata can help overcome grows out of the specialized nature of research and its potentially wider use and reuse-audiences (Arnold, 2008). Demetrescu (2015) suggests that (standardized or structured) paradata can help transcend the diverging motivations, interests and disciplinary specificities that distinguish and separate user groups. Two educational benefits of using paradata to this end are discussed in the corpus. Paradata makes more visible and informative—also to practitioners from other domains—the difficulties, solutions and related deliberations underpinning every scholarly product (Carnall, 2016; Cook, 2019). Also, research results and scholarly products with competently formed paradata more naturalistically appear as being manifestations of a particular point in the overarching structure of scholarly knowledge pursuits rather than something that springs from a final state of knowing (Bentkowska-Kafel and Denard, 2012b). In addition, paradata-driven and better- quality opportunities for communication across groups and communities of users and producers of scholarly products is seen to open up avenues of multivocal interpretative efforts (Lercari, et al., 2018; Tamborrino and Wendrich, 2017) and to be a factor supporting engagement from new actors (Cook, 2019).
Discussion
Making sense of paradata
The analysis offers several insights about paradata that can be used to outline a paradata proto-definition. Table 2 shows a summary of the main findings, building and expanding upon the analytical focuses presented in Table 1.
Paradata main part | Paradata subpart | Subpart description |
---|---|---|
Elements of paradata | Aboutness | Paradata is information about productive processes |
Subject matter | Paradata is information about the network of actions, means, methods, deliberations, rationales and intellectual horizons that constitute productive processes | |
Modality | Paradata is analogue, digital, multi-format and multi-temporal | |
Organization | Paradata is structured and unstructured; embedded and stand-alone | |
Context | Paradata is discussed in the contexts of research (data), GLAM institutions and heritage issues | |
Creators | Paradata is created by human (researchers, professionals) and non-human (software, recording devices) actors | |
Conceptual family tree | Paradata is connected to the terms information, documentation, records, descriptions, metadata, provenance, workflows, pipelines, contextual information | |
Empirical referents | Paradata is found in texts, drawings, annotations, tracked-changes, audio and video recordings, code books, research diaries | |
Paradata-use praxis | Attaining transparency | Paradata use can further research robustness |
Paradata use can afford data evaluation and assessment | ||
Paradata use can facilitate cross-boundary communication | ||
Key relationships of paradata | With data | Paradata and the data it describes are reciprocally value-adding e.g., regarding interpretability |
With the productive process | Paradata is only purposive if it sufficiently describes the productive process it is connected to | |
Paradata is a shadow-play rendering of the productive process (or parts thereof) it is connected to, shaped by the rationales and means of documentation | ||
Principal uncertainties of paradata | The definition of paradata; the benefits of paradata cf. other process-description concepts; what is paradata and what is metadata; how to determine the required types and amounts of paradata; considerations of paradata users; paradata use beyond research, GLAM and heritage contexts; what is paradata-facilitated transparency |
As a whole, paradata is information about processes that operate a network of means, mental and physical actions and intellectual regimen in the creation or shaping of a(n information) product. Paradata was most often discussed teleologically in the corpus; documented with the dual intent to make the productive process interpretable across time and different contexts of (re)use, and to make visible the connections between the productive process and its end result. Paradata can also refer to activity traces or descriptions that are discreet and made without particular ends in mind. In terms of modalities, paradata can be of any informative matter and format and be created by human or non-human actors. The analysis also shows that the most frequently occurring settings of paradata discussion are research data and affiliated matters of curation, dissemination, description and heritage issues. This is a result of the study's sampling procedures. The concept of paradata has potential significance for a broad array of settings and productive efforts with different degrees of formalization. Seeing as information research exhibits an increasing interest in data (Bates, 2018; Papenmeier, et al., 2021; Yan, et al., 2020) and heritage (Booth, et al., 2021; Golub, et al., 2021; Koya and Chowdhury, 2020) however, this rather indicates the usefulness of research in archaeology and cultural-heritage studies also for further inquiries into and utilizations of paradata as an empirical referent or analytical device.
Paradata, metadata, provenance (data)
A key step when considering what paradata is and how it can be useful is to delve into how paradata affiliates with core concepts—and by association also research subfields—in information research. The findings confirm the close connection between paradata, metadata and provenance but does not offer any clear evidence regarding the connections between the concepts; they are often mentioned pairwise, metadata and paradata being the most often occurring, and without distinction (e.g., Iadanza, et al., 2019; Giovannini, 2020; Jeffrey, et al., 2020; Münster, et al., 2015; Münster, 2019; Rashid and Antlej, 2020; Tryfonos, et al., 2021). It is not clear if this signifies that the differences between the concepts in the minds of the authors are so obvious that they do not require explanation, or if this mode of reference is used to sweepingly refer to information that can enrich the scholarly product in the focus of the studies.
This study suggests that the notable divergences that mark the intersection of paradata, provenance and metadata principally stem from the concepts having distinct cognates—ties of varying strength and elasticity to patterns of established use and thought. Many divergences and differences can of course exist in definitional considerations, but in in-situ settings the concepts are partly empirically indistinguishable. Although paradata and provenance are, for example, more closely associated with descriptions of productive processes than metadata, there are few practical or theoretical constraints that would hinder using the term metadata to discuss information pertaining to the origins of an information resource (see provenance metadata, Huggett, 2012; provenance of paradata Huggett, 2020). It is similarly easy to find cases where the notion of paradata with great plausibility can be employed to designate what otherwise could be termed metadata or provenance (paradata metadata, Drachsler, et al., 2012). Metadata, then, is a powerful and often high-level term not seldom used in a context- agnostic manner to signify resource descriptors (Pomerantz, 2015). The cognates of paradata and provenance together make up a sphere of reference that is possibly narrower than that of metadata, but still large and without very clear distinctions of what sets the two concepts apart. Provenance has a history of use in the settings of archives and records-management (Bearman and Lytle, 1985), computer science (Curcin, 2017) and many other disciplines (Reilly, et al., 2021) while paradata is principally associated with survey research (Couper and Kreuter, 2013) and cultural-heritage studies (Bentkowska-Kafel, et al., 2012); both terms are employed in archaeological research (Gant and Reilly, 2018). Further, the cognates of paradata and provenance can be strikingly different when considering certain use-scenarios. Provenance is commonly applied in discussions of the origins and custody and curatorial chains of digital, digitized and physical objects and collections (Dahlström and Hansson, 2019; De Oliveira, et al., 2015). In historical archives, especially provenance data is comprised of often fairly abstract narratives of custody and origin written by archivists. A contrast can be found in the findings of this paper where paradata, perhaps owing to its ties to survey research, not seldom is comparatively more intimately associated to the specific processes as in the goal-oriented progression of discrete events and activities that constitute productive ventures in e.g., science and heritage work. An example of such paradata would be in survey-evaluation is computer-captured traces of user interaction like time-stamps, logs of revisions and choices made and user information. However, plenty of opposite examples can be found in the literature and in the results of the present study that render provenance data as recordings of discrete actions in computerized environments and (Drachsler, et al., 2012; Fear and Donaldson, 2012) and paradata as free-form descriptions of key segments of productive processes or, perhaps most commonly, as a combination of the two like in the prevalent topic of heritage and research data re-use.
Paradata in information research
This paper suggests three principal and complementary reasons why it might make analytical sense to continue exploring the concept of paradata in information research. The first reason is practical: although paradata from a holistic viewpoint appears to be difficult to empirically and theoretically distinguish from provenance, it should be noted that provenance in the archival setting in the majority of cases is used in a narrower sense that is informed and defined by archival theory and archives and records-keeping praxis. Since archival studies and the archives and record-keeping profession is a part of the information-research sphere (Bates, 2007), it makes sense to utilize the concept of paradata as a vehicle for discussing and exploring descriptions of productive processes and related issues beyond the scope of archival provenance. There is also a topical reason for why paradata can prove useful in information research: there is presently a growth of research that explores or otherwise shows an interest in information processes and process perspectives (Thomer, et al., 2018; Tognoli and Guimarães, 2020; Trace, 2011); the notion of paradata might be a useful addition to this current of work because of its emphasis on process documentation and its breadth in terms of what resources and aspects to include in process capture and provision (see Table 2).
The third reason is theoretical, multipart and rests on the implications of the present study. Table 2 and the literature analysed and referenced in this study shows that paradata is a concept with a fairly invariable core meaning—paradata is information about productive processes—complemented by a peripheral flexibility—paradata process information can draw on a wide array of resources and descriptions, from trace data to explications of intellectual horizons. These characteristics point to the potential of paradata to be a boundary object in information research, i.e., a useful notion in several subdisciplines and research avenues that also can facilitate cross-boundary communication. Connected this, paradata additionally offers theoretical contributions by highlighting certain aspects of process information. A main cognate of paradata is the multidisciplinary vein of research attempting to understand and solve the many problems that hinder purposeful re-use of scholarly data—a large research- related information challenge in the present day (Borgman, 2012; Faniel and Yakel, 2017). Paradata that allows the re-users to better grasp the data creator(s) horizon and means of work is considered to be one of the most promising solutions (Faniel, et al., 2016; Yoon, 2017). To delve into paradata as a means to facilitate transparency between data producers and data re- users raises many foundational questions pertaining to the nature of this transparency—is it, e.g., a membrane, a representation, or a prism that refracts and makes certain components of the original research process differently visible depending on their particular characteristics— and how it functions. Paradata similarly highlights that there is an ethics of conversation to explore in the mode of communication between the producers and re-users of data, where process information is a key communicative element. These ethics would be grounded in the present infrastructural, political and policymaking investments made into facilitating and promoting research data sharing in publicly-funded academic research on an international scale. Important points to consider here would be what values are built into the practices of creating and using paradata and to what extent and how these values support the intent to reduce the intellectual and sociotechnical distance (Baker and Yarmey, 2009) of data production and re-use, if the dialogue parties can be seen to engage reciprocally in a shared cooperative endeavour or if the communicative structure appears in some other way.
Conclusions
Paradata is a concept that recently has started to make appearances in information research (see e.g., Börjesson, et al., 2020; Dahlström and Hansson, 2019; Huvila, et al., 2021a). While paradata carries promise to be useful, the concept and the scope of its existing application has remained unexplored. The present paper addressed this knowledge gap by analysing the concept of paradata and how it was employed in a corpus of scholarly texts from archaeology and cultural-heritage studies—two domains where the already extended discussion of paradata is strongly linked to how the concept can be framed in information research and associated professional settings. As a scoping review, one of the objectives of this study is to be a stepping stone for further inquiries researching or using the concept of paradata. Many potentially fruitful inquiries have been suggested; see especially the paradata uncertainties outlined above and in Table 2. Continued conceptual development and insight will likely occur as paradata is applied in new ways and in areas of work outside the research-data, GLAM and heritage settings. That being said, forward-looking applications of paradata will also continue to be informed by subsequent considerations of paradata in practical and theoretical terms. Such works could choose another approach than that of the present study, where the analysis was driven by a synthetic reading of paradata literature. Options include investigations of the ruptures and liminalities of paradata in professional and scholarly use, seeking to identify when and where paradata become difficult to discern from other types of data to the effect of becoming less useful and difficult to operationalize.
Acknowledgements
This work has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme grant agreement No 818210 as a part of the project CApturing Paradata for documenTing data creation and Use for the REsearch of the future (CAPTURE).
About the authors
Dr. Olle Sköld is a senior lecturer at the Department of ALM and the director of Uppsala University's Master's Programme in Digital Humanities. His research is characterised by a broad interest in the ALM field, research data creation and use and digital humanities. He can be contacted at olle.skold@abm.uu.se.
Dr. Lisa Börjesson works as a researcher at the Department of ALM at Uppsala University in Sweden. Her research focuses on research information including research information management systems, data descriptions, data publishing and use. She can be contacted at lisa.borjesson@abm.uu.se.
Isto Huvila is professor in Information Studies at the Department of ALM, Uppsala University in Sweden. Huvila chaired the recently closed COST Action ARKWORK and is directing the ERC funded research project CAPTURE. His primary areas of research include information and knowledge management, information work, knowledge organisation,
documentation and social and participatory information practices. He can be contacted at
isto.huvila@abm.uu.se.
References
- Abate, D., Avgousti, A., Faka, M., Hermon, S., Bakirtzis, N. & Christofi, P. (2017). An online 3D database system for endangered architectural and archaeological heritage in the South-Eastern Mediterranean. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLII-2/W3, 3D Virtual Reconstruction and Visualization of Complex Architectures, Nafplio, Greece, 1–3 March 2017, 1-8. https://doi.org/10.5194/isprs-archives-XLII-2-W3-1-2017
- Abbott, A. (1988). Transcending general linear reality. Sociological Theory, 6(2), 169-186. https://doi.org/10.2307/202114
- Abdelmonem, M. G., Selim, G., Mushatat, S. & Almogren, A. (2017). Virtual platforms for heritage preservation in the Middle East: the case of medieval Cairo. International Journal of Architectural Research: ArchNet-IJAR, 11(3), 28-41. https://doi.org/10.26687/archnet-ijar.v11i3.1404
- Arksey, H., O’Malley, L., Baldwin, S., Harris, J., Newbronner, E., Hare, P. & Mason, A. (2002). Literature review report: services to support carers of people with mental health problems. National Co-ordinating Centre for NHS Service Delivery and Organisation. https://eprints.whiterose.ac.uk/73297
- Arnold, D. (2008). Cultural heritage as a vehicle for basic research in computing science: Pasteur’s quadrant and a use-inspired basic research agenda. Computer Graphics Forum, 27(8), 2188-2196. https://doi.org/10.1111/j.1467-8659.2008.01195.x
- Baker, K. S. & Yarmey, L. (2009). Data stewardship: environmental data curation and a web-of-repositories. International Journal of Digital Curation, 4(2), 12-27. https://tsc.library.ubc.ca/index.php/christineslais/article/view/44
- Baldwin, M. A. & Rose, P. (2009). Concept analysis as a dissertation methodology. Nurse Education Today, 29(7), 780-783. https://doi.org/10.1016/j.nedt.2009.03.009
- Bates, J. (2018). The politics of data friction. Journal of Documentation, 74(2), 412-429. https://doi.org/10.1108/JD-05-2017-0080
- Bates, M. J. (2007). Defining the information disciplines in encyclopedia development. Information Research, 12(4). https://InformationR.net/ir/12-4/colis/colis29.html (Archived by the Internet Archive at https://web.archive.org/web/20220319201656/https://InformationR.net/ir/12-4/colis/colis29.html)
- Beacham, R. C. (2011). Concerning the paradox of paradata. Or, “I don’t want realism; I want magic!”. Virtual Archaeology Review, 2(4), 49-52. (https://dialnet.unirioja.es/servlet/articulo?codigo=3873293)
- Bearman, D. A. & Lytle, R. H. (1985). The power of the principle of provenance. Archivaria, 21(Winter 1985-86), 14-27. https://archivaria.ca/index.php/archivaria/article/view/11231 (Archived by the Internet Archive at https://web.archive.org/web/20220515121828/https://archivaria.ca/index.php/archivaria/article/view/11231)
- Bentkowska-Kafel, A. (2013). “I bought a piece of Roman furniture on the Internet. It’s quite good but low on polygons.”—digital visualization of cultural heritage and its scholarly value in art history. Visual Resources, 29(1-2), 38-46. https://doi.org/10.1080/01973762.2012.761117
- Bentkowska-Kafel, A. & Denard, H. (2012a). Introduction. In A. Bentkowska-Kafel, H. Denard &D. Baker (Eds.), Paradata and transparency in virtual heritage (pp. 1-4). Routledge. https://doi.org/10.4324/9781315599366
- Bentkowska-Kafel, A. & Denard, H. (2012b). Processual scholia: the importance of paradata in heritage visualization. In A. Bentkowska-Kafel, H. Denard & D. Baker (Eds.), Paradata and transparency in virtual heritage (pp. 320-335). Routledge. https://doi.org/10.4324/9781315599366
- Bentkowska-Kafel, A., Denard, H. & Baker, D. (Eds.). (2012). Paradata and transparency in virtual heritage. Routledge. https://doi.org/10.4324/9781315599366
- Berg, M. & Goorman, E. (1999). The contextual nature of medical information. International Journal of Medical Informatics, 56(1), 51-60. https://doi.org/10.1016/S1386-5056(99)00041-6
- Bogucka, E. P. & Jahnke, M. (2018). Feasibility of the space–time cube in temporal cultural landscape visualization. ISPRS International Journal of Geo-Information, 7(6). https://doi.org/10.3390/ijgi7060209
- Booth, P., Navarrete, T. & Ogundipe, A. (2021). Museum open data ecosystems: a comparative study. Journal of Documentation. https://doi.org/10.1108/JD-05-2021-0102
- Borgman, C. L. (2012). The conundrum of sharing research data. Journal of the American Society for Information Science and Technology, 63(6), 1059-1078. https://doi.org/10.1002/asi.22634
- Borrero, M. & Stroth, L. (2020). A proposal for the standardized reporting of error and paradata regarding structure from motion (SfM) 3D models used in recording and consolidating archaeological architecture. Advances in Archaeological Practice, 8(4), 376-388. https://doi.org/10.1017/aap.2020.11
- Bozorgi, K. and Lischer-Katz, Z. (2020). Using 3D/VR for research and cultural heritage preservation: project update on the Virtual Ganjali Khan Project. Preservation, Digital Technology & Culture, 49(2), 45-57. https://doi.org/10.1515/pdtc-2020-0017
- Börjesson, L., Sköld, O. & Huvila, I. (2020). Paradata in Documentation Standards and Recommendations for Digital Archaeological Visualisations. Digital Culture and Society, 6(2),191-220. https://doi.org/10.14361/dcs-2020-0210
- Buchanan, S. A. (2016). A provenance research study of archaeological curation. [Unpublished doctoral dissertation]. University of Texas at Austin, Austin, TX. (https://hdl.handle.net/2152/44000)
- Carboni, N., Bruseker, G., Guillem, A., Bellido Castañeda, D., Coughenour, C., Domajnko, M., de Kramer, M., Ramos Calles, M. M., Stathopoulou, E. K. & Suma, R. (2016). Data provenance in photogrammetry through documentation protocols. XXIII ISPRS Congress, Prague, Czech Republic, July 2016. https://hal.archives-ouvertes.fr/hal-02548591
- Carnall, M. (2016). Walking with dragons: CGIs in wildlife ‘Documentaries’. In A. Bentkowska- Kafel, H. Denard & D. Baker (Eds.), Paradata and transparency in virtual heritage (pp. 107-120). Routledge. https://doi.org/10.4324/9781315599366
- Champion, E. (2016). Critical gaming: interactive history and virtual heritage. Routledge.
- Champion, E. & Rahaman, H. (2019). 3D digital heritage models as sustainable scholarly resources. Sustainability, 11(8). https://doi.org/10.3390/su11082425
- Charmaz, K. (1983). The grounded theory method: an explication and interpretation. In R. M. Emerson (Ed.), Contemporary field research (pp. 109-126). Waveland Press.
- Cook, K. (2019). EmboDIYing disruption: queer, feminist and inclusive digital archaeologies. European Journal of Archaeology, 22(3), 398-414. https://doi.org/10.1017/eaa.2019.23
- Corbin, J. M. & Strauss, A. (1990). Grounded theory research: procedures, canons, and evaluative criteria. Qualitative Sociology, 13(1), 3-21. https://doi.org/10.1007/BF00988593
- Couper, M. P. (2000). Usability evaluation of computer-assisted survey instruments. Social Science Computer Review, 18(4), 384-396. https://doi.org/10.1177/089443930001800402
- Couper, M. P. & Kreuter, F. (2013). Using paradata to explore item level response times in surveys. Journal of the Royal Statistical Society: Series A (Statistics in Society), 176(1), 271-286. https://doi.org/10.1111/j.1467-985X.2012.01041.x
- Curcin, V. (2017). Embedding data provenance into the Learning Health System to facilitate reproducible research. Learning Health Systems, 1(2). https://doi.org/10.1002/lrh2.10019
- Dahlström, M. & Hansson, J. (2019). Documentary provenance and digitized collections. Proceedings from the Document Academy, 6(1). https://doi.org/10.35492/docam/6/1/8
- Davidson, S. B. & Freire, J. (2008). Provenance and scientific workflows: challenges and opportunities. Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, 1345-1350. https://doi.org/10.1145/1376616.1376772
- De Oliveira, D., Silva, V. & Mattoso, M. (2015). How much domain data should be in provenance databases? Proceedings of the 7th USENIX Conference on Theory and Practice of Provenance, Edinburgh, Scotland, 8-9 July 2015. https://www.usenix.org/conference/tapp15/workshop-program/presentation/de-oliveira (Archived by the Internet Archive at https://web.archive.org/web/20220515122732/https://www.usenix.org/conference/tapp15/workshop-program/presentation/de-oliveira)
- De Reu, J., Plets, G., Verhoeven, G., De Smedt, P., Bats, M., Cherretté, B., De Maeyer, W., Deconynck, J., Herremans, D., Laloo, P., Van Meirvenne, M. & De Clercq, W. (2013). Towards a three-dimensional cost-effective registration of the archaeological heritage. Journal of Archaeological Science, 40(2), 1108-1121. https://doi.org/10.1016/j.jas.2012.08.040
- Demetrescu, E. (2015). Archaeological stratigraphy as a formal language for virtual reconstruction. Theory and practice. Journal of Archaeological Science, 57, 42-55. https://doi.org/10.1016/j.jas.2015.02.004
- Denard, H. (2012). A new introduction to the London Charter. In A. Bentkowska-Kafel, H. Denard & D. Baker (Eds.), Paradata and transparency in virtual heritage (pp. 57-71). Routledge. https://doi.org/10.4324/9781315599366
- Di Giulio, R., Maietti, F., Piaia, E., Medici, M., Ferrari, F. & Turillazzi, B. (2017). Integrated data capturing requirements for 3D semantic modelling of cultural heritage: the INCEPTION protocol. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLII-2/W3, 3D Virtual Reconstruction and Visualization of Complex Architectures, Nafplio, Greece, 1–3 March 2017, 251-257. https://doi.org/10.5194/isprs-archives-XLII-2-W3-251-2017
- DiCenso, A., Martin-Misener, R., Bryant-Lukosius, D., Bourgeault, I., Kil- patrick, K., Donald, F., Kaasalainen, S., Harbman, P., Carter, N., Kioke, S., Abelson, J., McKinlay, R. J., Pasic, D., Wasyluk, B., Vohra, J. & Charbonneau-Smith, R. (2010). Advanced practice nursing in Canada: overview of a decision support synthesis. Nursing Leadership, 23(special issue), 15-34. https://doi.org/10.12927/cjnl.2010.22267
- Drachsler, H., Greller, W., Fazeli, S., Niemann, K., Sanchez-Alonso, S., Rajabi, E., Palmér, M., Ebner, H., Simon, B., Nösterer, D., Kastrantas, K., Manouselis, N. & Hatzakis, I. (2012). D8.1 Review of social data requirements. Open Discovery Space. bit.ly/3wvG8Kw (Archived by the Internet Archive at https://bit.ly/3a6fWi9)
- Faniel, I., Kansa, E., Whitcher Kansa, S., Barrera-Gomez, J. & Yakel, E. (2013). The challenges of digging data: a study of context in archaeological data reuse. Proceedings of the 13th ACM/IEEE-CS Joint Conference on Digital Libraries, 295-304. https://doi.org/10.1145/2467696.2467712
- Faniel, I. & Yakel, E. (2017). Practices do not make perfect: disciplinary data sharing and reuse practices and their implications for repository data curation. In L. R. Johnston (Ed.), Curating research data, volume one: practical strategies for your data repository (pp. 103-126). ACRL.
- Faniel, I. M., Kriesberg, A. & Yakel, E. (2016). Social scientists’ satisfaction with data reuse. Journal of the Association for Information Science and Technology, 67(6), 1404-1416. https://doi.org/10.1002/asi.23480
- Fear, K. & Donaldson, D. R. (2012). Provenance and credibility in scientific data repositories. Archival Science, 12(3), 319-339. https://doi.org/10.1007/s10502-012-9172-7
- Figuerola, C. G., García Marco, F. J. & Pinto, M. (2017). Mapping the evolution of library and information science (1978-2014) using topic modeling on LISA. Scientometrics, 112(3), 1507-1535. https://doi.org/10.1007/s11192-017-2432-9
- Fisher, M., Fradley, M., Flohr, P., Rouhani, B. & Simi, F. (2021). Ethical considerations for remote sensing and open data in relation to the endangered archaeology in the Middle East and North Africa project. Archaeological Prospection, 28(3), 279-292. https://doi.org/10.1002/arp.1816
- Gant, S. & Reilly, P. (2018). Different expressions of the same mode: a recent dialogue between archaeological and contemporary drawing practices. Journal of Visual Art Practice, 17(1), 100-120. https://doi.org/10.1080/14702029.2017.1384974
- Gasparetto, F. & Baratin, L. (2021). Conservation 4.0. Possible guidlines for standardising the documental process for artistic heritage. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLVI-M-1-2021, 28th CIPA Symposium Great Learning & Digital Emotion, Beijing, China, 28 August-1 September 2021, 257-264. https://doi.org/10.5194/isprs-archives-XLVI-M-1-2021-257-2021
- Giles, K., Masinton, A. & Arnott, G. (2012). Visualising the Guild Chapel, Stratford-upon-Avon: digital models as research tools in buildings archaeology. Internet Archaeology, 32. https://doi.org/10.11141/ia.32.1
- Giovannini, E. C. (2020). Workflow for an evidence-based virtual reconstruction: the marbles of the ciborium of the early medieval Monte Sorbo Church. The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 43, 1395-1402. https://doi.org/10.5194/isprs-archives-XLIII-B2-2020-1395-2020
- Golub, K., Ziolkowski, P. M. & Zlodi, G. (2021). Organizing subject access to cultural heritage in Swedish online museums. Journal of Documentation, 78(7), 211-247. https://doi.org/10.1108/JD-05-2021-0094
- Havemann, S. (2012). Intricacies and potentials of gathering paradata in the 3D modelling workflow. In A. Bentkowska-Kafel, H. Denard & D. Baker (Eds.), Paradata and transparency in virtual heritage (pp. 145-160). Routledge. https://doi.org/10.4324/9781315599366
- Havemann, S., Settgast, V., Berndt, R., Eide, B. & Fellner, D. W. (2009). The arrigo showcase reloaded–towards a sustainable link between 3D and semantics. Journal on Computing and Cultural Heritage, 2(1), 1-13. https://doi.org/10.1145/1551676.1551680
- Huggett, J. (2020). Capturing the silences in digital archaeological knowledge. Information, 11(5). https://doi.org/10.3390/info11050278
- Huvila, I. (2012). The unbearable complexity of documenting intellectual processes: paradata and virtual cultural heritage visualisation. Human IT, 12(1), 97-110. https://humanit.hb.se/article/view/96/82 (Archived by the Internet Archive at https://web.archive.org/web/20220515123409/https://humanit.hb.se/article/view/96/82)
- Huvila, I.(2021). Monstrous hybridity of social information technologies: through the lens of photorealism and non-photorealism in archaeological visualization. The Information Society, 37(1), 46-59. https://doi.org/10.1080/01972243.2020.1830211
- Huvila, I., Greenberg, J., Sköld, O., Thomer, A., Trace, C. & Zhao, X. (2021a). Documenting information processes and practices: paradata, provenance metadata, life-cycles and pipelines. Proceedings of the Association for Information Science and Technology, 58(1), 604-609. https://doi.org/10.1002/pra2.509
- Huvila, I. & Sköld, O. (2021). Choreographies of making archaeological data. Open Archaeology, 7(1), 1602-1617. https://doi.org/10.1515/opar-2020-0212
- Huvila, I., Sköld, O. & Börjesson, L. (2021b). Documenting information making in archaeological field reports. Journal of Documentation, 77(5), 1107-1127. https://doi.org/10.1108/JD-11-2020-0188
- Iadanza, E., Maietti, F., Ziri, A. E., Di Giulio, R., Medici, M., Ferrari, F., Bon- sma, P. & Turillazzi, B. (2019). Semantic web technologies meet BIM for accessing and understanding cultural heritage. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLII-2/W9, 8th Intl. Workshop 3D-ARCH, 3D Virtual Reconstruction and Visualization of Complex Architectures, Bergamo, Italy, 6–8 February 2019, 381-388. https://doi.org/10.5194/isprs-archives-XLII-2-W9-381-2019
- Jeffrey, S., Jones, S., Maxwell, M., Hale. A. & Jones, C. (2020). 3D visualisation, communities and the production of significance. International Journal of Heritage Studies, 26(9), 885-900. https://doi.org/10.1080/13527258.2020.1731703
- Kansa, S., Atici, L., Kansa, E. & Meadow, R. (2020). Archaeological analysis in the information age: guidelines for maximizing the reach, comprehensiveness, and longevity of data. Advances in Archaeological Practice, 8(1), 40-52. https://doi.org/10.1017/aap.2019.36
- Kim, Y. & Yoon, A. (2017). Scientists’ data reuse behaviors: a multilevel analysis. Journal of the Association for Information Science and Technology, 68(12), 2709-2719. https://doi.org/10.1002/asi.23892
- Koya, K. & Chowdhury, G. (2020). Cultural heritage information practices and iSchools education for achieving sustainable development. Journal of the Association for Information Science and Technology, 71(6), 696-710. https://doi.org/10.1002/asi.24283
- Kreuter, F. & Casas-Cordero, C. (2010). Paradata. German Council for Social and Economic Data.
- Lercari, N., Shiferaw, E., Forte, M. & Kopper, R. (2018). Immersive visualization and curation of archaeological heritage data: Çatalhöyük and the Dig@IT app. Journal of Archaeological Method and Theory, 25(2), 368-392. https://doi.org/10.1007/s10816-017-9340-4
- Llamas, J., M. Lerones, P., Medina, R., Zalama, E. & Gómez-García-Bermejo, J. (2017). Classification of architectural heritage images using deep learning techniques. Applied Sciences, 7(10). https://doi.org/10.3390/app7100992
- Lo Turco, M., Calvano, M. & Giovannini, E. C. (2019). Data modelling for museum collections. The Sciences, Volume XLII-2/W9, 8th Intl. Workshop 3D-ARCH, 3D Virtual Reconstruction and Visualization of Complex Architectures, Bergamo, Italy, 6–8 February 2019, 433-440. https://doi.org/10.5194/isprs-archives-XLII-2-W9-381-2019
- MacNeil, H. (2008). Archivalterity: rethinking original order. Archivaria, 66(1), 1-24. https://archivaria.ca/index.php/archivaria/article/view/13190 (Archived by the Internet Archive at https://web.archive.org/web/20220515123529/https://archivaria.ca/index.php/archivaria/article/view/13190)
- Maines, D. R. (1993). Narrative’s moment and sociology’s phenomena: toward a narrative sociology. The Sociological Quarterly, 34(1), 17-38. https://doi.org/10.1111/j.1533-8525.1993.tb00128.x
- McEwen Arnold, J. D. & Lafreniere, D. (2018). Creating a longitudinal, data-driven 3D model of change over time in a postindustrial landscape using GIS and CityEngine. Journal of Cultural Heritage Management and Sustainable Development, 8(4), 434-447. https://doi.org/10.1108/JCHMSD-08-2017-0055
- Moore, H. L. (2004). Global anxieties: concept-metaphors and pre-theoretical commitments in anthropology. Anthropological Theory, 4(1), 71-88. https://doi.org/10.1177/1463499604040848
- Mudge, M. (2012). Transparency for empirical data. In A. Bentkowska-Kafel, H. Denard & D. Baker (Eds.), Paradata and transparency in virtual heritage (pp. 252-263). Routledge. https://doi.org/10.4324/9781315599366
- Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A. & Aromataris, E. (2018). Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 18(1), 143. https://doi.org/10.1186/s12874-018-0611-x
- Münster, S., Kuroczyński, P., Pfarr-Harfst, M., Grellert, M. & Lengyel, D. (2015). Future research challenges for a computer-based interpretative 3D reconstruction of cultural heritage - a german community’s view. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 207-213. https://doi.org/10.5194/isprsannals-II-5-W3-207-2015
- Münster, S. (2019). Digital heritage as a scholarly field—topics, researchers, and perspectives from a bibliometric point of view. Journal on Computing and Cultural Heritage, 12(3), 1-27. https://doi.org/10.1145/3310012
- Nicolaas, G. (2011). Survey paradata: a review. ESRC National Centre for Research Methods. https://eprints.ncrm.ac.uk/id/eprint/1719
- Nolin, J. & Åström, F. (2010). Turning weakness into strength: strategies for future LIS. Journal of Documentation, 66(1), 7-27. https://doi.org/10.1108/00220411011016344
- Nuopponen, A. (2010a). Methods of concept analysis - a comparative study. LSP Journal, 1(1), 4-12. https://rauli.cbs.dk/index.php/lspcog/article/view/2970 (Archived by the Internet Archive at https://web.archive.org/web/20220515123700/https://rauli.cbs.dk/index.php/lspcog/article/view/2970)
- Nuopponen, A. (2010b). Methods of concept analysis - towards systematic concept analysis. LSP Journal, 1(2), 5-14. https://rauli.cbs.dk/index.php/lspcog/article/view/3092 (Archived by the Internet Archive at https://web.archive.org/web/20220515123828/https://rauli.cbs.dk/index.php/lspcog/article/view/3092)
- Nuopponen, A. (2011). Methods of concept analysis-tools for systematic concept analysis. LSP Journal, 2(1), 4-15. https://rauli.cbs.dk/index.php/lspcog/article/view/3302 (Archived by the Internet Archive at https://web.archive.org/web/20220515123939/https://rauli.cbs.dk/index.php/lspcog/article/view/3302)
- Papenmeier, A., Krämer, T., Friedrich, T., Hienert, D. & Kern, D. (2021). Genuine information needs of social scientists looking for data. Proceedings of the Association for Information Science and Technology, 58(1), 292-302. https://doi.org/10.1002/pra2.457
- Parisi, P., Lo Turco, M. & Giovannini, E. C. (2019). The value of knowledge through H-BIM models: historic documentation with a semantic approach. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLII-2/W9, 8th Intl. Workshop 3D-ARCH, 3D Virtual Reconstruction and Visualization of Complex Architectures, Bergamo, Italy, 6–8 February 2019, 581-588. https://doi.org/10.5194/isprs-archives-XLII-2-W9-381-2019
- Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D. & Soares, C. B. (2015). Guidance for conducting systematic scoping reviews. International Journal of Evidence-Based Healthcare, 13(3), 141-146. https://doi.org/10.1097/XEB.0000000000000050
- Pham, M. T., Rajić, A., Greig, J. D., Sargeant, J. M., Papadopoulos, A. & McEwen, S. A. (2014). A scoping review of scoping reviews: advancing the approach and enhancing the consistency. Research Synthesis Methods, 5(4), 371-385. https://doi.org/10.1002/jrsm.1123
- Pomerantz, J. (2015). Metadata. MIT Press.
- Prizeman, O., Pezzica, C., Taher, A. and Boughanmi, M. (2020). Networking historic environmental standards to address modern challenges for sustainable conservation in HBIM. Applied Sciences, 10(4). https://doi.org/10.3390/app10041283
- Rahaman, H. (2018). Digital heritage interpretation: a conceptual framework. Digital Creativity, 29(2-3), 208-234. https://doi.org/10.1080/14626268.2018.1511602
- Rashid, M. M. & Antlej, K. (2020). Geospatial platforms and immersive tools for social cohesion: the 4D narrative of architecture of Australia’s Afghan cameleers. Virtual Archaeology Review, 11(22), 74-84. https://doi.org/10.4995/var.2020.12230
- Reilly, P., Callery, S., Dawson, I. & Gant, S. (2021). Provenance illusions and elusive paradata: when archaeology and art/archaeological practice meets the phygital. Open Archaeology, 7(1), 454-481. https://doi.org/10.1515/opar-2020-0143
- Reilly, P., Todd, S. & Walter, A. (2016). Rediscovering and modernising the digital Old Minster of Winchester. Digital Applications in Archaeology and Cultural Heritage, 3(2), 33-41. https://doi.org/10.1016/j.daach.2016.04.001
- Richards-Rissetto, H. & Landau, K. (2019). Digitally-mediated practices of geospatial archaeological data: transformation, integration, & interpretation. Journal of Computer Applications in Archaeology, 2(1), 120-135. https://doi.org/10.5334/jcaa.30
- Ridener, J. (2009). From polders to postmodernism: a concise history of archival theory. Litwin Books.
- Rodgers, B. L. & Knafl, K. A. (Eds.). (1993). Concept development in nursing: foundations, techniques, and applications. Saunders.
- Saygi, G., Agugiaro, G. & Hamamcioglu-Turan, M. (2018). Behind the 3D scene: a GIS approach for managing the chronological information of historic buildings. Multimodal Technologies and Interaction, 2(2). https://doi.org/10.3390/mti2020026
- Schreibman, S. & Papadopoulos, C. (2019). Textuality in 3D: three-dimensional (re)constructions as digital scholarly editions. International Journal of Digital Humanities, 1, 221-233. https://doi.org/10.1007/s42803-019-00024-6
- Schofield, G., Beale, G., Beale, N., Fell, M., Hadley, D., Hook, J., Murphy, D., Richards, J. & Thresh, L. (2018). Viking VR: designing a virtual reality experience for a museum. Proceedings of the 2018 Designing Interactive Systems Conference, 805-815. https://doi.org/10.1145/3196709.3196714
- Sköld, O., Huvila, I. & Börjesson, L. (forthcoming). Paradata. Knowledge Organization and ISKO Encyclopedia of Knowledge Organization.
- Štular, B., Eichert, S. & Lozić, E. (2021). Airborne LiDAR point cloud processing for archaeology. Pipeline and QGIS toolbox. Remote Sensing, 13(16). https://doi.org/10.3390/rs13163225
- Sweeney, S. (2008). T he ambiguous origins of the archival principle of "provenance". Libraries & the Cultural Record, 43(2), 193-213. https://www.jstor.org/stable/25549475
- Tamborrino, R. & Wendrich, W. (2017). Cultural heritage in context: the temples of Nubia, digital technologies and the future of conservation. Journal of the Institute of Conservation, 40(2), 168-182. https://doi.org/10.1080/19455224.2017.1321562
- ten Harkel, L. & Fisher, M. T. (2021). The EAMENA database and its potential impact on research and heritage management: a case study of Crusader heritage in Lebanon. Levant. https://doi.org/10.1080/00758914.2021.1988474
- Thomer, A. K., Wickett, K. M., Baker, K. S., Fouke, B. W. & Palmer, C. L. (2018). Documenting provenance in noncomputational workflows: research process models based on geobiology fieldwork in Yellowstone National Park. Journal of the Association for Information Science and Technology, 69(10), 1234-1245. https://doi.org/10.1002/asi.24039
- Tognoli, N. & Guimarães, J. A. C. (2020). Provenance as a knowledge organization principle. KO KNOWLEDGE ORGANIZATION, 46(7), 558-568. https://doi.org/10.5771/0943-7444-2019-7-558
- Trace, C. B. (2011). Documenting work and working documents: perspectives from workplace studies, CSCW, and genre studies. 2011 44th Hawaii International Conference on System Sciences, 1-10. https://doi.org/10.1109/HICSS.2011.170
- Tricco, A. C., Lillie, E., Zarin, W., O’Brien, K., Colquhoun, H., Kastner, M., Levac, D., Ng, C., Sharpe, J. P. & Wilson, K. (2016). A scoping review on the conduct and reporting of scoping reviews. BMC Medical Research Methodology, 16(1), 1-10. https://doi.org/10.1186/s12874-016-0116-4
- Tryfonos, G., Ioannides, M., Anastasi, A. G., Apostolou, V. A., Pieri, P. P., Koundouris, M. A. & Savva, F. G. (2021). Cultural heritage monument documentation through adaptive parametric design process. The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 46, 769-776. https://doi.org/10.5194/isprs-archives-XLVI-M-1-2021-769-2021
- Tschan, R. (2002). A comparison of Jenkinson and Schellenberg on appraisal. The American Archivist, 65(2), 176-195. https://doi.org/10.17723/aarc.65.2.920w65g3217706l1
- Tuomaala, O., Järvelin, K. & Vakkari, P. (2014). Evolution of library and information science, 1965-2005: content analysis of journal articles. Journal of the Association for Information Science and Technology, 65(7), 1446-1462. https://doi.org/10.1002/asi.23034
- von Schwerin J., Lyons M., Loos L., Billen N., Auer M. & Zipf A. (2016) Show me the data!: structuring archaeological data to deliver interactive, transparent 3D reconstructions in a 3D WebGIS. In S. Münster, M. Pfarr-Harfst, P. Kuroczyński & M. Ioannides (Eds.), 3D research challenges in cultural heritage II (pp. 198-230). Springer. https://doi.org/10.1007/978-3-319-47647-6_10
- Wallis, J. C., Rolando, E. & Borgman, C. L. (2013). If we share data, will anyone use them? Data sharing and reuse in the long tail of science and technology. PLOS ONE, 8(7). https://doi.org/10.1371/journal.pone.0067332
- West, B. T. (2011). Paradata in survey research. Survey Practice, 4(4). https://doi.org/10.29115/SP-2011-0018
- Westwood, M. (2016). Technology, time, transposition. Journal of Visual Art Practice, 15(2-3), 214-226. https://doi.org/10.1080/14702029.2016.1228892
- Yan, A., Huang, C., Lee, J.-S. & Palmer, C. L. (2020). Cross-disciplinary data practices in earth system science: aligning services with reuse and reproducibility priorities. Proceedings of the Association for Information Science and Technology, 57(1). https://doi.org/10.1002/pra2.218
- Yoon, A. (2017). Data reusers’ trust development. Journal of the Association for Information Science and Technology, 68(4), 946-956. https://doi.org/10.1002/asi.23730