Balancing ideology and feasibility: a case study on adopting and evaluating open access publishing models for a society journal within philosophy
Yrsa Neuman, and Mikael Laakso
Introduction. Open access, the notion that research output, such as journal articles, should be freely accessible to readers on the Web, is arguably in the best interest of science. In this article, we (1) describe in-depth how a society-owned philosophy journal, Nordic Wittgenstein Review, evaluated various publishing models and made an informed decision on how best to adopt open access publishing for the journal, and (2) develop and implement measures to evaluate the chosen model.
Method. This case study uses reports from editorial board members (mainly the editor-in-chief), Web access metrics as well as a Web survey to the journal community as well as the wider philosophy research community.
Analysis. After two years as a delayed open access journal with commercial publishers, the journal made a decision to become an independent scholar-run journal without fees to readers or authors, and which would rely mainly on volunteer effort with university faculty support. This decision was made after evaluating various publishing scenarios and negotiating with potential publishers. This study breaks down what is involved in terms of input and effort compared to having handed over the publishing of the journal to an external publisher.
Conclusions. For an open access journal choosing between publishing models, elements of ideology and feasibility need to be balanced. This article provides an overview of relevant elements and some means to judge feasibility in journal publishing endeavours.
Publishing is a core component of scholarly communication, and peer-reviewed journals are the prime outlet for reporting on scientific advances. Over the last two centuries, the volume of articles published in scholarly journals has been increasing steadily at a pace of 3-3.5% annually, to the status of today with over 28,000 active journals publishing over 2.5 million articles a year (Ware and Mabe 2015). From a global perspective, scholarly journal publishing has become clustered into a market demonstrating oligopolistic tendencies: a few large publishers own the majority of the produced material, fuelled by scholarly societies handing over publishing activities to be managed by commercial publishers (Larivière, Haustein and Mongeon 2015). Paradoxically, this gradual infusion of profit-maximising interests into scholarly journal publishing is built on the notion of scholars handing over manuscripts, conducting peer-review, and managing editorial tasks on behalf of journals without direct financial compensation.
Intertwined with the overall growth of scholarly journal publishing, there is the development of open access (Laakso 2014), which at its core means that research publications are made free to read and access through the Web. In the case of journals, which is the focus of this study, it means omitting the traditional reader-side subscription or pay-per-view costs. Since open access means free to readers, the publication services of a journal should be kept running through mechanisms other than subscription fees. Research funders, governments, and universities are increasingly facilitating open access through science policy (Swan, Gargouri, Hunt and Harnad 2015).
Independently of the publishing model, several fundamental ingredients are required for the making of a successful and thriving journal. Some of the necessary steps in creating a healthy outlet for research include; an engaged and respected editorial board, capability to attract high-quality submissions of relevant research, and obtaining motivated reviewers who conduct an ethically sound review process (Solomon 2008). Once a sufficient track record of publications and citations to published articles have been established, a journal should apply for inclusion in indexing services (Fortney and Murphy 2016). In addition to facilitating discovery of content, having a journal indexed by Scopus and Web of Science can attract more authors and higher-quality manuscripts since outlet indexing and associated metrics are integrated into research evaluation in various disciplines and universities. It is also increasingly important for journals to be included in national classification schemes for publication channels, which influence university funding and, thus, publication behaviour, such as the Finnish Publication Forum or Norway's Register for Scientific Journals, Series and Publishers While some elements of a thriving journal are quickly summarised here, their realisation likely takes years for journals to fulfil, during which time the initial enthusiasm for establishing the journal may fade among the central founders.
Crawford (2002) coined the term arc of enthusiasm to describe the publication activity traits of several early independent scholar-run open access journals, where many journals started strong but for one reason or another ceased publication within a few years. In a recent longitudinal study of independent scholar-run open access journals, Björk, Shen and Laakso (2016) found that slightly over half (56%) of a cohort of such journals (N=226) founded during 2002 or earlier were still actively publishing in 2014. Most journals included in the study survived their first 2-5 years from founding, however, the 6-9 year period proved to be a very critical period. After this period, the number of journals ceasing had clearly dropped, indicating that the surviving journals had found stability. Out of the 226 journals, 11 had become subscription-based through major international publishers. These quantitative measures provide a bird’s-eye view on the situation. Morrison (2016) conducted interviews and focus groups with fifteen participants involved in producing small scholar-led journals that either are, or would like to become open access. From the responses of journals it is clear that the circumstances for adopting open access publishing varies greatly between journals. For most journals such a transition was revealed to contain major uncertainty with regard to financial aspects, but also editorial staff support and foreseen community response were issues perceived to inhibit a transition to open access (Morrison 2016). Hence, when a journal adopts an open access publishing model in whatever form, it should be done with well-planned consideration for many of the implications of such a decision to ensure that foreseeable feasibility issues will not shorten the lifespan of the journal.
The many avenues available for existing subscription-based journals considering a transition to open access were recently reviewed by Solomon, Laakso and Björk (2016). The review highlighted the difficulty in formulating universally applicable processes of publication model transformation. For example, organizational differences between research disciplines have consequences for the success of the different publication and business models available in academic publishing: the viability of author-funded open access models may depend on whether a discipline has a wealth of externally funded research projects, making it easier to fund author-side fees in publishing such as APCs (article processing charges) in open access journals. Contextual factors such as popularity of the journal among authors and readers, relative importance of subscription income, existence of a print edition, and availability of external funding for supporting publication activities all influence the range of available potentially sustainable options.
For journals starting out as open access, the situation is different than for journals and communities considering transformation of an existing journal to open access. For newly-founded open access journals, one primary concern is how to stand out from the crowd of thousands of other open access journals, and to present themselves as a reputable outlet despite not yet having a track record to show for it. The goals of the journal will influence what needs to be considered. Is open access as a fundamental ideal valued as important? Does the journal aim to increase the quality of published material over time, increase the amount of papers published in a topic-specific research community, or simply to increase profits? The review by Solomon, Laakso and Björk (2016) highlighted that there is a lack of thorough accounts of journals which have transitioned to open access, accounts in which the process before, during, and after the transition is thoroughly documented and analysed. Their finding that one size does not fit all is one of the main motivations for initiating the case study that is provided in this paper. There is a growing body of scholarly literature available describing how individual journals have adopted open access publishing in some form. Bailey (2010) lists 46 such case studies. Baileys’ list has since been integrated into the wider and more frequently updated Open Access Directory as part of an all-encompassing open access bibliography. While impossible to review every journal case study in this paper, the most influential and relevant previous studies are summarised below.
Björk and Turk (2006) present a case study concerning an independent scholar-run open access journal entitled Journal of Information Technology in Construction (ITcon) (http://www.itcon.org) which has been publishing actively since 1996. The journal is still publishing based on the same model, although the original proprietary Web platform has been exchanged for Open Journal Systems (OJS). In addition to describing the history and editorial processes of the journal the case study focuses mainly on Web access metrics regarding the distribution of article downloads. Solomon (2007) provides a case study based on Medical Education Online (http://med-ed-online.net). This journal began publishing in 1996 as an independent scholar-run open access journal, which has since made a publishing agreement with a professional open access publisher, Co-Action publishing. Co-Action merged with Taylor and Francis in 2016 and the journal currently requests an APC of €1562. The study is a good example of how the different aspects of a journal’s activities can be chronicled transparently both chronologically and thematically. Caveleri, Keren, Ramello and Valli (2009) describe the history and experiences of the first six years of the European Journal of Comparative Economics, an independent scholar-run open access journal based in Italy. The authors raise concern for the longevity of the journal as it has no employed staff, framing it as an exploratory experiment that is ongoing. While the overall expenses for running the journal are low, financing the twelve or so days worth of copy-editing work to be done for accepted articles was reported to be a challenge. Foxall and Nailor (2016) review the 2014 switch by the oncology journal ecancermedicalscience, from a completely free model for readers and authors to an innovative ‘pay what you want’ model for authors. The suggested charge is set at £1,000 'but authors are welcome to pay any amount that they can afford' (Foxall and Nailor (2016:114). The income generated from author payments does not cover operating expenses for the journal but such an alternative can function as one piece of a wider funding strategy, and preferably also as part of a larger enterprise so as to enable cross-allocation of funds (Foxall and Nailor 2016).
As can be seen from the brief review of existing studies, many of the prominent case studies are relatively old, and the research area coverage for the humanities is limited. However, while it might be hard to directly compare the experiences of transitions that happen a decade apart, drawing on previously used methods (e.g. article processing charge level deliberations and experiments, Web access metrics, terms of publishing model description) is likely to be useful for any journal evaluating publishing model transition.
Research aim and method
This case study aims to contribute to the existing body of research and understanding of how scholarly journal publishing can be transformed from a dominantly subscription-based environment towards open publishing. This is done by providing a transparent case study of a recently founded small society journal, Nordic Wittgenstein Review (hereafter, the Review). The purpose is to consciously avoid a rose-tinted retrospective account, or founding a study around an elite journal where authors easily conform to any changes and charges purely based on the prestigious leading status of the journal.
A core perspective of this study is that open access is a spectrum rather than something that is either on or off (Chen and Olijhoek 2016). The different variables include, but are not limited to: from partial openness to full, immediate to delayed, gratis to libre, and free to author-financed. For scholarly communication, the notion of openness can be grounded as an ideology which facilitates the best interest of scientific progress by removing access barriers. This notion of variable openness as an ideology is juxtaposed with the notion of practical feasibility and longevity in maintaining a scholarly publishing outlet. The adopted analytical perspective is summarised in Figure 1.
RQ1: What publishing options are available for small subscription-based journals considering adoption of open access publishing in some form?
RQ2: What was the process and which were the experiences which led Nordic Wittgenstein Review to become an independent, scholar-run open access journal?
RQ3: What kinds of resources are required to operate an independent, scholar-run open access journal within the humanities?
RQ4: What can journal Web metrics and a Web survey distributed to the scholarly community within the research area tell about the current feasibility of an open access journal in said research area?
To answer these questions the case study uses data combined from three sources:
- Information given by two editorial board members, the present editor-in-chief and one of the first editors (who were in central positions in all stages of the journal founding), operations, publisher negotiations, and decision-making. This includes accounts of the process as well as associated documentation and historical records.
- Web access metrics from the journal publishing platform and through Google Analytics 2014-2016.
- A Web survey to the wider research community around the journal circulated during a three-week period during May to June 2016. A link to the publicly accessible survey was sent out to registered readers of the journal Website, posted on PhilPapers.org (http://www.philpapers.org), members of related research organizations and disciplinary communities reached through e-mail lists. The survey rendered 141 useable completed responses.
Personal accounts provide insight into the deliberations on publishing models. Hence a traditional bird’s-eye view journal case study can be complemented with a perspective from below, from within the context in which publication model decisions are taken: by editorial boards and society boards.
The article is structured as follows: first the Review is introduced in detail, the situation is then presented on how the publication model was chosen: the publisher offers received by the editorial board, and the critical issues for publishing model choice. Following that, available details on the resources needed to operate the journal are presented. The choice of publication model is evaluated in the light of these needs and the results of a survey to a group of scholars in the wider field of philosophy are presented. The attitudes and situation of these scholars should be comparable to those of potential authors of the Review. This is followed by analysing journal Web metrics to evaluate the current status of readership in light of previous research. The article is concluded with a section covering the main overarching conclusions as well as practical recommendations for journals evaluating various alternative publishing models.
Nordic Wittgenstein Review
History and publisher collaboration background
The Nordic Wittgenstein Review was founded in 2011 by the Nordic Wittgenstein Society, which is a non-profit organization founded in 2009 and run by scholars from the Nordic countries. Apart from publishing the journal, the Society arranges an annual conference and edits the book series Nordic Wittgenstein Studies (published by Springer), which opened for submissions in 2014. The name of the journal was the result of a suggestion and online voting round between the members of the Nordic Wittgenstein Society (which had approximately 100 members at the time in 2012). From the start, the founding group behind the journal considered open access availability a central motivation for founding the journal since no open access journal for Wittgenstein scholarship existed at the time. Another central motivation was that the founders felt that there was a need for a journal which made sure that authors working in this field could have their papers reviewed by scholars with a genuine expertise in Wittgenstein. The journal focuses on philosophy but is interdisciplinary in character. It publishes not only philosophical work inspired by Ludwig Wittgenstein (1889-1951) or related to traditions which stem from his work, but also philological, linguistics and computing-related material connected with Wittgenstein’s writings.
The Review started out as a dual mode (print and electronic) annual journal with its first issue published in 2012 by Ontos Verlag, an international publisher based in Germany (in Heusenstamm am Frankfurt). Under that arrangement the journal published all articles open access on the Website after a delay of three months after print. Web materials were all licensed with the Creative Commons license, CC-BY-NC-SA. The Review’s first steps were initiated by the Wittgenstein Archives at the University of Bergen in cooperation with the Nordic Wittgenstein Society within an EU-funded research project called Agora: Scholarly open access Research in European Philosophy (2011-2014, FP7, CIP), which included also a larger dissemination project on Wittgenstein material (derived from the Bergen archives and the Austrian Wittgenstein Society) and experiments with open access book publishing (at Ontos Verlag). Ontos was a small publisher, which mostly published printed books and to some extent e-books, but which specifically had the field of Wittgenstein studies as one of its focus areas. There were plans to offer electronic subscription to libraries, but Ontos left the EU-funded Agora-project and as a small publisher was not able to provide a license-based subscription which the libraries had requested (Neuman et al., 2014). In May 2013, Ontos was sold to the larger German publishing house Walter De Gruyter, who set out to expand and to develop their Wittgenstein palette. The Review progressed as an immediate open access journal with print subscriptions, and it was also included in a subscription bundle. It was at this time that the negotiations regarding the future publishing model of the journal began. The only publishing model De Gruyter could provide was a closed-access, traditional subscription model with a hybrid open access option. However, this model was out of the question for the editorial board of the journal, which is responsible for all organizational decisions of the journal. Following the decision to start looking for a new publisher, two rounds of publisher negotiations commenced.
Choosing a new publisher: The first round
The editorial board, who are in charge of decisions for the journal organization and publication models, discussed the issue of publisher collaboration at length and over several meetings.
Three publication offers with an openness element were considered by the editorial board in 2013. (See Table 1 for an overview of the offers.)
(A) Closed Access with hybrid open access option
The journal would become a traditional closed-access subscription journal at an international publisher, sold as part of large bundles of journals to libraries. The model would include a hybrid open access option: authors could have their articles made open access for a fee. The typesetting, PDF-production, publishing and indexing would be managed by the publisher but the peer-review system would be handled by the editors. Main journal decisions would be made by a society-appointed editorial board and no honorary would be given to the editor(s).
The traditional closed-access model was not an option for the editorial board. The readership would be expected to diminish and open availability was a key characteristic for the journal ever since it was founded. This was an ideological issue, and open availability is what the society regarded as a crucial service to the research environment; subsequently it was a commitment of the Agora project. The editorial board was aware that the hybrid offer would result in very few open articles and was thus considered to be of no value to the journal.
(B) Journal Pays 1: Full open access with print-on-demand
The journal would require funding of around €5,000 a year for facilitating the publication process (calculated on ten items per issue) which included layout, publication, proper indexing and indexing assistance. However, wide visibility is expected from a publication in an international publisher’s platform. No proof-reading in the basic offer, but available for an extra fee. Two years free basic services, with no obligations to remain. Print-on-demand in volumes with an annual 25% revenue share.
A benefit of this model is that the provided publisher services would ease the load for the editors. The main reason for declining the offer was commitment to continuous annual funding. Obtaining funding is the hardest and most uncertain of all tasks related to journal editing and hence it may not always be guaranteed. Some members of the editorial board also noted that this publisher had no renommé and that prestige was important for this journal as a newcomer. This same publisher later returned with a similar offer, see offer E.
(C) Closed access subscription journal with free access on login for society members
This model would include typesetting and PDF-production services, which the editorial board members valued highly. The login and read for free interface for society members would be provided by the society. Editing honoraria would be given to the society. The journal would not remain society-owned, but should the publisher stop publishing it ownership would revert to the society. The publisher’s platform would be used and the journal should increase its article output considerably. Some print copies would be available, also with a discounted rate for members. The society would appoint editors etc. i.e. the society would retain decision power over the journal. Turning over the power entirely was not considered an option, the journal was to be steered by academics for academics and for their purposes.
The third offer (C) was initially accepted by the editorial board, the main reason being that the investment of the multinational publishing house would provide the journal with sustainability both economically and organizationally. The negotiations went on and were extensive, until the acquisitions board at the publishing house decided not to go ahead for financial reasons. Hence, in 2015, after 1.5 years of negotiations, a second round of negotiations commenced.
Choosing a new publisher: The second round
(D) Closed access subscription journal with a honorary to the editors
Free access provided for members of the society for a trial period, on the condition that the publisher was given the copyright of all articles, or with university-specific waivers (i.e. partnership arrangement through which authors would have open access for free). Full services including proof-reading by assigned editor. Hybrid option with lower article processing charges than many other publishers.
The main drawback of this offer was the fundamental principle of closed-access. Turning over copyright to guarantee access to Society members was also not an option for the journal. Besides the commitment to open access, the society saw that the authors would be worse off and one important motivation for having a journal was to benefit the authors and get the best possible deal for them. Waivers for universities is beyond the interest and powers of the journal editorial board to arrange and this would be a transfer of open access decision power away from the society.
(E) Journal Pays 2
The same offer as (B) above, but no free years without obligations. Also a switch to author pays (at around 500€ per article) planned in case funding would be difficult to achieve (around €5,000 needed for two issues a year).
(F) Independent scholar-run journal
Published by Nordic Wittgenstein Society.
This last option, (F) was the option eventually chosen and is described in close detail later in this article. Hence, in the end, the decision was to make the Review an independent journal without the support of a professional publisher, published by the Nordic Wittgenstein Society itself.
|ROUND 1 2013||Open access||Cost/income for society||Publisher services||Publication/workflow platform||Other issues|
|(A) Closed Access with hybrid open access option||No.
Hybrid: author fee
Open review not possible in new platform but allowed in old platform.
|Availability to readers key issue for NWR.|
|(B) Journal pays 1||Yes.||Yes
Print on demand (volumes not issues) (25% revenue share to publisher).
Complimentary copies paid by society.
|-5000€/year (2 issues, 250e/article)
2 years no fee (or premium pack incl. more services 600€/article: 12000€)
Typesetting at extra fee.
(Premium pack: all services except peer-review
|Transfer not obligatory.
New platform service included (unnecessary for NWR).
|Publisher not renowned.
Finding funding an unpopular task among editors.
|(C) Closed Access with free access for society members
Hybrid: author fee.
Free access on login for society member, university waivers possible
Free copies to authors and special subscription rate to members.
|+ 2500€ honorary to editors.||Typesetting.
Typographical oddities, house style compliance.
Society must provide member login interface.
|Copyright to publisher.
Should increase number of issues yearly.
Offer accepted by the Review in 2013 but withdrawn by publisher.
|ROUND 2 2015|
|D) Closed Access with free access for society members (trial period)||No.
Hybrid: author fee (low fee)
Trial: free access for society members on certain conditions
Free subscription to editorial board members and guest editor 1 copy.
Authors only free PDF offprint.
|+ honorary to editors.||Typesetting, publication.
Editing: typographical oddities and house style compliance.
Open review not possible on new platform but allowed on old platform.
|Copyright to publisher.|
|(E) Journal pays 2||Yes.||Yes.
|-5000€/year for society.
-book reviews and small items only 60€/item.
Proof-reading at extra fee.
|Transfer not necessary.||Transfer to author pays in case society cannot.
Article processing charge around €500.
|(F) Independent scholar-run journal||Yes.||Print possible.||0.
Some can be bought.
Many routines already in place.
|Transfer not necessary.
Platform already in use.
Hosting issue can be solved.
Open review as we like it.
Experimental profile can be kept.
Why was the independent publishing route chosen?
The central issue for the editorial board of the Review was securing continuity and quality, but also (especially at the early stages of the discussion) securing some prestige for the young journal, which can be obtained through collaboration with a renowned publisher. When the range of available options changed in the second round, independence and prestige were not conceived of as important as having full control over the journal (that the decisions on the journal should be made by scholars and not by a publisher for financial ends). Additional hopes were to keep the experimental character of the journal by being able to continue with open review for preprints (not possible with a large-scale publisher because of the rigid publication platform the development of which was kept to a minimum).
Publishers differ in the services they provide but as the Review had a working workflow and publishing platform in OJS, only some of the services offered were important for the publisher decision for the Review. Proof-reading, print copies, good indexing, but also marketing and visibility were considered benefits. The transfer or change of an editing platform was an issue (configuring a new platform is a time investment), but for the Review the step to independence was smaller since the journal platform already existed and was running. Handling of back-issues was a concern, but not a central one. However, no re-negotiation of author copyright licenses of already published articles was to be accepted, nor would the editorial board have been prepared to let the back-issues become closed access. Open access was central to the editorial board as an ideology, which involved values and ideals which would take a central position in all reasoning on the future of the journal. According to the editor-in-chief, the importance of open access from the perspective of the editorial board members increased up to the second round of negotiations 2015 since the first round in 2013.
Hence, in 2014, the Review turned biannual and electronic only, as well as immediately open access upon publication in line with the BOAI definition, which also requires the most liberal Creative Commons license (CC-BY). Hence the Review’s degree of openness increased with it becoming more independent (cf. Chen and Olijhoek 2016). The possibility to offer print-on-demand has been left open.
The Nordic Wittgenstein Review today
Operating an academic journal consists of certain tasks, independently of business and publication model which include: receiving and evaluating papers (commissioning editorial material and running the peer-review process), editorial tasks, processing papers for publication, maintaining Website (and perhaps processing platform), marketing, information dissemination, indexing arrangements. Furthermore, for an independent journal, finding necessary funding is often a task for the editorial team. In principle, all tasks can be taken care of as part of community service. In what follows, we have attempted to make the dimensions of these tasks as explicit as possible.
Selecting articles: the peer-review system
The Review applies a double-blind peer-review procedure for submitted papers, and furthermore, a type of open review on accepted papers. The papers are typeset and made available online for commenting for one month. Apart from submitted articles, each issue contains an invited paper (of a top name in the field as widely understood), book reviews, and a note from the editors. On average, every second issue contains an interview, at least one paper in an archive section in which archive material related to Wittgenstein is presented or reproduced. (See publication numbers in Figure 2 and Table 2.) In relation to the survival parameters of the cohort study by Björk, Shen and Laakso (2016), the Review’s publication numbers have developed well, but tend toward the lower end of the spectrum.
|Year||Issues||Published items||Research articles||Other items*|
|2012||1||13||6 (1 invited)||7|
|2013||1||10||5 (1 invited)||5|
|2014||2||19||10 (2 invited)||9|
|2015||2||20||9 (2 invited)||11|
|1 special issue||8||8||0|
|* Other items: archive section papers on archive material (commissioned, no blind peer-review),interviews, book reviews, notes from the editors.|
Running the peer-review system is one of the tasks which cannot be transferred to a publisher, it is the task of the academic editors (also at international publishing houses). There is no significant difference between the time it takes for academic editors serving subscription journals at professional publishing houses and the time it takes for editors at independent open access journals. Peer-reviewed journals rely mostly on community service for the peer-review process and reviewers use their time to support their communication system. New initiatives of business models with paid peer-reviews exist but are not options for independent scholar-run journals (cf.Matthews, 2016).
For editors, the peer-review procedure for an article would typically consist of the following tasks: reading the article, finding reviewers (discussing with the other editors), assigning papers and sending requests, and if not already part of the reviewer pool, finding their contact information (e-mail), sending enrolment invitations, sending review requests, reminders, following up the responses, finding replacement reviewers, acknowledging received reviews, requesting clarification (see task selection chart, Figure 3 and Table 3).
|Published||Submission count||Direct decline||Resubmit||Decline||Accept||Accepted after resubmission|
The acceptance rate (i.e., the share of submissions that are accepted for publication of all submissions) for the article section in these two volumes (2014-2015) was 26%, which was slightly down from 33% in the 2012-13 volumes. According to Edgar and Willinsky (2010:10), low acceptance rates, below 30%, are 'generally a measure of higher-quality journal content'. Journal quality assessment is in some fields reduced to comparing citation-based ‘impact factors’ of journals to gauge the relative importance of a journal within a field. However, even though the practice is one-dimensional and open for strategic optimisation, this remains the dominant type of assessment due to a lack of better qualitative alternatives (Polonioli 2016). The prime impact factor authority, Clarivate Analytics Journal Citation Reports, does not calculate impact factors for journals within the humanities, so other ways of measuring need to be used. Marchi and Lorenzetti (2016) recently suggested that journal rejection-rates and subscription numbers should be used as an analogue for quality among humanities journals. In the case of the Review , subscription numbers are not an applicable measure since no subscriptions are offered. PDF download numbers may instead be a suitable measure, a topic which we will return to later as part of the Web metrics analysis.
The number of completed peer-reviews divided by the number of published articles is almost seven in the articles section of the Review for the two years charted (Table 4). The extent of the interaction task of coordinating the peer-review procedure is manifested in the number of times reviewers asked decline to take on the task: 83 failed invitations by editors precede the 104 completed reviews.
|Reviews completed||Reviewer declined||Request retracted (no response)||Resubmission (2 review rounds)||Extra reviews (3rd reviewer)|
The editors of the Review have responded to the expansion of the task by attempting to reject more papers in the eligibility check, but this measure goes counter to one of the tasks of review: not only gatekeeping, but also improving the quality of the academic work. The editors have aimed at taking on this responsibility for a large share of the submissions, however, it is not possible or practical to do as coordinating it takes time. More importantly, one of the most valuable assets of the journal is its pool of peer-reviewers, which must be used with consideration: this valuable and scarce resource is likely to diminish if reviewers tire from being presented with too many or with low-quality papers. There is a conflict in the fact that editors must use more time to read papers carefully to judge whether to reject them offhand to avoid using peer-reviewers' time for the task, when the peer-reviewers are part of the system in the first place as the actual judges of scholarly quality.
Editorial work and Website maintenance
It is crucial for journals which depend heavily on volunteer labour to have a platform that is simple and easy to learn and use. OJS has some issues which require technical knowledge which an editor does not necessarily wish to develop, and which may, therefore, require funding to be provided as a service. The Review benefited from funding for the configuration of the platform because it was created within the EU-funded research project, Agora. Keeping the platform up-to-date requires a few working hours on part of the editors and developers every year. Also, there may be recurrent user issues, for example, authors needing instructions to find out where to resubmit papers. Reviewers sometimes have problems submitting their reviews, Java updates can cause problems when completing the review form which can add to the editor-in-chief's time investment. Some text fields are set and mar the communication on the site, and the default text is small. For the Review, the editorship circulates in the Nordic countries, and when new editors take on the task, they need time to learn how to use the platform and the editor-in-chief needs to take the time to instruct them.
The OJS platform is open source software and requires no licensing fees. The Review’s platform was set up and hosted by the Wittgenstein Archives at the University of Bergen at no cost to the journal or to the Nordic Wittgenstein Society. However, it must be moved because of a lack of funding for the archives, leading to lack of proper maintenance and technical support. In 2017 the platform was transferred to he University of Bergen Library, which provides persistent identifiers and technical support at no cost. This kind of support is crucial for the journal to stay independent. In other words, hosting may be an issue for some journals. The Review has not utilised all of the functions of OJS, for instance, some of the editing communication (copyediting, layout) etc. have been taken care of by e-mail instead of using the process steps in the platform (as laid out in for instance Willinsky and Mendis 2007). All aspects of editing have been carried out by the editors together with the editor-in-chief and some section editors. There are possibilities of improving the workflow which remain to be tested and which may unburden the editors.
The Review publishes papers in PDF-format. The typesetting of the papers could be managed by an editorial secretary but so far the editors or editor-in-chief have adopted this task. This is one of the more time-consuming single tasks of the journal. Cavaleri, Keren, Ramello and Valli (2009) approximate the time taken to complete the final editing and formatting of the published articles to around eight hours per article (at twelve articles a year the sum is around twelve working days per year). For the Review, the papers are read and edited by all editors including the editor-in-chief. The formatting is done before the open review, with one round of author-checked suggested changes, followed by a new round (after the open review has ended before final publishing). The formatting takes two to four hours depending on whether there are complications (bugs, pictures etc.) and adding the corrections approximately one to two hours more. With the editing, the preparation for publication of an article takes altogether at least ten hours of work. Resubmitted articles take longer, since the suggested changes are put together and then checked by editors (approximately two hours more). With eight submitted articles, that makes eighty hours i.e., ten working days a year for only the submitted articles. Invited papers (two per year) take altogether around twelve hours (normally only one editing round) and article section contributions and interviews also loosely approximated twelve hours altogether for four papers; book reviews are shorter and will take around two hours each. Altogether the yearly working days required for editing will be at the very least fourteen, divided among the editors but mostly the editor-in-chief. The estimates are not based on systematic follow-ups but loose approximations.
The Review has had a host of revenue streams over the years:
- Print subscriptions. During the first two years the Review offered two-year print subscriptions (institutional and individual at a reduced rate to members of the Nordic Wittgenstein Society). Institutional print subscriptions were difficult to sell. The print cost and postage expenses were covered by the subscriptions during 2012. However, during transition between publishers, the subscriptions were lost.
- Hard-copy sales. No single hard-copy sales so far (apart from two complimentary print copies each for authors in 2012-13), however, single print issues on pre-order is planned for 2017 (primarily for Society members) and is expected break even or better.
- Subsidies. The Review was started within the auspices of the EU-funded Agora project, which financed the configuration of the OJS platform and the setting up the organization and editing the first issues. During the first five years, the platform was set up and hosted by the Wittgenstein Archives in Bergen, and then it was transferred to the University Library in Bergen. Also, a grant was received from The Joint Committee for Nordic Research Councils in the Humanities and Social Sciences (NOS-HS) for 2013 (10,000 NOK = €1,000) and a more substantial one for 2016-18 (tot 144,000 SEK= €15,000); therefore, this journal will have funding for the foreseeable future.
- Hidden subsidies. The main portion of the work (editing, peer-review, editorial board tasks) is facilitated through community service and from the employment of editors at universities in the Nordic countries. The community service is presented in more detail below.
In addition to the above, the range of revenue channels analysed in the overview of OJS journals by Edgar and Willinsky (2010) included advertising, member dues, publication fees, submission fees, pay-per-view, reprint fees, endowment and fundraising, none of which the Review has tried. Print subscriptions are not likely to be a good revenue channel as very few journals (only 17 out of 247) produced a surplus of more than $US100 according to Edgar and Willinsky (2010). Hence print subscription for the journal may be considered a service to the community and a means to securing more readers, rather than a source of funding. (Furthermore, a free online version increased print subscriptions more than a paid online version (Edgar and Willinsky 2010). The difficulty in judging the feasibility of offering print subscriptions again underlines how journals are in unique positions when compared to each other (Solomon, Laakso and Björk 2016).
- Direct: domain services (around 20€/year).
- Indirect, university or privately provided: computers, internet, hosting, OJS tech support.
- Irregular direct expenses: travel, print, postage.
An independent open access journal: the Review’s choice in the light of survey and Web metric results
Operating an independent scholarly-run open access journal requires financial (and other) resources. The Review had financial support for the start-up phase, and at its 6th year of existence, it has some subsidy funding but will be mostly dependent on community service. In this section, we will present and analyse some of the resources in numbers, supplemented with an editor perspective. The main factors are financial resources, community service and workload issues. The workload is estimated where possible, and the current operation of the journal is set alongside the responses to the relevant survey questions posed to the philosophical research community in spring 2016. The hypothesis is that the feasibility of a publication and business model for a journal depends on its specific discipline and situation, where especially the potential authors’ attitudes will play a crucial role.
Revenue stream sustainability
Could the Review change revenue streams? The focus of part of the survey to the philosophical research community was to gauge the current climate for introducing article processing charges.
Figure 4 shows that 52 respondents of 141 would be prepared to pay up to €1,000. Almost half (46%) of the respondents would not be prepared to pay or have their institution or department pay open access fees. A comparison with the Agora Journal Survey from 2013 (Neuman et al. 2014:28) in which the question was put to the community around the Review suggests that the hostile attitudes towards article processing charges are easing up. In the 2013 diagnostic survey (n=46) 28 (61%) ticked the box 'I would never pay nor have my institution pay open access fees'. The survey response confirms that, since authors choose publication venues, charges are not yet a viable option for the Review because of author attitudes. The authors’ attitudes to fees may be related to their situation: in 2013, only 6/46 (13%) knew of funding available for open access fees, and in our 2016 survey (Table 5) 52% were not aware of such funding. 11% were aware about funding and had applied, 25% knew of such funding, although they had not applied for it. The editors have nevertheless speculated explicitly on introducing a voluntary open access fee (Neuman, Søndergaard Christensen and Gustafsson 2016:6).
|If none of your published articles have been made available open access (by you or the publisher) what is the main reason?|
|I have not had funding for it||33||56%|
|I have not realised that it was possible||13||22%|
|I do not see open access as important||3||5%|
|There are not good enough open access journals in my field||10||17%|
|I have not wanted my articles to be available online||0||0%|
|Are you able to apply for funding to publish outputs from your research?|
|No, I am not aware of any opportunity to apply for such funding||74||52%|
|Yes, but I have never applied for such funding||35||25%|
|Not sure / cannot remember||17||12%|
|Yes, and I have applied for such funding before||15||11%|
The survey results suggest that the current model remains the reasonable financial model for NWR to choose: keeping costs low with hidden subsidies or community service, together with grant or subsidy funding.
Community service as a resource
In our survey to the community around the Review, we inquired as to which tasks the authors could imagine taking on. These responses are enlightening for how the editorial work should to be set-up in order for an independent journal in this field to be sustainable.
In the survey, the respondents were asked what services they think that authors must receive from editors and publishers (Figure 5). The most wanted, minimum services were article dissemination and marketing (>80% of the respondents marked it as must be provided by publishers or editors), typesetting and layout (>70%), reference conformity to journal guidelines (>60%), and editing (>55%). Many respondents could imagine taking care of reference check (~60%) , language check and proof-reading (each ~50%).
The responses indicate that the Review should not consider transferring the typesetting task to its authors. The authors are currently asked to check references and edit, however, the editors mostly do technical editing, language checking and typo correction. The responses on the editor or publisher task sharing shows that the journal should not considerably change its task distribution. Effective dissemination and marketing for published content emerged as the most important factors. What is also considered to be highly relevant is the integration with repositories and forums which are important to the research discipline. Note that this particular question may reflect “pro open access bias” in the respondents, possibly a contributing cause to their decision to respond to the survey.
Today, authors of the Review do proof-reading too, but as the editors are responsible for the end publication format, they cannot refrain from this task without risking a drop in quality. Reference conformity to journal guidelines is the responsibility of the authors, but the the editors’ experience show that this check only partly succeeds, just as checking references.
Considering the fact that the peer-review process and editing would not be taken over by a publisher, the editor honoraria offered to the Review by international publishers would probably not be substantial enough to motivate editorship for financial ends (approximately €5,000 a year in total for the journal). The sustainability of the journal depends on community service, which rests on other values and rewards, such as the perception of the tasks as important or meaningful.
Funding availability is not necessarily a guarantee of sustainability: in the case of the Review, honoraria to the editors may help, but the problem of lack of time for fully employed university teachers and researchers is not resolved with additional income. The Review received a grant of around €5,000 a year for three years, however, this is not enough to fund sufficient external assistance. Professional typesetting services for one issue of 200 pages would amount to €2,000 and would not solve the problem it set out to solve, which is to unburden the editors, because the open review requires a round of typesetting too and adding corrections after the open review would make the professional layout assistance too expensive.
Appreciation in the scholarly community is one example of a non-financial reward. When asked, most of the respondents did not have an opinion on whether being part of journal operations is sufficiently appreciated in the scholarly community (Figure 6). The experience of the editors is that editorship does provide some recognition and considerably widens the professional network and knowledge of the network and its research undertakings. In situations when they have been asked to continue as editors, none has so far declined. Nevertheless, editors processing many papers in addition to full-time teaching and research makes the system vulnerable. Should the editors be overburdened, the publication process is at risk of suffering.
Decisions related to indexing are in a sense a journal start-up phase issue. However, many indexing services do not include journals until they have a few volumes of back issues, and the hours needed to complete the applications for inclusion vary considerably. In the survey, the authors were asked which indexing services are important to them.
Indexing inclusion can be a complicated process for editors to execute. The Review is indexed in Philpapers.org (since 2014), EriH PLUS (since 2015), and in some national evaluation indices (JUFO (Finland), NSD (Norway)). It is under evaluation for Thomson-Reuters Arts and Humanities Index. Scopus has been considered, although application for inclusion is on hold owing to the sizeable application form required. The Directory of Open Access Journals is surprisingly unknown, as more than 40% of the survey respondents ‘have never heard of this service’ (Figure 7). The Review was not indexed in DOAJ 2011-16 although it fulfilled all inclusion criteria, apart from long-term digital preservation. This could be implemented through the LOCKSS enrolment function supported by OJS, which required measures which the editors may lack the time or expertise to complete. Indexing inclusion is important for many authors, and Philpapers.org is clearly the most important one. Philpapers is an online index and bibliography of philosophy which collects its information by trawling and crowdsourcing and among other services provides individualised news notifications about new publications and hence helps researchers monitor what is published.
Some sustainability issues have been discussed above. However, the survey provides a diagnostic tool for the publishing environment of the Review and sheds light on what the authors, the dominant stakeholder group, find feasible. Table 6 summarises the experiences that authors within philosophy have had of open access and of their publishing values and attitudes; it can give clues as to the feasibility of the chosen publication model.
|How many peer-reviewed scholarly journal articles have you published? (An estimation will do.)||How many of these were published open access by the publisher/journal (i.e. made openly available on the Internet for free to the reader)?||For how many of these did you pay an open access fee?||How many of your articles published in closed access journals have been made available open access by you in a repository or elsewhere on the Web?||Academic social network mentioned as one location|
The experience of open access publishing varies between the survey respondents (Table 6), but the distribution of respondent and the numbers should render their publishing experiences generalisable to the discipline in general. The median reported number of articles published by a respondent was 6, of which 1 was published open access by journal/publisher (gold open access). Out of altogether 1800 articles by this group of scholars, 310 (17%) were reported to be available through the publisher. However, this number should be expected to be lower, as at least one author reported 60, which would be highly unusual, if not impossible in this field.)
Paying an open access fee is not a common experience and the responses suggest that should the Review attempt to introduce one, it would require pedagogical measures to convince authors that it is a good idea to have a chance of success. In the 2013 Agora journal survey, only 1 of 46 respondents from the community around the journal had once paid an article processing charge of €500. When it comes to green open access, it is striking that academic social media (such as Academia.edu) is considered a suitable venue by many (mentioned by 58 out of 128 respondents).
Attracting high-quality submissions
The sustainability of a journal depends partly on the capability to attract high quality submissions. The three most important factors for authors to submit to a journal according to respondents in our survey (Figure 8) are: 1. They are the best in my academic field, 2. Prestige of publication venue and in shared third place 3. Reaching the audience and 3. Trustworthy quality assurance processes. Prestige is difficult to achieve and to measure. From the beginning, the Review editors have tried to create a quality journal by putting effort into setting up a high quality peer-review procedure, and to carefully consider good editorial practices on all steps taken (supported by and evaluated within the Agora research project). Also, the aim has been for the communication of the journal to be clear, open and fair to authors in all of their dealings with it. Furthermore, the journal has an esteemed advisory board, an editorial board with several respected (Nordic) researchers and the invited papers by leading scholars in the field, which have all been a way to attract attention.
What ‘the best in my academic field’ precisely means is difficult to determine, however, this may involve perceived quality and is related to prestige (possibly a proxy measure for quality). An independent journal is often less professionally edited but this is not necessarily reflected in the number of printing errors. However, some multinational publishing houses provide very little editing assistance and no language editing, both of which could improve the quality of the text.
Potential authors’ views
Choosing a publishing model which potential authors understand and value may be important for sustainability. The majority of respondents (67%) find that independence is valuable and worth maintaining (Figure 9). This finding resonates with the decision for the Review to become an independent journal.
The availability of reviewing contributions and submissions is crucial for sustainability. When asked (Figure 10), as many as 50% of the respondents reported that they prefer to review for open access journals, whereas only 40 % prefer to submit to open access journals. Scholars do play a role in the journal business because approximately 30% subscribe to a journal as an individual (25% pay for an academic print journal), and 40% of respondents have asked their libraries to subscribe to a journal at least once.
Since a market for individual print subscriptions does seem to exist to some degree, this could be a possibility for an income stream for the Review. However, this income stream presupposes a system for handling fees, print file preparation and cover layout. Individual print subscriptions for predominately Nordic Wittgenstein Society members would not necessarily require any elevation in marketing efforts.
The respondents do feel that open access is needed in the future (Figure 11), however, they do not believe that access is a competitive factor in the discipline. A possible conclusion is that open access is more important to the editorial board than it is for potential authors, which highlights the need for a balance between sustainability and ideology by editorial boards making publishing model decisions.
Web metrics: the journal Website in numbers
When obtaining insight into how the journal is accessed and read longitudinal Web metrics can be very helpful in assessing aspects related to journal outreach, for example, through which sites visitors arrive to the Website, and how download counts for content are distributed. For the purposes of this study only high-level data collected by the Google Analytics tracker present on the journal Website was used, however, deeper insight could be gained by collecting e.g. Website visitor surveys.
From 7 June 2015 to 7 June 2016 Google Analytics registered 12,417 unique visits to the journal Website domain with a total of 40,861 Webpages being viewed (3.29 average per visit). The visitor origin breakdown can be seen in Table 7. 20% of visits came from the US, 11 % from the UK, 6 % from Germany, 6% from Finland, and 5 % from Brazil and Italy. Over 60% of all visits resulted in only opening one page during the visit. The vast majority of visitors accessed the Webpage through a computer (84%), but 11% of visits to the Website were made with a mobile phone, and 5% with a tablet.
|% of visitor origin (N=12 417)||Website
|47%||Web search engines|
|25%||Direct URL (e.g., bookmarked, shortcut saved in browser memory, or by typing it out)|
|20%||Linking: Philpapers.org; Wab.uib.no; Wittgensteinrepository.org; Olponline.org; Dailynous.com; bookforum.com|
|8%||Social media: Facebook; Blogger; Twitter; Reddit; Tumblr|
According to the survey results, indexing in Philpapers.org was seen as important by scholars, and the Web metrics also shed light on the important role of Philpapers for NWR’s Website traffic by being the most frequent linking source to NWR. wab.uib.no is the Wittgenstein Archives at the University of Bergen portal which contains much material on Wittgenstein but also hosted NWR’s OJS site.
The OJS platform’s built-in counter provides view counts for each article and for the abstract, both PDF and HTML versions. However, these statistics are only available for the first two issues of the articles. These numbers, visualised in Figure 12, show that the articles are downloaded not only during the first months of publication but also in later years. Articles in later issues have reached the 500 download mark quicker than articles published in the first issues.
The ideology for supporting open access in scholarly publishing is nearly universally accepted as beneficial. However, to make such a publishing model feasible and sustainable in the long run requires resources to come from somewhere else other than readers. The available publishing options for a small subscription-based journal considering transfer to open access were: journal pays (which can often lead to article processing charges and author-pays), independent cost-cut, or applying to be part of a consortium publishing model (e.g. Open Library of Humanities). For larger societies there might be other possibilities to fund journal publication activities through subsidies from other activities, but in the case of the Nordic Wittgenstein Society the journal had to be practically self-sustaining.
The processes which led the Review to becoming an independent, scholar-run, open access journal started with the need to find a new publisher, it then passed through a long negotiation process, and was finalised by the editorial board judgments of what was most important for the Review. The open access ideology and positive experiences of publishing open access so far were crucial to choosing the current model, whilst retaining authority over the journal. Furthermore, the secured hosting of the platform was an important factor. The evaluation measures show that open access comes at a price which can affect sustainability: good offers from publishers were turned down because of the lack of openness. Through this process, the editorial board was forced to balance ideology and feasibility in very tangible terms.
Regarding the operation of an independent scholar-run open access journal within the humanities, one can note that some financial resources are necessary, but above all a strong community offering its service is important. The Review is, fortunately, a journal with a strong community. It had over 1000 likes on Facebook by the end of 2015 with minimum marketing efforts. In September 2015, the Nordic Wittgenstein Society had 193 members from all over the globe (perhaps due to no membership fees and an online membership application process). The need for funding is directly related to the availability of community service, which in turn depends on the community and on how editing is valued and how agents within the community perceive their responsibility for the communication system. The situation may be investigated by the help of surveys to the community. Open access may be considered an aspect of quality of a journal by authors. The members of the group behind the Revioew have thought that prestige of a journal may depend on clear communication and open access and editing assistance, i.e., the services provided by a journal are components of its esteem.
Collecting and analysing Web metrics and conducting Web surveys distributed to the scholarly community within the journal research area can greatly help to guide the decision to gauge the feasibility of an open access journal. The Review survey was used to ascertain when authors are prepared to take over tasks from the editors, and may provide hints to sustainable adjustments of the operations of the journal. Also, feasibility of different kinds of income streams, such as article processing charges can be surveyed. For the Review, the survey supported independence, a model with no such charges but relying on community service. Web metrics help with informing the editors on what kind of readership the journal has internationally and what type of content is being most heavily accessed.
Recommendations for the Review and other journals
A possibility not investigated in this article is joining a consortium (e.g. Open Library of Humanities, which was not yet established during the first round of negotiations as it was launched in January 2013). This sort of opportunity may be a good option for society journals because it offers stable funding, a continuously developed common journal platform, technical support, and increased visibility for the journal (compared with being fully independent).
Journals need to look over their workflow to make it effective and include more scholars than a few editors involved in tasks like copy-editing. A good way to start monitoring the status of this aspect is to create an overview of the various tasks conducted and to follow up on their time consumption. Independent journals have the benefit of being autonomous and flexible when needed, however, independence from professional publisher backing also makes them more vulnerable to continuity issues since key individuals are keeping the entire journal running. Decentralisation of both authority and responsibilities help with managing the continuity of the journal if and when the time comes for key individuals to leave their editorial duties.
Dr. Annamaria Carusi (http://www.sheffield.ac.uk/iicd/profiles/carusi) collected the Google analytics data.
The editorial board of Nordic Wittgenstein Review has supported the work on this article, in particular the editor Anne-Marie Søndergaard Christensen (University of Southern Denmark).
Alois Pichler from the Wittgenstein Archives at the University of Bergen has reviewed the preprint of the article and contributed to its revision and provided information as a former editor and central agent in starting up the journal.
Two anonymous reviewers of Information Research have made constructive suggestions, which have improved the quality of the article.
About the authors
Yrsa Neuman is a postdoc researcher in philosophy at Åbo Akademi University (Turku, Finland). Apart from practicing it as the editor-in-chief of Nordic Wittgenstein Review, open access publishing in the humanities is included among her research interests. She can be reached at firstname.lastname@example.org.
Mikael Laakso is an associate professor in information systems science at Hanken School of Economics (Helsinki, Finland). He has conducted research on the changing landscape of scholarly publishing through the introduction of open access since 2009 and defended his doctoral thesis on the topic in 2014. He can be reached at email@example.com.
- Adema J. & Rutten, P. (2010). Digital monographs in the humanities and social sciences: report on user meeds. (OAPEN project report D3.1.4). Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download;jsessionid=FB1575C4BDC7400D68EE1CAC0C127616?doi=10.1.1.163.798&rep=rep1&type=pdf
- Bailey, C. W., Jr. (2010). Open access journals bibliography. Houston, TX: Digital Scholarship. Retrieved from http://www.digital-scholarship.org/oajb/oajb.html (Archived by WebCite® at http://www.webcitation.org/6rytcs46C).
- Beck, R. N., & Lineback, R. H. (1978). Scientific information transfer: the editor’s role. In M. Balaban (Ed.) Proceedings of the First International Conference of Scientific Editors, April 24--29, 1977, Jerusalem, Israel, (pp. 419–427). Dordrecht, Netherlands: Springer Netherlands.
- Björk, B-C., Shen, C., Laakso, M. (2016). A longitudinal study of independent scholar-published open access journals. PeerJ, 4. e1990. Retrieved from https://doi.org/10.7717/peerj.1990
- Björk, B-C. and Turk, Z. (2006). The Electronic Journal of Information Technology in Construction (ITcon): an open access journal using an un-paid, volunteer-based organization. Information Research, 11(3), paper 255. Retrieved from http://InformationR.net/ir/11-3/paper255.html (Archived by WebCite® at http://www.webcitation.org/6rytz5big)
- Cavaleri, P., Keren, M., Ramello, G., and Valli. V. (2009). Publishing an e-journal on a shoe string: is it a sustainable project? Economic Analysis and Policy, 39(1), 89–101. Retrieved from http://bit.ly/2zTozJk
- Chen X., Olijhoek, T. (2016). Measuring the Degrees of openness of scholarly journals with the Open Access Spectrum (OAS) evaluation tool, Serials Review, 42(2), 108-115. Retrieved from http://dx.doi.org/10.1080/00987913.2016.1182672
- Crawford, W. (2002). Free electronic refereed journals: getting past the arc of enthusiasm. Learned Publishing, 15(2), 117-123. Retrieved from http://dx.doi.org/10.1087/09531510252848881
- De Grandis, G. & Neuman, Y. (2014). Measuring openness and evaluating digital academic publishing models: not quite the same business. Journal of Electronic Publishing, 17(3). Retrieved from http://dx.doi.org/10.3998/3336451.0017.302
- Edgar, B.D., Willinsky, J. (2010). A survey of scholarly journals using Open Journal Systems.Scholarly and Research Communication, 1(2). Retrieved from http://dx.doi.org/10.22230/src.2010v1n2a24.
- European Commission. (2015). Guidelines on ppen access to scientific publications and research data in Horizon 2020. Version 2.0. October 2015. Brussels: European Commission. Retrieved from http://ec.europa.eu/research/participants/data/ref/h2020/grants_manual/hi/oa_pilot/h2020-hi-oa-pilot-guide_en.pdf (Archived by WebCite® at http://www.webcitation.org/6ryvZCDrh)
- Eve, M. P. (2014). Open access and the humanities: contexts, controversies and the future. Cambridge: Cambridge University Press. Retrieved from http://www.cambridge.org/do/titles/open-access-and-humanities-contexts-controversies-and-future/. (Archived by WebCite® at http://www.webcitation.org/6ryvi8OZN)
- Felczak, M., Lorimer, R. & Smith, R. (2007). From production to publishing at CJC online: experiences, insights, and considerations for adoption. First Monday, 12(10). Retrieved from http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/rt/printerFriendly/1959/1836. (Archived by WebCite® at http://www.webcitation.org/6ryvpnGl9)
- Fortney, K. & Murphy, L. (2016). Getting found: indexing and the independent open access journal.Western Journal of Emergency Medicine, 17(5), 508–510. Retrieved from http://doi.org/10.5811/westjem.2016.6.30836
- Foxall, K. & Nailor, A. (2016). Sustainability in open access publishing: the ecancer case study. Learned Publishing, 29(2), 113–117. Retrieved from http://dx.doi.org/10.1002/leap.1023
- Haggerty, K.D. (2008). Taking the plunge: open access at the Canadian Journal of Sociology. Information Research, 13(1), paper 338. Retrieved from http://InformationR.net/ir/13-1/paper338.html. (Archived by WebCite® at http://www.webcitation.org/6ryw26eC1)
- Laakso, M. (2014).Measuring aoen access: studies of Web-enabled innovation in scientific journal publishing". Unpublished doctoral dissertation, Hanken School of Economics, Helsinki, Finland. Retrieved from http://hdl.handle.net/10138/45238 (Archived by WebCite® at http://www.webcitation.org/6rywFWYJ0)
- Laakso, M. & Björk, B.-C. (2013).Delayed open access: an overlooked high-impact category of openly available scientific literature. Journal of the American Society for Information Science and Technology, 64(7), 1323–1329. (Archived by WebCite® at http://www.webcitation.org/6rywSzrI3)
- Larivière, V., Haustein, S., Mongeon, P. (2015). The oligopoly of academic publishers in the digital era. PLoS ONE, 10(6): e0127502. Retrieved from http://dx.doi.org/10.1371/journal.pone.0127502
- Marchi, M.D., Lorenzetti, E. (2016). Measuring the impact of scholarly journals in the humanities field. Scientometrics, 106(1), 253–26.
- Matthews, D. (2016, March 16). Should academics be paid for peer review? imes Higher Education. Retrieved from https://www.timeshighereducation.com/news/should-academics-be-paid-for-peer-review (Archived by WebCite® at http://www.webcitation.org/6s1CmI4fU)
- Morrison, H. (2016). Small scholar-led scholarly journals: can they survive and thrive in an open access future? Learned Publishing, 29(2), 83–88. Retrieved from http://dx.doi.org/10.1002/leap.1015.
- Neuman, Y., Strandberg, H., Gustafsson, M. & Pichler, A. (2014). Different shades of gold: report on future strategy of open access, D7.5 Agora – scholarly open access research in European philosophy.Retrieved from https://philpapers.org/archive/NEUDSO.pdf
- Neuman, Y., Søndergaard Christensen, A-M., Gustafsson, M. (2016). Note from the Editors, Nordic Wittgenstein Review, 5(1), 5-7. Retrieved from http://www.nordicwittgensteinreview.com/article/view/3412/Fulltext%20pdf. (Archived by WebCite® at http://www.webcitation.org/6s0RXop65)
- Noorden, R.V. (2013). Open access: The true cost of science publishing. News Feature. Nature, 495(7442), 426–429. Retrieved from http://dx.doi.org/10.1038/495426a
- Norwegian Centre for Research Data. (2016). Norwegian register for scientific journals, series and publishers. Retrieved from https://dbh.nsd.uib.no/publiseringskanaler/Forside?sok.avansert=true&request_locale=en. (Archived by WebCite® at http://www.webcitation.org/6ryugQpnu)
- Polonioli, A. (2016). Metrics, flawed indicators, and the case of philosophy journals. Scientometrics, 108(2), 987–994.
- Schmoller, S. (2013). The transition to… open access. Oxford: Association for Learning Technology. (ALT Project Report). Retrieved from http://repository.alt.ac.uk/2243/1/Journaltransitioning_20130404_Final_Abs.pdf
- Solomon, D.J. (2007). Medical Education Online: a case study of an open access journal in health professional education. Information Research, 12(2) paper 301. Retrieved from http://InformationR.net/ir/12-2/paper301.html. (Archived by WebCite® at http://www.webcitation.org/6s1CtS74M)
- Solomon, D.J. (2008). Developing open access journals: a practical guide, Version 1.02. Retrieved from https://www.fosteropenscience.eu/sites/default/files/pdf/2362.pdf. (Archived by WebCite® at http://www.webcitation.org/6s1D0p4mM)
- Solomon, D., Laakso, M., Björk, B-C. (2016). Converting scholarly journals to open access: a review of approaches and experiences., edited by Peter Suber. Cambrdige, MA: Harvard University, Harvard Library Office for Scholarly Communication. Retrieved from https://dash.harvard.edu/handle/1/27803834.
- Swan, A., Gargouri, Y., Hunt, M., Harnad, S. (2015). Working together to promote open access policy alignment in Europe. Work package 3 report: open access policies PASTEUR4OA Project. Retrieved from https://arxiv.org/abs/1504.02261.
- Ware, M., & Mabe, M. (2015). The STM report — an overview of scientific and scholarly journals publishing. 4th. ed. Oxford: International Association of Scientific, Technical and Medical Publishers. Retrieved from http://www.stm-assoc.org/2015_02_20_STM_Report_2015.pdf. (Archived by WebCite® at http://www.webcitation.org/6s1DJ7yUC)
- Willinsky, J. & Mendis, R. (2007). "Open access on a zero budget: a case study of Postcolonial Text". Information Research, 12(3) paper 308. Retrieved from http://InformationR.net/ir/12-3/paper308.html. . (Archived by WebCite® at http://www.webcitation.org/6s1DNUJ9l)