id sid tid token lemma pos crl-16846 1 1 2 2 X crl-16846 1 2 the the DET crl-16846 1 3 reproducibility reproducibility NOUN crl-16846 1 4 crisis crisis NOUN crl-16846 1 5 and and CCONJ crl-16846 1 6 academic academic ADJ crl-16846 1 7 libraries library NOUN crl-16846 1 8 in in ADP crl-16846 1 9 recent recent ADJ crl-16846 1 10 years year NOUN crl-16846 1 11 , , PUNCT crl-16846 1 12 evidence evidence NOUN crl-16846 1 13 has have AUX crl-16846 1 14 emerged emerge VERB crl-16846 1 15 from from ADP crl-16846 1 16 disciplines discipline NOUN crl-16846 1 17 ranging range VERB crl-16846 1 18 from from ADP crl-16846 1 19 biology biology NOUN crl-16846 1 20 to to ADP crl-16846 1 21 economics economic NOUN crl-16846 1 22 that that SCONJ crl-16846 1 23 many many ADJ crl-16846 1 24 scientific scientific ADJ crl-16846 1 25 studies study NOUN crl-16846 1 26 are be AUX crl-16846 1 27 not not PART crl-16846 1 28 reproducible reproducible ADJ crl-16846 1 29 . . PUNCT crl-16846 2 1 this this DET crl-16846 2 2 evidence evidence NOUN crl-16846 2 3 has have AUX crl-16846 2 4 led lead VERB crl-16846 2 5 to to ADP crl-16846 2 6 declarations declaration NOUN crl-16846 2 7 in in ADP crl-16846 2 8 both both CCONJ crl-16846 2 9 the the DET crl-16846 2 10 scientific scientific ADJ crl-16846 2 11 and and CCONJ crl-16846 2 12 lay lay VERB crl-16846 2 13 press press NOUN crl-16846 2 14 that that SCONJ crl-16846 2 15 science science NOUN crl-16846 2 16 is be AUX crl-16846 2 17 experiencing experience VERB crl-16846 2 18 a a DET crl-16846 2 19 “ " PUNCT crl-16846 2 20 reproducibility reproducibility NOUN crl-16846 2 21 crisis crisis NOUN crl-16846 2 22 ” " PUNCT crl-16846 2 23 and and CCONJ crl-16846 2 24 that that SCONJ crl-16846 2 25 this this DET crl-16846 2 26 crisis crisis NOUN crl-16846 2 27 has have VERB crl-16846 2 28 significant significant ADJ crl-16846 2 29 impacts impact NOUN crl-16846 2 30 on on ADP crl-16846 2 31 both both CCONJ crl-16846 2 32 science science NOUN crl-16846 2 33 and and CCONJ crl-16846 2 34 society society NOUN crl-16846 2 35 , , PUNCT crl-16846 2 36 including include VERB crl-16846 2 37 misdirected misdirected ADJ crl-16846 2 38 effort effort NOUN crl-16846 2 39 , , PUNCT crl-16846 2 40 funding funding NOUN crl-16846 2 41 , , PUNCT crl-16846 2 42 and and CCONJ crl-16846 2 43 policy policy NOUN crl-16846 2 44 implemented implement VERB crl-16846 2 45 on on ADP crl-16846 2 46 the the DET crl-16846 2 47 basis basis NOUN crl-16846 2 48 of of ADP crl-16846 2 49 irreproducible irreproducible ADJ crl-16846 2 50 research research NOUN crl-16846 2 51 . . PUNCT crl-16846 3 1 in in ADP crl-16846 3 2 many many ADJ crl-16846 3 3 cases case NOUN crl-16846 3 4 , , PUNCT crl-16846 3 5 academic academic ADJ crl-16846 3 6 libraries library NOUN crl-16846 3 7 are be AUX crl-16846 3 8 the the DET crl-16846 3 9 natural natural ADJ crl-16846 3 10 organizations organization NOUN crl-16846 3 11 to to PART crl-16846 3 12 lead lead VERB crl-16846 3 13 efforts effort NOUN crl-16846 3 14 to to PART crl-16846 3 15 implement implement VERB crl-16846 3 16 recommendations recommendation NOUN crl-16846 3 17 from from ADP crl-16846 3 18 journals journal NOUN crl-16846 3 19 , , PUNCT crl-16846 3 20 funders funder NOUN crl-16846 3 21 , , PUNCT crl-16846 3 22 and and CCONJ crl-16846 3 23 societies society NOUN crl-16846 3 24 to to PART crl-16846 3 25 improve improve VERB crl-16846 3 26 research research NOUN crl-16846 3 27 reproducibility reproducibility NOUN crl-16846 3 28 . . PUNCT crl-16846 4 1 in in ADP crl-16846 4 2 this this DET crl-16846 4 3 editorial editorial NOUN crl-16846 4 4 , , PUNCT crl-16846 4 5 we we PRON crl-16846 4 6 introduce introduce VERB crl-16846 4 7 the the DET crl-16846 4 8 reproducibility reproducibility NOUN crl-16846 4 9 crisis crisis NOUN crl-16846 4 10 , , PUNCT crl-16846 4 11 define define VERB crl-16846 4 12 reproducibility reproducibility NOUN crl-16846 4 13 and and CCONJ crl-16846 4 14 replicability replicability NOUN crl-16846 4 15 , , PUNCT crl-16846 4 16 and and CCONJ crl-16846 4 17 then then ADV crl-16846 4 18 discusses discuss VERB crl-16846 4 19 how how SCONJ crl-16846 4 20 academic academic ADJ crl-16846 4 21 libraries library NOUN crl-16846 4 22 can can AUX crl-16846 4 23 lead lead VERB crl-16846 4 24 institutional institutional ADJ crl-16846 4 25 support support NOUN crl-16846 4 26 for for ADP crl-16846 4 27 reproducible reproducible ADJ crl-16846 4 28 research research NOUN crl-16846 4 29 . . PUNCT crl-16846 5 1 background background NOUN crl-16846 5 2 concerns concern NOUN crl-16846 5 3 about about ADP crl-16846 5 4 the the DET crl-16846 5 5 reproducibility reproducibility NOUN crl-16846 5 6 of of ADP crl-16846 5 7 research research NOUN crl-16846 5 8 have have AUX crl-16846 5 9 become become VERB crl-16846 5 10 an an DET crl-16846 5 11 issue issue NOUN crl-16846 5 12 in in ADP crl-16846 5 13 a a DET crl-16846 5 14 number number NOUN crl-16846 5 15 disciplines discipline NOUN crl-16846 5 16 , , PUNCT crl-16846 5 17 including include VERB crl-16846 5 18 psychology,1 psychology,1 NOUN crl-16846 5 19 biology,2 biology,2 NOUN crl-16846 5 20 biomedicine,3 biomedicine,3 NOUN crl-16846 5 21 neuroscience,4 neuroscience,4 PROPN crl-16846 5 22 drug drug PROPN crl-16846 5 23 development,5 development,5 PROPN crl-16846 5 24 chemistry,6 chemistry,6 PROPN crl-16846 5 25 climate climate NOUN crl-16846 5 26 science,7 science,7 ADJ crl-16846 5 27 economics,8 economics,8 NOUN crl-16846 5 28 and and CCONJ crl-16846 5 29 education,9 education,9 NOUN crl-16846 5 30 among among ADP crl-16846 5 31 others other NOUN crl-16846 5 32 . . PUNCT crl-16846 6 1 one one NUM crl-16846 6 2 recent recent ADJ crl-16846 6 3 study study NOUN crl-16846 6 4 estimated estimate VERB crl-16846 6 5 the the DET crl-16846 6 6 cost cost NOUN crl-16846 6 7 of of ADP crl-16846 6 8 funding fund VERB crl-16846 6 9 irreproducible irreproducible ADJ crl-16846 6 10 research research NOUN crl-16846 6 11 at at ADP crl-16846 6 12 $ $ SYM crl-16846 6 13 28 28 NUM crl-16846 6 14 billion billion NUM crl-16846 6 15 a a DET crl-16846 6 16 year year NOUN crl-16846 6 17 in in ADP crl-16846 6 18 the the DET crl-16846 6 19 united united PROPN crl-16846 6 20 states states PROPN crl-16846 6 21 alone.10 alone.10 ADV crl-16846 6 22 a a DET crl-16846 6 23 number number NOUN crl-16846 6 24 of of ADP crl-16846 6 25 landmark landmark NOUN crl-16846 6 26 studies study NOUN crl-16846 6 27 have have AUX crl-16846 6 28 garnered garner VERB crl-16846 6 29 significant significant ADJ crl-16846 6 30 attention attention NOUN crl-16846 6 31 in in ADP crl-16846 6 32 both both CCONJ crl-16846 6 33 the the DET crl-16846 6 34 scientific scientific ADJ crl-16846 6 35 and and CCONJ crl-16846 6 36 popular popular ADJ crl-16846 6 37 press press NOUN crl-16846 6 38 . . PUNCT crl-16846 7 1 the the DET crl-16846 7 2 open open ADJ crl-16846 7 3 science science NOUN crl-16846 7 4 collaboration collaboration NOUN crl-16846 7 5 ’s ’s PART crl-16846 7 6 reproducibility reproducibility NOUN crl-16846 7 7 project project NOUN crl-16846 7 8 in in ADP crl-16846 7 9 psychology psychology NOUN crl-16846 7 10 is be AUX crl-16846 7 11 probably probably ADV crl-16846 7 12 the the DET crl-16846 7 13 most most ADV crl-16846 7 14 well well ADV crl-16846 7 15 - - PUNCT crl-16846 7 16 known know VERB crl-16846 7 17 of of ADP crl-16846 7 18 these these DET crl-16846 7 19 studies study NOUN crl-16846 7 20 . . PUNCT crl-16846 8 1 beginning begin VERB crl-16846 8 2 in in ADP crl-16846 8 3 2012 2012 NUM crl-16846 8 4 , , PUNCT crl-16846 8 5 the the DET crl-16846 8 6 project project NOUN crl-16846 8 7 sought seek VERB crl-16846 8 8 to to PART crl-16846 8 9 estimate estimate VERB crl-16846 8 10 the the DET crl-16846 8 11 reproducibility reproducibility NOUN crl-16846 8 12 of of ADP crl-16846 8 13 psychological psychological ADJ crl-16846 8 14 science science NOUN crl-16846 8 15 by by ADP crl-16846 8 16 having have VERB crl-16846 8 17 270 270 NUM crl-16846 8 18 authors author NOUN crl-16846 8 19 and and CCONJ crl-16846 8 20 86 86 NUM crl-16846 8 21 other other ADJ crl-16846 8 22 volunteers volunteer NOUN crl-16846 8 23 across across ADP crl-16846 8 24 41 41 NUM crl-16846 8 25 institutions institution NOUN crl-16846 8 26 replicate replicate VERB crl-16846 8 27 a a DET crl-16846 8 28 sample sample NOUN crl-16846 8 29 of of ADP crl-16846 8 30 100 100 NUM crl-16846 8 31 experiments.11 experiments.11 NOUN crl-16846 8 32 in in ADP crl-16846 8 33 2015 2015 NUM crl-16846 8 34 , , PUNCT crl-16846 8 35 they they PRON crl-16846 8 36 reported report VERB crl-16846 8 37 the the DET crl-16846 8 38 results result NOUN crl-16846 8 39 , , PUNCT crl-16846 8 40 using use VERB crl-16846 8 41 p p NOUN crl-16846 8 42 - - PUNCT crl-16846 8 43 values value NOUN crl-16846 8 44 , , PUNCT crl-16846 8 45 effect effect NOUN crl-16846 8 46 sizes size NOUN crl-16846 8 47 , , PUNCT crl-16846 8 48 and and CCONJ crl-16846 8 49 subjective subjective ADJ crl-16846 8 50 assessments assessment NOUN crl-16846 8 51 to to PART crl-16846 8 52 determine determine VERB crl-16846 8 53 if if SCONJ crl-16846 8 54 experiments experiment NOUN crl-16846 8 55 had have AUX crl-16846 8 56 been be AUX crl-16846 8 57 replicated replicate VERB crl-16846 8 58 . . PUNCT crl-16846 9 1 they they PRON crl-16846 9 2 found find VERB crl-16846 9 3 that that SCONJ crl-16846 9 4 only only ADV crl-16846 9 5 36 36 NUM crl-16846 9 6 percent percent NOUN crl-16846 9 7 of of ADP crl-16846 9 8 replicated replicate VERB crl-16846 9 9 experiments experiment NOUN crl-16846 9 10 had have VERB crl-16846 9 11 significant significant ADJ crl-16846 9 12 results result NOUN crl-16846 9 13 , , PUNCT crl-16846 9 14 47 47 NUM crl-16846 9 15 percent percent NOUN crl-16846 9 16 of of ADP crl-16846 9 17 original original ADJ crl-16846 9 18 effect effect NOUN crl-16846 9 19 sizes size NOUN crl-16846 9 20 were be AUX crl-16846 9 21 in in ADP crl-16846 9 22 the the DET crl-16846 9 23 95 95 NUM crl-16846 9 24 percent percent NOUN crl-16846 9 25 confidence confidence NOUN crl-16846 9 26 interval interval NOUN crl-16846 9 27 of of ADP crl-16846 9 28 the the DET crl-16846 9 29 replication replication NOUN crl-16846 9 30 effect effect NOUN crl-16846 9 31 size size NOUN crl-16846 9 32 , , PUNCT crl-16846 9 33 and and CCONJ crl-16846 9 34 the the DET crl-16846 9 35 researchers researcher NOUN crl-16846 9 36 who who PRON crl-16846 9 37 conducted conduct VERB crl-16846 9 38 the the DET crl-16846 9 39 replications replication NOUN crl-16846 9 40 subjectively subjectively ADV crl-16846 9 41 rated rate VERB crl-16846 9 42 only only ADV crl-16846 9 43 39 39 NUM crl-16846 9 44 percent percent NOUN crl-16846 9 45 of of ADP crl-16846 9 46 results result NOUN crl-16846 9 47 as as ADP crl-16846 9 48 having having AUX crl-16846 9 49 successfully successfully ADV crl-16846 9 50 replicated replicate VERB crl-16846 9 51 the the DET crl-16846 9 52 original original ADJ crl-16846 9 53 results.12 results.12 NOUN crl-16846 9 54 this this DET crl-16846 9 55 project project NOUN crl-16846 9 56 was be AUX crl-16846 9 57 covered cover VERB crl-16846 9 58 prominently prominently ADV crl-16846 9 59 in in ADP crl-16846 9 60 the the DET crl-16846 9 61 popular popular ADJ crl-16846 9 62 press press NOUN crl-16846 9 63 and and CCONJ crl-16846 9 64 received receive VERB crl-16846 9 65 considerable considerable ADJ crl-16846 9 66 attention.13 attention.13 NOUN crl-16846 9 67 also also ADV crl-16846 9 68 significant significant ADJ crl-16846 9 69 was be AUX crl-16846 9 70 a a DET crl-16846 9 71 2005 2005 NUM crl-16846 9 72 article article NOUN crl-16846 9 73 by by ADP crl-16846 9 74 john john PROPN crl-16846 9 75 ioannidis ioannidis PROPN crl-16846 9 76 provocatively provocatively ADV crl-16846 9 77 titled title VERB crl-16846 9 78 “ " PUNCT crl-16846 9 79 why why SCONJ crl-16846 9 80 most most ADV crl-16846 9 81 published publish VERB crl-16846 9 82 research research NOUN crl-16846 9 83 findings finding NOUN crl-16846 9 84 are be AUX crl-16846 9 85 false false ADJ crl-16846 9 86 . . PUNCT crl-16846 9 87 ” " PUNCT crl-16846 10 1 ioannidis ioannidi NOUN crl-16846 10 2 argued argue VERB crl-16846 10 3 that that SCONJ crl-16846 10 4 “ " PUNCT crl-16846 10 5 most most ADJ crl-16846 10 6 research research NOUN crl-16846 10 7 findings finding NOUN crl-16846 10 8 are be AUX crl-16846 10 9 false false ADJ crl-16846 10 10 for for ADP crl-16846 10 11 most most ADJ crl-16846 10 12 research research NOUN crl-16846 10 13 designs design NOUN crl-16846 10 14 and and CCONJ crl-16846 10 15 for for ADP crl-16846 10 16 most most ADJ crl-16846 10 17 fields field NOUN crl-16846 10 18 ” " PUNCT crl-16846 10 19 due due ADP crl-16846 10 20 to to ADP crl-16846 10 21 a a DET crl-16846 10 22 combination combination NOUN crl-16846 10 23 of of ADP crl-16846 10 24 biases bias NOUN crl-16846 10 25 in in ADP crl-16846 10 26 design design NOUN crl-16846 10 27 , , PUNCT crl-16846 10 28 analysis analysis NOUN crl-16846 10 29 , , PUNCT crl-16846 10 30 and and CCONJ crl-16846 10 31 reporting reporting NOUN crl-16846 10 32 ; ; PUNCT crl-16846 10 33 testing testing NOUN crl-16846 10 34 by by ADP crl-16846 10 35 multiple multiple ADJ crl-16846 10 36 independent independent ADJ crl-16846 10 37 teams team NOUN crl-16846 10 38 leading lead VERB crl-16846 10 39 to to ADP crl-16846 10 40 false false ADJ crl-16846 10 41 - - PUNCT crl-16846 10 42 positive positive ADJ crl-16846 10 43 findings finding NOUN crl-16846 10 44 being be AUX crl-16846 10 45 published publish VERB crl-16846 10 46 ; ; PUNCT crl-16846 10 47 and and CCONJ crl-16846 10 48 low low ADV crl-16846 10 49 - - PUNCT crl-16846 10 50 powered power VERB crl-16846 10 51 research research NOUN crl-16846 10 52 designs design NOUN crl-16846 10 53 . . PUNCT crl-16846 11 1 admitting admit VERB crl-16846 11 2 that that SCONJ crl-16846 11 3 there there PRON crl-16846 11 4 was be VERB crl-16846 11 5 no no DET crl-16846 11 6 way way NOUN crl-16846 11 7 to to PART crl-16846 11 8 reach reach VERB crl-16846 11 9 100 100 NUM crl-16846 11 10 percent percent NOUN crl-16846 11 11 certainty certainty NOUN crl-16846 11 12 , , PUNCT crl-16846 11 13 ioannidis ioannidi NOUN crl-16846 11 14 called call VERB crl-16846 11 15 for for ADP crl-16846 11 16 higher higher ADV crl-16846 11 17 - - PUNCT crl-16846 11 18 powered power VERB crl-16846 11 19 evidence evidence NOUN crl-16846 11 20 , , PUNCT crl-16846 11 21 fixing fix VERB crl-16846 11 22 publication publication NOUN crl-16846 11 23 bias bias NOUN crl-16846 11 24 , , PUNCT crl-16846 11 25 and and CCONJ crl-16846 11 26 addressing address VERB crl-16846 11 27 issues issue NOUN crl-16846 11 28 with with ADP crl-16846 11 29 other other ADJ crl-16846 11 30 forms form NOUN crl-16846 11 31 of of ADP crl-16846 11 32 bias.14 bias.14 NOUN crl-16846 11 33 while while SCONJ crl-16846 11 34 the the DET crl-16846 11 35 previously previously ADV crl-16846 11 36 listed list VERB crl-16846 11 37 studies study NOUN crl-16846 11 38 have have AUX crl-16846 11 39 focused focus VERB crl-16846 11 40 on on ADP crl-16846 11 41 the the DET crl-16846 11 42 reproducibility reproducibility NOUN crl-16846 11 43 of of ADP crl-16846 11 44 disciplines discipline NOUN crl-16846 11 45 , , PUNCT crl-16846 11 46 some some DET crl-16846 11 47 individual individual ADJ crl-16846 11 48 studies study NOUN crl-16846 11 49 that that PRON crl-16846 11 50 have have AUX crl-16846 11 51 failed fail VERB crl-16846 11 52 to to PART crl-16846 11 53 replicate replicate VERB crl-16846 11 54 have have AUX crl-16846 11 55 also also ADV crl-16846 11 56 received receive VERB crl-16846 11 57 substantial substantial ADJ crl-16846 11 58 attention attention NOUN crl-16846 11 59 . . PUNCT crl-16846 12 1 examples example NOUN crl-16846 12 2 include include VERB crl-16846 12 3 a a DET crl-16846 12 4 retracted retract VERB crl-16846 12 5 wakefield wakefield NOUN crl-16846 12 6 et et PROPN crl-16846 12 7 al al PROPN crl-16846 12 8 . . PROPN crl-16846 12 9 study study PROPN crl-16846 12 10 on on ADP crl-16846 12 11 the the DET crl-16846 12 12 mmr mmr PROPN crl-16846 12 13 vaccine vaccine NOUN crl-16846 12 14 and and CCONJ crl-16846 12 15 autism autism NOUN crl-16846 12 16 and and CCONJ crl-16846 12 17 a a DET crl-16846 12 18 lacour lacour NOUN crl-16846 12 19 and and CCONJ crl-16846 12 20 green green ADJ crl-16846 12 21 study study NOUN crl-16846 12 22 on on ADP crl-16846 12 23 political political ADJ crl-16846 12 24 canvassing canvass VERB crl-16846 12 25 and and CCONJ crl-16846 12 26 gay gay ADJ crl-16846 12 27 marriage marriage NOUN crl-16846 12 28 that that PRON crl-16846 12 29 included include VERB crl-16846 12 30 fabricated fabricate VERB crl-16846 12 31 data.15 data.15 NOUN crl-16846 12 32 another another DET crl-16846 12 33 example example NOUN crl-16846 12 34 is be AUX crl-16846 12 35 the the DET crl-16846 12 36 power power NOUN crl-16846 12 37 pose pose VERB crl-16846 12 38 research research NOUN crl-16846 12 39 of of ADP crl-16846 12 40 carney carney NOUN crl-16846 12 41 , , PUNCT crl-16846 12 42 cuddy cuddy PROPN crl-16846 12 43 , , PUNCT crl-16846 12 44 and and CCONJ crl-16846 12 45 yap yap PROPN crl-16846 12 46 , , PUNCT crl-16846 12 47 which which PRON crl-16846 12 48 has have AUX crl-16846 12 49 received receive VERB crl-16846 12 50 considerable considerable ADJ crl-16846 12 51 attention attention NOUN crl-16846 12 52 partly partly ADV crl-16846 12 53 due due ADP crl-16846 12 54 to to ADP crl-16846 12 55 a a DET crl-16846 12 56 widely widely ADV crl-16846 12 57 shared share VERB crl-16846 12 58 ted ted ADJ crl-16846 12 59 talk,16 talk,16 NOUN crl-16846 12 60 but but CCONJ crl-16846 12 61 , , PUNCT crl-16846 12 62 as as SCONJ crl-16846 12 63 noted note VERB crl-16846 12 64 in in ADP crl-16846 12 65 the the DET crl-16846 12 66 new new PROPN crl-16846 12 67 york york PROPN crl-16846 12 68 times times PROPN crl-16846 12 69 and and CCONJ crl-16846 12 70 other other ADJ crl-16846 12 71 venues venue NOUN crl-16846 12 72 , , PUNCT crl-16846 12 73 significant significant ADJ crl-16846 12 74 parts part NOUN crl-16846 12 75 of of ADP crl-16846 12 76 the the DET crl-16846 12 77 research research NOUN crl-16846 12 78 have have AUX crl-16846 12 79 not not PART crl-16846 12 80 been be AUX crl-16846 12 81 successfully successfully ADV crl-16846 12 82 replicated.17 replicated.17 ADJ crl-16846 12 83 doi:10.5860 doi:10.5860 PROPN crl-16846 12 84 / / SYM crl-16846 12 85 crl.79.1.2 crl.79.1.2 VERB crl-16846 12 86 https://doi.org/10.5860/crl.79.1.2 https://doi.org/10.5860/crl.79.1.2 ADJ crl-16846 12 87 editorial editorial NOUN crl-16846 12 88     SPACE crl-16846 12 89 3 3 NUM crl-16846 12 90 in in ADP crl-16846 12 91 2016 2016 NUM crl-16846 12 92 , , PUNCT crl-16846 12 93 nature nature NOUN crl-16846 12 94 conducted conduct VERB crl-16846 12 95 a a DET crl-16846 12 96 survey survey NOUN crl-16846 12 97 of of ADP crl-16846 12 98 1,576 1,576 NUM crl-16846 12 99 researchers researcher NOUN crl-16846 12 100 , , PUNCT crl-16846 12 101 which which PRON crl-16846 12 102 found find VERB crl-16846 12 103 that that SCONJ crl-16846 12 104 52 52 NUM crl-16846 12 105 percent percent NOUN crl-16846 12 106 believed believe VERB crl-16846 12 107 there there PRON crl-16846 12 108 was be VERB crl-16846 12 109 a a DET crl-16846 12 110 “ " PUNCT crl-16846 12 111 replication replication NOUN crl-16846 12 112 crisis crisis NOUN crl-16846 12 113 ” " PUNCT crl-16846 12 114 in in ADP crl-16846 12 115 science science NOUN crl-16846 12 116 , , PUNCT crl-16846 12 117 although although SCONJ crl-16846 12 118 less less ADJ crl-16846 12 119 than than ADP crl-16846 12 120 31 31 NUM crl-16846 12 121 percent percent NOUN crl-16846 12 122 of of ADP crl-16846 12 123 respondents respondent NOUN crl-16846 12 124 believed believe VERB crl-16846 12 125 that that SCONJ crl-16846 12 126 failures failure NOUN crl-16846 12 127 to to PART crl-16846 12 128 replicate replicate VERB crl-16846 12 129 meant mean VERB crl-16846 12 130 that that SCONJ crl-16846 12 131 studies study NOUN crl-16846 12 132 were be AUX crl-16846 12 133 necessarily necessarily ADV crl-16846 12 134 wrong.18 wrong.18 NOUN crl-16846 12 135 more more ADJ crl-16846 12 136 than than ADP crl-16846 12 137 70 70 NUM crl-16846 12 138 percent percent NOUN crl-16846 12 139 of of ADP crl-16846 12 140 respondents respondent NOUN crl-16846 12 141 reported report VERB crl-16846 12 142 having having AUX crl-16846 12 143 failed fail VERB crl-16846 12 144 to to PART crl-16846 12 145 reproduce reproduce VERB crl-16846 12 146 another another DET crl-16846 12 147 scientist scientist NOUN crl-16846 12 148 ’s ’s PART crl-16846 12 149 experiments experiment NOUN crl-16846 12 150 , , PUNCT crl-16846 12 151 and and CCONJ crl-16846 12 152 more more ADJ crl-16846 12 153 than than ADP crl-16846 12 154 60 60 NUM crl-16846 12 155 percent percent NOUN crl-16846 12 156 of of ADP crl-16846 12 157 researchers researcher NOUN crl-16846 12 158 reported report VERB crl-16846 12 159 that that SCONJ crl-16846 12 160 pressure pressure NOUN crl-16846 12 161 to to PART crl-16846 12 162 publish publish VERB crl-16846 12 163 and and CCONJ crl-16846 12 164 selective selective ADJ crl-16846 12 165 reporting reporting NOUN crl-16846 12 166 were be AUX crl-16846 12 167 major major ADJ crl-16846 12 168 factors factor NOUN crl-16846 12 169 that that PRON crl-16846 12 170 caused cause VERB crl-16846 12 171 problems problem NOUN crl-16846 12 172 with with ADP crl-16846 12 173 reproducibility.19 reproducibility.19 NOUN crl-16846 12 174 the the DET crl-16846 12 175 survey survey NOUN crl-16846 12 176 also also ADV crl-16846 12 177 showed show VERB crl-16846 12 178 evidence evidence NOUN crl-16846 12 179 of of ADP crl-16846 12 180 emerging emerge VERB crl-16846 12 181 responses response NOUN crl-16846 12 182 to to ADP crl-16846 12 183 the the DET crl-16846 12 184 crisis crisis NOUN crl-16846 12 185 , , PUNCT crl-16846 12 186 with with ADP crl-16846 12 187 more more ADJ crl-16846 12 188 than than ADP crl-16846 12 189 30 30 NUM crl-16846 12 190 percent percent NOUN crl-16846 12 191 reporting report VERB crl-16846 12 192 that that SCONJ crl-16846 12 193 they they PRON crl-16846 12 194 had have AUX crl-16846 12 195 taken take VERB crl-16846 12 196 steps step NOUN crl-16846 12 197 to to PART crl-16846 12 198 improve improve VERB crl-16846 12 199 reproducibility reproducibility NOUN crl-16846 12 200 in in ADP crl-16846 12 201 their their PRON crl-16846 12 202 research research NOUN crl-16846 12 203 in in ADP crl-16846 12 204 the the DET crl-16846 12 205 past past ADJ crl-16846 12 206 five five NUM crl-16846 12 207 years.20 years.20 NOUN crl-16846 12 208 definitions definition NOUN crl-16846 12 209 the the DET crl-16846 12 210 terms term NOUN crl-16846 12 211 reproducibility reproducibility NOUN crl-16846 12 212 and and CCONJ crl-16846 12 213 replicability replicability NOUN crl-16846 12 214 are be AUX crl-16846 12 215 frequently frequently ADV crl-16846 12 216 misused misuse VERB crl-16846 12 217 , , PUNCT crl-16846 12 218 and and CCONJ crl-16846 12 219 their their PRON crl-16846 12 220 ambiguous ambiguous ADJ crl-16846 12 221 and and CCONJ crl-16846 12 222 inconsistent inconsistent ADJ crl-16846 12 223 use use NOUN crl-16846 12 224 exists exist VERB crl-16846 12 225 across across ADP crl-16846 12 226 different different ADJ crl-16846 12 227 disciplines discipline NOUN crl-16846 12 228 and and CCONJ crl-16846 12 229 contexts context NOUN crl-16846 12 230 . . PUNCT crl-16846 13 1 goodman goodman PROPN crl-16846 13 2 , , PUNCT crl-16846 13 3 fanelli fanelli PROPN crl-16846 13 4 , , PUNCT crl-16846 13 5 and and CCONJ crl-16846 13 6 ioannidis ioannidi NOUN crl-16846 13 7 have have AUX crl-16846 13 8 written write VERB crl-16846 13 9 about about ADP crl-16846 13 10 how how SCONJ crl-16846 13 11 reproducibility reproducibility NOUN crl-16846 13 12 and and CCONJ crl-16846 13 13 replicability replicability NOUN crl-16846 13 14 , , PUNCT crl-16846 13 15 along along ADP crl-16846 13 16 with with ADP crl-16846 13 17 robustness robustness NOUN crl-16846 13 18 and and CCONJ crl-16846 13 19 generalizability generalizability NOUN crl-16846 13 20 , , PUNCT crl-16846 13 21 are be AUX crl-16846 13 22 not not PART crl-16846 13 23 standardized standardize VERB crl-16846 13 24 and and CCONJ crl-16846 13 25 that that SCONJ crl-16846 13 26 “ " PUNCT crl-16846 13 27 this this DET crl-16846 13 28 diverse diverse ADJ crl-16846 13 29 nomenclature nomenclature NOUN crl-16846 13 30 has have AUX crl-16846 13 31 led lead VERB crl-16846 13 32 to to ADP crl-16846 13 33 confusion confusion NOUN crl-16846 13 34 , , PUNCT crl-16846 13 35 both both CCONJ crl-16846 13 36 conceptual conceptual ADJ crl-16846 13 37 and and CCONJ crl-16846 13 38 operational operational ADJ crl-16846 13 39 , , PUNCT crl-16846 13 40 about about ADP crl-16846 13 41 what what PRON crl-16846 13 42 kind kind NOUN crl-16846 13 43 of of ADP crl-16846 13 44 confirmation confirmation NOUN crl-16846 13 45 is be AUX crl-16846 13 46 needed need VERB crl-16846 13 47 to to PART crl-16846 13 48 trust trust VERB crl-16846 13 49 a a DET crl-16846 13 50 given give VERB crl-16846 13 51 scientific scientific ADJ crl-16846 13 52 result result NOUN crl-16846 13 53 . . PUNCT crl-16846 14 1 ”21 ”21 PUNCT crl-16846 14 2 patil patil PROPN crl-16846 14 3 , , PUNCT crl-16846 14 4 peng peng PROPN crl-16846 14 5 , , PUNCT crl-16846 14 6 and and CCONJ crl-16846 14 7 leek leek NOUN crl-16846 14 8 have have AUX crl-16846 14 9 also also ADV crl-16846 14 10 written write VERB crl-16846 14 11 about about ADP crl-16846 14 12 the the DET crl-16846 14 13 general general ADJ crl-16846 14 14 ambiguity ambiguity NOUN crl-16846 14 15 of of ADP crl-16846 14 16 the the DET crl-16846 14 17 terms term NOUN crl-16846 14 18 , , PUNCT crl-16846 14 19 as as ADV crl-16846 14 20 well well ADV crl-16846 14 21 as as ADP crl-16846 14 22 how how SCONJ crl-16846 14 23 “ " PUNCT crl-16846 14 24 the the DET crl-16846 14 25 same same ADJ crl-16846 14 26 words word NOUN crl-16846 14 27 are be AUX crl-16846 14 28 used use VERB crl-16846 14 29 for for ADP crl-16846 14 30 different different ADJ crl-16846 14 31 concepts concept NOUN crl-16846 14 32 by by ADP crl-16846 14 33 different different ADJ crl-16846 14 34 people people NOUN crl-16846 14 35 in in ADP crl-16846 14 36 different different ADJ crl-16846 14 37 fields field NOUN crl-16846 14 38 . . PUNCT crl-16846 15 1 ”22 ”22 PROPN crl-16846 16 1 one one NUM crl-16846 16 2 succinct succinct ADJ crl-16846 16 3 definition definition NOUN crl-16846 16 4 was be AUX crl-16846 16 5 proposed propose VERB crl-16846 16 6 by by ADP crl-16846 16 7 national national PROPN crl-16846 16 8 science science PROPN crl-16846 16 9 foundation foundation PROPN crl-16846 16 10 ’s ’s PART crl-16846 16 11 ( ( PUNCT crl-16846 16 12 nsf nsf ADJ crl-16846 16 13 ) ) PUNCT crl-16846 16 14 social social ADJ crl-16846 16 15 , , PUNCT crl-16846 16 16 behavioral behavioral ADJ crl-16846 16 17 and and CCONJ crl-16846 16 18 economic economic ADJ crl-16846 16 19 ( ( PUNCT crl-16846 16 20 sbe sbe NOUN crl-16846 16 21 ) ) PUNCT crl-16846 16 22 division division NOUN crl-16846 16 23 subcommittee subcommittee NOUN crl-16846 16 24 on on ADP crl-16846 16 25 replicable replicable ADJ crl-16846 16 26 science science NOUN crl-16846 16 27 . . PUNCT crl-16846 17 1 in in ADP crl-16846 17 2 a a DET crl-16846 17 3 report report NOUN crl-16846 17 4 on on ADP crl-16846 17 5 how how SCONJ crl-16846 17 6 to to PART crl-16846 17 7 promote promote VERB crl-16846 17 8 robust robust ADJ crl-16846 17 9 research research NOUN crl-16846 17 10 practices practice NOUN crl-16846 17 11 , , PUNCT crl-16846 17 12 they they PRON crl-16846 17 13 define define VERB crl-16846 17 14 reproducibility reproducibility NOUN crl-16846 17 15 as as ADP crl-16846 17 16 “ " PUNCT crl-16846 17 17 the the DET crl-16846 17 18 ability ability NOUN crl-16846 17 19 of of ADP crl-16846 17 20 a a DET crl-16846 17 21 researcher researcher NOUN crl-16846 17 22 to to PART crl-16846 17 23 duplicate duplicate VERB crl-16846 17 24 the the DET crl-16846 17 25 results result NOUN crl-16846 17 26 of of ADP crl-16846 17 27 a a DET crl-16846 17 28 prior prior ADJ crl-16846 17 29 study study NOUN crl-16846 17 30 using use VERB crl-16846 17 31 the the DET crl-16846 17 32 same same ADJ crl-16846 17 33 materials material NOUN crl-16846 17 34 and and CCONJ crl-16846 17 35 procedures procedure NOUN crl-16846 17 36 [ [ X crl-16846 17 37 emphasis emphasis NOUN crl-16846 17 38 added add VERB crl-16846 17 39 ] ] PUNCT crl-16846 17 40 as as SCONJ crl-16846 17 41 were be AUX crl-16846 17 42 used use VERB crl-16846 17 43 by by ADP crl-16846 17 44 the the DET crl-16846 17 45 original original ADJ crl-16846 17 46 investigator investigator NOUN crl-16846 17 47 . . PUNCT crl-16846 17 48 ”23 ”23 PUNCT crl-16846 18 1 according accord VERB crl-16846 18 2 to to ADP crl-16846 18 3 this this DET crl-16846 18 4 definition definition NOUN crl-16846 18 5 , , PUNCT crl-16846 18 6 reproducibility reproducibility NOUN crl-16846 18 7 uses use VERB crl-16846 18 8 the the DET crl-16846 18 9 same same ADJ crl-16846 18 10 methods method NOUN crl-16846 18 11 and and CCONJ crl-16846 18 12 data datum NOUN crl-16846 18 13 to to PART crl-16846 18 14 confirm confirm VERB crl-16846 18 15 the the DET crl-16846 18 16 results result NOUN crl-16846 18 17 of of ADP crl-16846 18 18 an an DET crl-16846 18 19 experiment experiment NOUN crl-16846 18 20 . . PUNCT crl-16846 19 1 the the DET crl-16846 19 2 sbe sbe NOUN crl-16846 19 3 defines define VERB crl-16846 19 4 replicability replicability NOUN crl-16846 19 5 as as ADP crl-16846 19 6 “ " PUNCT crl-16846 19 7 the the DET crl-16846 19 8 ability ability NOUN crl-16846 19 9 of of ADP crl-16846 19 10 a a DET crl-16846 19 11 researcher researcher NOUN crl-16846 19 12 to to PART crl-16846 19 13 duplicate duplicate VERB crl-16846 19 14 the the DET crl-16846 19 15 results result NOUN crl-16846 19 16 of of ADP crl-16846 19 17 a a DET crl-16846 19 18 prior prior ADJ crl-16846 19 19 study study NOUN crl-16846 19 20 if if SCONJ crl-16846 19 21 the the DET crl-16846 19 22 same same ADJ crl-16846 19 23 procedures procedure NOUN crl-16846 19 24 are be AUX crl-16846 19 25 followed follow VERB crl-16846 19 26 but but CCONJ crl-16846 19 27 new new ADJ crl-16846 19 28 data datum NOUN crl-16846 19 29 are be AUX crl-16846 19 30 collected collect VERB crl-16846 19 31 [ [ X crl-16846 19 32 emphasis emphasis NOUN crl-16846 19 33 added].”24 added].”24 VERB crl-16846 19 34 thus thus ADV crl-16846 19 35 , , PUNCT crl-16846 19 36 replicability replicability NOUN crl-16846 19 37 goes go VERB crl-16846 19 38 a a DET crl-16846 19 39 step step NOUN crl-16846 19 40 further far ADV crl-16846 19 41 , , PUNCT crl-16846 19 42 gathering gather VERB crl-16846 19 43 new new ADJ crl-16846 19 44 data datum NOUN crl-16846 19 45 to to PART crl-16846 19 46 confirm confirm VERB crl-16846 19 47 an an DET crl-16846 19 48 earlier early ADJ crl-16846 19 49 finding finding NOUN crl-16846 19 50 . . PUNCT crl-16846 20 1 leek leek NOUN crl-16846 20 2 and and CCONJ crl-16846 20 3 jager jager NOUN crl-16846 20 4 also also ADV crl-16846 20 5 reinforce reinforce VERB crl-16846 20 6 this this DET crl-16846 20 7 definition definition NOUN crl-16846 20 8 , , PUNCT crl-16846 20 9 noting note VERB crl-16846 20 10 that that SCONJ crl-16846 20 11 “ " PUNCT crl-16846 20 12 [ [ X crl-16846 20 13 a a X crl-16846 20 14 ] ] X crl-16846 20 15 study study NOUN crl-16846 20 16 is be AUX crl-16846 20 17 reproducible reproducible ADJ crl-16846 20 18 if if SCONJ crl-16846 20 19 all all PRON crl-16846 20 20 of of ADP crl-16846 20 21 the the DET crl-16846 20 22 code code NOUN crl-16846 20 23 and and CCONJ crl-16846 20 24 data datum NOUN crl-16846 20 25 used use VERB crl-16846 20 26 to to PART crl-16846 20 27 generate generate VERB crl-16846 20 28 the the DET crl-16846 20 29 numbers number NOUN crl-16846 20 30 and and CCONJ crl-16846 20 31 figures figure NOUN crl-16846 20 32 in in ADP crl-16846 20 33 the the DET crl-16846 20 34 paper paper NOUN crl-16846 20 35 are be AUX crl-16846 20 36 available available ADJ crl-16846 20 37 and and CCONJ crl-16846 20 38 exactly exactly ADV crl-16846 20 39 produce produce VERB crl-16846 20 40 the the DET crl-16846 20 41 published publish VERB crl-16846 20 42 results result NOUN crl-16846 20 43 . . PUNCT crl-16846 21 1 ”25 ”25 PROPN crl-16846 21 2 broman broman PROPN crl-16846 21 3 et et PROPN crl-16846 22 1 al al PROPN crl-16846 22 2 . . PROPN crl-16846 22 3 point point VERB crl-16846 22 4 out out ADP crl-16846 22 5 that that SCONJ crl-16846 22 6 this this PRON crl-16846 22 7 means mean VERB crl-16846 22 8 reproducibility reproducibility NOUN crl-16846 22 9 “ " PUNCT crl-16846 22 10 is be AUX crl-16846 22 11 the the DET crl-16846 22 12 only only ADJ crl-16846 22 13 thing thing NOUN crl-16846 22 14 that that PRON crl-16846 22 15 can can AUX crl-16846 22 16 be be AUX crl-16846 22 17 effectively effectively ADV crl-16846 22 18 guaranteed guarantee VERB crl-16846 22 19 in in ADP crl-16846 22 20 a a DET crl-16846 22 21 published publish VERB crl-16846 22 22 study study NOUN crl-16846 22 23 . . PUNCT crl-16846 23 1 whether whether SCONJ crl-16846 23 2 any any DET crl-16846 23 3 claimed claim VERB crl-16846 23 4 findings finding NOUN crl-16846 23 5 are be AUX crl-16846 23 6 indeed indeed ADV crl-16846 23 7 true true ADJ crl-16846 23 8 or or CCONJ crl-16846 23 9 false false ADJ crl-16846 23 10 can can AUX crl-16846 23 11 only only ADV crl-16846 23 12 be be AUX crl-16846 23 13 confirmed confirm VERB crl-16846 23 14 via via ADP crl-16846 23 15 additional additional ADJ crl-16846 23 16 studies study NOUN crl-16846 23 17 , , PUNCT crl-16846 23 18 but but CCONJ crl-16846 23 19 reproducibility reproducibility NOUN crl-16846 23 20 can can AUX crl-16846 23 21 be be AUX crl-16846 23 22 confirmed confirm VERB crl-16846 23 23 immediately immediately ADV crl-16846 23 24 . . PUNCT crl-16846 23 25 ”26 ”26 PUNCT crl-16846 24 1 generally generally ADV crl-16846 24 2 , , PUNCT crl-16846 24 3 the the DET crl-16846 24 4 term term NOUN crl-16846 24 5 “ " PUNCT crl-16846 24 6 reproducibility reproducibility NOUN crl-16846 24 7 ” " PUNCT crl-16846 24 8 has have AUX crl-16846 24 9 stood stand VERB crl-16846 24 10 in in ADP crl-16846 24 11 for for ADP crl-16846 24 12 both both CCONJ crl-16846 24 13 the the DET crl-16846 24 14 concepts concept NOUN crl-16846 24 15 of of ADP crl-16846 24 16 reproducibility reproducibility NOUN crl-16846 24 17 and and CCONJ crl-16846 24 18 replicability replicability NOUN crl-16846 24 19 . . PUNCT crl-16846 25 1 even even ADV crl-16846 25 2 the the DET crl-16846 25 3 open open ADJ crl-16846 25 4 science science NOUN crl-16846 25 5 collaboration collaboration NOUN crl-16846 25 6 ’s ’s PART crl-16846 25 7 reproducibility reproducibility NOUN crl-16846 25 8 project project NOUN crl-16846 25 9 , , PUNCT crl-16846 25 10 perhaps perhaps ADV crl-16846 25 11 the the DET crl-16846 25 12 best well ADV crl-16846 25 13 known know VERB crl-16846 25 14 attempt attempt NOUN crl-16846 25 15 at at ADP crl-16846 25 16 replication replication NOUN crl-16846 25 17 , , PUNCT crl-16846 25 18 used use VERB crl-16846 25 19 the the DET crl-16846 25 20 term term NOUN crl-16846 25 21 reproducibility reproducibility NOUN crl-16846 25 22 in in ADP crl-16846 25 23 the the DET crl-16846 25 24 title title NOUN crl-16846 25 25 . . PUNCT crl-16846 26 1 this this DET crl-16846 26 2 article article NOUN crl-16846 26 3 will will AUX crl-16846 26 4 focus focus VERB crl-16846 26 5 primarily primarily ADV crl-16846 26 6 on on ADP crl-16846 26 7 reproducibility reproducibility NOUN crl-16846 26 8 as as SCONJ crl-16846 26 9 defined define VERB crl-16846 26 10 above above ADV crl-16846 26 11 , , PUNCT crl-16846 26 12 with with ADP crl-16846 26 13 the the DET crl-16846 26 14 understanding understanding NOUN crl-16846 26 15 that that SCONJ crl-16846 26 16 measures measure NOUN crl-16846 26 17 that that PRON crl-16846 26 18 improve improve VERB crl-16846 26 19 reproducibility reproducibility NOUN crl-16846 26 20 are be AUX crl-16846 26 21 a a DET crl-16846 26 22 prerequisite prerequisite NOUN crl-16846 26 23 for for ADP crl-16846 26 24 improving improve VERB crl-16846 26 25 replicability replicability NOUN crl-16846 26 26 . . PUNCT crl-16846 27 1 guidelines guideline NOUN crl-16846 27 2 to to PART crl-16846 27 3 address address VERB crl-16846 27 4 the the DET crl-16846 27 5 reproducibility reproducibility NOUN crl-16846 27 6 crisis crisis NOUN crl-16846 27 7 , , PUNCT crl-16846 27 8 many many ADJ crl-16846 27 9 stakeholders stakeholder NOUN crl-16846 27 10 , , PUNCT crl-16846 27 11 including include VERB crl-16846 27 12 funders funder NOUN crl-16846 27 13 , , PUNCT crl-16846 27 14 journals journal NOUN crl-16846 27 15 , , PUNCT crl-16846 27 16 scientific scientific ADJ crl-16846 27 17 societies society NOUN crl-16846 27 18 , , PUNCT crl-16846 27 19 institutions institution NOUN crl-16846 27 20 , , PUNCT crl-16846 27 21 and and CCONJ crl-16846 27 22 individual individual ADJ crl-16846 27 23 researchers researcher NOUN crl-16846 27 24 , , PUNCT crl-16846 27 25 have have AUX crl-16846 27 26 developed develop VERB crl-16846 27 27 reproducibility reproducibility NOUN crl-16846 27 28 guidelines guideline NOUN crl-16846 27 29 and and CCONJ crl-16846 27 30 recommendations recommendation NOUN crl-16846 27 31 . . PUNCT crl-16846 28 1 a a DET crl-16846 28 2 review review NOUN crl-16846 28 3 of of ADP crl-16846 28 4 the the DET crl-16846 28 5 recommendations recommendation NOUN crl-16846 28 6 in in ADP crl-16846 28 7 these these DET crl-16846 28 8 guidelines guideline NOUN crl-16846 28 9 demonstrates demonstrate VERB crl-16846 28 10 that that SCONJ crl-16846 28 11 academic academic ADJ crl-16846 28 12 libraries library NOUN crl-16846 28 13 have have VERB crl-16846 28 14 a a DET crl-16846 28 15 considerable considerable ADJ crl-16846 28 16 role role NOUN crl-16846 28 17 in in ADP crl-16846 28 18 making make VERB crl-16846 28 19 research research NOUN crl-16846 28 20 more more ADV crl-16846 28 21 reproducible reproducible ADJ crl-16846 28 22 . . PUNCT crl-16846 29 1 one one NUM crl-16846 29 2 prominent prominent ADJ crl-16846 29 3 example example NOUN crl-16846 29 4 is be AUX crl-16846 29 5 the the DET crl-16846 29 6 transparency transparency NOUN crl-16846 29 7 and and CCONJ crl-16846 29 8 openness openness NOUN crl-16846 29 9 promotion promotion NOUN crl-16846 29 10 ( ( PUNCT crl-16846 29 11 top top ADJ crl-16846 29 12 ) ) PUNCT crl-16846 29 13 guidelines guideline NOUN crl-16846 29 14 , , PUNCT crl-16846 29 15 a a DET crl-16846 29 16 set set NOUN crl-16846 29 17 of of ADP crl-16846 29 18 eight eight NUM crl-16846 29 19 standards standard NOUN crl-16846 29 20 for for ADP crl-16846 29 21 academic academic ADJ crl-16846 29 22 journals journal NOUN crl-16846 29 23 created create VERB crl-16846 29 24 in in ADP crl-16846 29 25 2014 2014 NUM crl-16846 29 26 by by ADP crl-16846 29 27 the the DET crl-16846 29 28 center center NOUN crl-16846 29 29 for for ADP crl-16846 29 30 open open ADJ crl-16846 29 31 science science NOUN crl-16846 29 32 ( ( PUNCT crl-16846 29 33 cos cos PROPN crl-16846 29 34 ) ) PUNCT crl-16846 29 35 , , PUNCT crl-16846 29 36 disciplinary disciplinary ADJ crl-16846 29 37 leaders leader NOUN crl-16846 29 38 , , PUNCT crl-16846 29 39 journal journal NOUN crl-16846 29 40 editors editor NOUN crl-16846 29 41 , , PUNCT crl-16846 29 42 funding funding NOUN crl-16846 29 43 agency agency NOUN crl-16846 29 44 representa4 representa4 PROPN crl-16846 29 45     SPACE crl-16846 29 46 college college PROPN crl-16846 29 47 & & CCONJ crl-16846 29 48 research research PROPN crl-16846 29 49 libraries librarie VERB crl-16846 29 50 january january PROPN crl-16846 29 51 2018 2018 NUM crl-16846 29 52 tives tive NOUN crl-16846 29 53 , , PUNCT crl-16846 29 54 and and CCONJ crl-16846 29 55 disciplinary disciplinary ADJ crl-16846 29 56 experts.27 experts.27 NOUN crl-16846 29 57 the the DET crl-16846 29 58 center center NOUN crl-16846 29 59 for for ADP crl-16846 29 60 open open ADJ crl-16846 29 61 science science NOUN crl-16846 29 62 is be AUX crl-16846 29 63 a a DET crl-16846 29 64 nonprofit nonprofit ADJ crl-16846 29 65 started start VERB crl-16846 29 66 in in ADP crl-16846 29 67 2013 2013 NUM crl-16846 29 68 with with ADP crl-16846 29 69 a a DET crl-16846 29 70 goal goal NOUN crl-16846 29 71 “ " PUNCT crl-16846 29 72 to to PART crl-16846 29 73 increase increase VERB crl-16846 29 74 openness openness NOUN crl-16846 29 75 , , PUNCT crl-16846 29 76 integrity integrity NOUN crl-16846 29 77 , , PUNCT crl-16846 29 78 and and CCONJ crl-16846 29 79 reproducibility reproducibility NOUN crl-16846 29 80 of of ADP crl-16846 29 81 research research NOUN crl-16846 29 82 . . PUNCT crl-16846 30 1 ”28 ”28 NOUN crl-16846 30 2 the the DET crl-16846 30 3 guidelines guideline NOUN crl-16846 30 4 are be AUX crl-16846 30 5 meant mean VERB crl-16846 30 6 to to PART crl-16846 30 7 be be AUX crl-16846 30 8 flexible flexible ADJ crl-16846 30 9 enough enough ADV crl-16846 30 10 to to PART crl-16846 30 11 be be AUX crl-16846 30 12 applied apply VERB crl-16846 30 13 across across ADP crl-16846 30 14 disciplines discipline NOUN crl-16846 30 15 , , PUNCT crl-16846 30 16 and and CCONJ crl-16846 30 17 each each DET crl-16846 30 18 standard standard NOUN crl-16846 30 19 can can AUX crl-16846 30 20 be be AUX crl-16846 30 21 implemented implement VERB crl-16846 30 22 at at ADP crl-16846 30 23 one one NUM crl-16846 30 24 of of ADP crl-16846 30 25 three three NUM crl-16846 30 26 levels level NOUN crl-16846 30 27 : : PUNCT crl-16846 30 28 1 1 X crl-16846 30 29 ) ) PUNCT crl-16846 30 30 disclosure disclosure NOUN crl-16846 30 31 , , PUNCT crl-16846 30 32 2 2 NUM crl-16846 30 33 ) ) PUNCT crl-16846 30 34 mandating mandating NOUN crl-16846 30 35 , , PUNCT crl-16846 30 36 or or CCONJ crl-16846 30 37 3 3 NUM crl-16846 30 38 ) ) PUNCT crl-16846 30 39 verification verification NOUN crl-16846 30 40 . . PUNCT crl-16846 31 1 for for ADP crl-16846 31 2 example example NOUN crl-16846 31 3 , , PUNCT crl-16846 31 4 for for ADP crl-16846 31 5 the the DET crl-16846 31 6 “ " PUNCT crl-16846 31 7 data datum NOUN crl-16846 31 8 transparency transparency NOUN crl-16846 31 9 ” " PUNCT crl-16846 31 10 standard standard NOUN crl-16846 31 11 , , PUNCT crl-16846 31 12 the the DET crl-16846 31 13 first first ADJ crl-16846 31 14 level level NOUN crl-16846 31 15 would would AUX crl-16846 31 16 require require VERB crl-16846 31 17 that that SCONJ crl-16846 31 18 authors author NOUN crl-16846 31 19 state state VERB crl-16846 31 20 whether whether SCONJ crl-16846 31 21 the the DET crl-16846 31 22 underlying underlie VERB crl-16846 31 23 data datum NOUN crl-16846 31 24 are be AUX crl-16846 31 25 available available ADJ crl-16846 31 26 , , PUNCT crl-16846 31 27 the the DET crl-16846 31 28 second second ADJ crl-16846 31 29 level level NOUN crl-16846 31 30 would would AUX crl-16846 31 31 mandate mandate VERB crl-16846 31 32 that that SCONJ crl-16846 31 33 data datum NOUN crl-16846 31 34 be be AUX crl-16846 31 35 shared share VERB crl-16846 31 36 , , PUNCT crl-16846 31 37 and and CCONJ crl-16846 31 38 the the DET crl-16846 31 39 third third ADJ crl-16846 31 40 level level NOUN crl-16846 31 41 would would AUX crl-16846 31 42 include include VERB crl-16846 31 43 the the DET crl-16846 31 44 journal journal NOUN crl-16846 31 45 verifying verifying NOUN crl-16846 31 46 that that SCONJ crl-16846 31 47 the the DET crl-16846 31 48 data datum NOUN crl-16846 31 49 have have AUX crl-16846 31 50 been be AUX crl-16846 31 51 made make VERB crl-16846 31 52 available available ADJ crl-16846 31 53 . . PUNCT crl-16846 32 1 this this DET crl-16846 32 2 modular modular ADJ crl-16846 32 3 framework framework NOUN crl-16846 32 4 recognizes recognize VERB crl-16846 32 5 that that SCONJ crl-16846 32 6 there there PRON crl-16846 32 7 are be VERB crl-16846 32 8 different different ADJ crl-16846 32 9 disciplinary disciplinary ADJ crl-16846 32 10 norms norm NOUN crl-16846 32 11 for for ADP crl-16846 32 12 transparency transparency NOUN crl-16846 32 13 and and CCONJ crl-16846 32 14 abilities ability NOUN crl-16846 32 15 to to PART crl-16846 32 16 implement implement VERB crl-16846 32 17 change change NOUN crl-16846 32 18 across across ADP crl-16846 32 19 disciplines discipline NOUN crl-16846 32 20 . . PUNCT crl-16846 33 1 as as ADP crl-16846 33 2 of of ADP crl-16846 33 3 october october PROPN crl-16846 33 4 2017 2017 NUM crl-16846 33 5 , , PUNCT crl-16846 33 6 more more ADJ crl-16846 33 7 than than ADP crl-16846 33 8 5,000 5,000 NUM crl-16846 33 9 journals journal NOUN crl-16846 33 10 and and CCONJ crl-16846 33 11 societies society NOUN crl-16846 33 12 have have AUX crl-16846 33 13 signed sign VERB crl-16846 33 14 on on ADP crl-16846 33 15 to to ADP crl-16846 33 16 the the DET crl-16846 33 17 top top ADJ crl-16846 33 18 guidelines.29 guidelines.29 NOUN crl-16846 33 19 in in ADP crl-16846 33 20 september september PROPN crl-16846 33 21 2017 2017 NUM crl-16846 33 22 , , PUNCT crl-16846 33 23 elsevier elsevier ADV crl-16846 33 24 announced announce VERB crl-16846 33 25 new new ADJ crl-16846 33 26 data datum NOUN crl-16846 33 27 guidelines guideline NOUN crl-16846 33 28 across across ADP crl-16846 33 29 1,800 1,800 NUM crl-16846 33 30 journals journal NOUN crl-16846 33 31 that that PRON crl-16846 33 32 align align VERB crl-16846 33 33 with with ADP crl-16846 33 34 the the DET crl-16846 33 35 top top ADJ crl-16846 33 36 guidelines.30 guidelines.30 NOUN crl-16846 33 37 the the DET crl-16846 33 38 top top ADJ crl-16846 33 39 guidelines guideline NOUN crl-16846 33 40 contain contain VERB crl-16846 33 41 many many ADJ crl-16846 33 42 recommendations recommendation NOUN crl-16846 33 43 that that SCONJ crl-16846 33 44 academic academic ADJ crl-16846 33 45 librarians librarian NOUN crl-16846 33 46 who who PRON crl-16846 33 47 support support VERB crl-16846 33 48 research research NOUN crl-16846 33 49 , , PUNCT crl-16846 33 50 scholarly scholarly ADJ crl-16846 33 51 communication communication NOUN crl-16846 33 52 , , PUNCT crl-16846 33 53 and and CCONJ crl-16846 33 54 research research NOUN crl-16846 33 55 data datum NOUN crl-16846 33 56 management management NOUN crl-16846 33 57 will will AUX crl-16846 33 58 find find VERB crl-16846 33 59 familiar:31 familiar:31 PRON crl-16846 33 60 • • ADJ crl-16846 33 61 citation citation NOUN crl-16846 33 62 : : PUNCT crl-16846 33 63 proper proper ADJ crl-16846 33 64 citing citing NOUN crl-16846 33 65 of of ADP crl-16846 33 66 data data NOUN crl-16846 33 67 , , PUNCT crl-16846 33 68 code code NOUN crl-16846 33 69 , , PUNCT crl-16846 33 70 and and CCONJ crl-16846 33 71 materials material NOUN crl-16846 33 72 and and CCONJ crl-16846 33 73 the the DET crl-16846 33 74 recognition recognition NOUN crl-16846 33 75 of of ADP crl-16846 33 76 these these DET crl-16846 33 77 products product NOUN crl-16846 33 78 as as ADP crl-16846 33 79 legitimate legitimate ADJ crl-16846 33 80 intellectual intellectual ADJ crl-16846 33 81 contributions contribution NOUN crl-16846 33 82 to to ADP crl-16846 33 83 science science NOUN crl-16846 33 84 . . PUNCT crl-16846 34 1 ( ( PUNCT crl-16846 34 2 standard standard PROPN crl-16846 34 3 1 1 NUM crl-16846 34 4 ) ) PUNCT crl-16846 34 5 • • VERB crl-16846 34 6 data data NOUN crl-16846 34 7 transparency transparency NOUN crl-16846 34 8 , , PUNCT crl-16846 34 9 analytic analytic ADJ crl-16846 34 10 methods method NOUN crl-16846 34 11 ( ( PUNCT crl-16846 34 12 code code NOUN crl-16846 34 13 ) ) PUNCT crl-16846 34 14 transparency transparency NOUN crl-16846 34 15 , , PUNCT crl-16846 34 16 research research NOUN crl-16846 34 17 materials material NOUN crl-16846 34 18 transparency transparency NOUN crl-16846 34 19 : : PUNCT crl-16846 34 20 these these DET crl-16846 34 21 three three NUM crl-16846 34 22 distinct distinct ADJ crl-16846 34 23 standards standard NOUN crl-16846 34 24 relate relate VERB crl-16846 34 25 to to ADP crl-16846 34 26 the the DET crl-16846 34 27 degree degree NOUN crl-16846 34 28 to to PART crl-16846 34 29 which which PRON crl-16846 34 30 data data NOUN crl-16846 34 31 , , PUNCT crl-16846 34 32 code code NOUN crl-16846 34 33 , , PUNCT crl-16846 34 34 and and CCONJ crl-16846 34 35 research research NOUN crl-16846 34 36 materials material NOUN crl-16846 34 37 are be AUX crl-16846 34 38 made make VERB crl-16846 34 39 available available ADJ crl-16846 34 40 to to ADP crl-16846 34 41 other other ADJ crl-16846 34 42 researchers researcher NOUN crl-16846 34 43 to to PART crl-16846 34 44 enable enable VERB crl-16846 34 45 reproducibility reproducibility NOUN crl-16846 34 46 and and CCONJ crl-16846 34 47 replication replication NOUN crl-16846 34 48 . . PUNCT crl-16846 35 1 ( ( PUNCT crl-16846 35 2 standard standard PROPN crl-16846 35 3 2 2 NUM crl-16846 35 4 , , PUNCT crl-16846 35 5 3 3 NUM crl-16846 35 6 , , PUNCT crl-16846 35 7 4 4 NUM crl-16846 35 8 ) ) PUNCT crl-16846 35 9 • • ADJ crl-16846 35 10 design design NOUN crl-16846 35 11 and and CCONJ crl-16846 35 12 analysis analysis NOUN crl-16846 35 13 transparency transparency NOUN crl-16846 35 14 : : PUNCT crl-16846 35 15 this this DET crl-16846 35 16 standard standard NOUN crl-16846 35 17 encourages encourage VERB crl-16846 35 18 authors author NOUN crl-16846 35 19 to to PART crl-16846 35 20 follow follow VERB crl-16846 35 21 explicit explicit ADJ crl-16846 35 22 guidelines guideline NOUN crl-16846 35 23 for for ADP crl-16846 35 24 disclosing disclose VERB crl-16846 35 25 key key ADJ crl-16846 35 26 aspects aspect NOUN crl-16846 35 27 of of ADP crl-16846 35 28 research research NOUN crl-16846 35 29 design design NOUN crl-16846 35 30 and and CCONJ crl-16846 35 31 analysis analysis NOUN crl-16846 35 32 . . PUNCT crl-16846 36 1 for for ADP crl-16846 36 2 example example NOUN crl-16846 36 3 , , PUNCT crl-16846 36 4 the the DET crl-16846 36 5 prisma prisma NOUN crl-16846 36 6 guidelines guideline NOUN crl-16846 36 7 outline outline VERB crl-16846 36 8 explicit explicit ADJ crl-16846 36 9 standards standard NOUN crl-16846 36 10 for for ADP crl-16846 36 11 reporting report VERB crl-16846 36 12 systematic systematic ADJ crl-16846 36 13 review review NOUN crl-16846 36 14 research research NOUN crl-16846 36 15 , , PUNCT crl-16846 36 16 and and CCONJ crl-16846 36 17 the the DET crl-16846 36 18 arrive arrive ADJ crl-16846 36 19 guidelines guideline NOUN crl-16846 36 20 outline outline VERB crl-16846 36 21 similar similar ADJ crl-16846 36 22 standards standard NOUN crl-16846 36 23 for for ADP crl-16846 36 24 reporting report VERB crl-16846 36 25 animal animal NOUN crl-16846 36 26 research research NOUN crl-16846 36 27 . . PUNCT crl-16846 37 1 ( ( PUNCT crl-16846 37 2 standard standard ADJ crl-16846 37 3 5 5 NUM crl-16846 37 4 ) ) PUNCT crl-16846 37 5 • • ADJ crl-16846 37 6 preregistration preregistration NOUN crl-16846 37 7 of of ADP crl-16846 37 8 studies study NOUN crl-16846 37 9 , , PUNCT crl-16846 37 10 preregistration preregistration NOUN crl-16846 37 11 of of ADP crl-16846 37 12 analysis analysis NOUN crl-16846 37 13 plans plan NOUN crl-16846 37 14 : : PUNCT crl-16846 37 15 preregistration preregistration NOUN crl-16846 37 16 of of ADP crl-16846 37 17 studies study NOUN crl-16846 37 18 involves involve VERB crl-16846 37 19 publicly publicly ADV crl-16846 37 20 declaring declare VERB crl-16846 37 21 the the DET crl-16846 37 22 research research NOUN crl-16846 37 23 you you PRON crl-16846 37 24 are be AUX crl-16846 37 25 conducting conduct VERB crl-16846 37 26 in in ADP crl-16846 37 27 advance advance NOUN crl-16846 37 28 , , PUNCT crl-16846 37 29 thereby thereby ADV crl-16846 37 30 increasing increase VERB crl-16846 37 31 discovery discovery NOUN crl-16846 37 32 of of ADP crl-16846 37 33 research research NOUN crl-16846 37 34 that that PRON crl-16846 37 35 was be AUX crl-16846 37 36 not not PART crl-16846 37 37 published publish VERB crl-16846 37 38 ( ( PUNCT crl-16846 37 39 thus thus ADV crl-16846 37 40 addressing address VERB crl-16846 37 41 publication publication NOUN crl-16846 37 42 bias bias NOUN crl-16846 37 43 ) ) PUNCT crl-16846 37 44 . . PUNCT crl-16846 38 1 preregistration preregistration NOUN crl-16846 38 2 of of ADP crl-16846 38 3 analysis analysis NOUN crl-16846 38 4 plans plan NOUN crl-16846 38 5 goes go VERB crl-16846 38 6 a a DET crl-16846 38 7 step step NOUN crl-16846 38 8 further far ADV crl-16846 38 9 by by ADP crl-16846 38 10 including include VERB crl-16846 38 11 details detail NOUN crl-16846 38 12 about about ADP crl-16846 38 13 planned plan VERB crl-16846 38 14 analysis analysis NOUN crl-16846 38 15 , , PUNCT crl-16846 38 16 preventing prevent VERB crl-16846 38 17 problems problem NOUN crl-16846 38 18 like like ADP crl-16846 38 19 p p NOUN crl-16846 38 20 - - PUNCT crl-16846 38 21 hacking hacking NOUN crl-16846 38 22 as as ADV crl-16846 38 23 well well ADV crl-16846 38 24 as as ADP crl-16846 38 25 certifying certify VERB crl-16846 38 26 the the DET crl-16846 38 27 distinction distinction NOUN crl-16846 38 28 between between ADP crl-16846 38 29 confirmatory confirmatory NOUN crl-16846 38 30 and and CCONJ crl-16846 38 31 exploratory exploratory ADJ crl-16846 38 32 research research NOUN crl-16846 38 33 . . PUNCT crl-16846 39 1 ( ( PUNCT crl-16846 39 2 standard standard PROPN crl-16846 39 3 6 6 NUM crl-16846 39 4 , , PUNCT crl-16846 39 5 7 7 NUM crl-16846 39 6 ) ) PUNCT crl-16846 39 7 • • NUM crl-16846 39 8 replication replication NOUN crl-16846 39 9 : : PUNCT crl-16846 39 10 this this DET crl-16846 39 11 standard standard NOUN crl-16846 39 12 relates relate VERB crl-16846 39 13 to to ADP crl-16846 39 14 the the DET crl-16846 39 15 journal journal NOUN crl-16846 39 16 ’s ’s PART crl-16846 39 17 willingness willingness NOUN crl-16846 39 18 to to PART crl-16846 39 19 publish publish VERB crl-16846 39 20 direct direct ADJ crl-16846 39 21 replications replication NOUN crl-16846 39 22 of of ADP crl-16846 39 23 studies study NOUN crl-16846 39 24 it it PRON crl-16846 39 25 previously previously ADV crl-16846 39 26 published publish VERB crl-16846 39 27 . . PUNCT crl-16846 40 1 ( ( PUNCT crl-16846 40 2 standard standard PROPN crl-16846 40 3 8) 8) PROPN crl-16846 40 4 the the DET crl-16846 40 5 american american PROPN crl-16846 40 6 statistical statistical PROPN crl-16846 40 7 association association PROPN crl-16846 40 8 ( ( PUNCT crl-16846 40 9 asa asa PROPN crl-16846 40 10 ) ) PUNCT crl-16846 40 11 has have AUX crl-16846 40 12 developed develop VERB crl-16846 40 13 guidelines guideline NOUN crl-16846 40 14 for for ADP crl-16846 40 15 funding funding NOUN crl-16846 40 16 agencies agency NOUN crl-16846 40 17 , , PUNCT crl-16846 40 18 aimed aim VERB crl-16846 40 19 at at ADP crl-16846 40 20 improving improve VERB crl-16846 40 21 reproducibility.32 reproducibility.32 VERB crl-16846 40 22 while while SCONJ crl-16846 40 23 these these DET crl-16846 40 24 guidelines guideline NOUN crl-16846 40 25 address address NOUN crl-16846 40 26 funders funder VERB crl-16846 40 27 , , PUNCT crl-16846 40 28 they they PRON crl-16846 40 29 contain contain VERB crl-16846 40 30 many many ADJ crl-16846 40 31 measures measure NOUN crl-16846 40 32 familiar familiar ADJ crl-16846 40 33 from from ADP crl-16846 40 34 the the DET crl-16846 40 35 top top ADJ crl-16846 40 36 guidelines guideline NOUN crl-16846 40 37 . . PUNCT crl-16846 41 1 the the DET crl-16846 41 2 asa asa PROPN crl-16846 41 3 ’s ’s PART crl-16846 41 4 recommendations recommendation NOUN crl-16846 41 5 include include VERB crl-16846 41 6 , , PUNCT crl-16846 41 7 among among ADP crl-16846 41 8 other other ADJ crl-16846 41 9 things thing NOUN crl-16846 41 10 , , PUNCT crl-16846 41 11 increasing increase VERB crl-16846 41 12 support support NOUN crl-16846 41 13 for for ADP crl-16846 41 14 the the DET crl-16846 41 15 methodological methodological ADJ crl-16846 41 16 training training NOUN crl-16846 41 17 , , PUNCT crl-16846 41 18 with with ADP crl-16846 41 19 particular particular ADJ crl-16846 41 20 emphasis emphasis NOUN crl-16846 41 21 on on ADP crl-16846 41 22 data data NOUN crl-16846 41 23 management management NOUN crl-16846 41 24 skills skill NOUN crl-16846 41 25 and and CCONJ crl-16846 41 26 adding add VERB crl-16846 41 27 code code NOUN crl-16846 41 28 management management NOUN crl-16846 41 29 plans plan NOUN crl-16846 41 30 to to ADP crl-16846 41 31 existing exist VERB crl-16846 41 32 requirements requirement NOUN crl-16846 41 33 of of ADP crl-16846 41 34 data data NOUN crl-16846 41 35 management management NOUN crl-16846 41 36 plans plan NOUN crl-16846 41 37 ( ( PUNCT crl-16846 41 38 dmps dmp NOUN crl-16846 41 39 ) ) PUNCT crl-16846 41 40 . . PUNCT crl-16846 42 1 also also ADV crl-16846 42 2 interesting interesting ADJ crl-16846 42 3 for for ADP crl-16846 42 4 librarians librarian NOUN crl-16846 42 5 are be AUX crl-16846 42 6 the the DET crl-16846 42 7 “ " PUNCT crl-16846 42 8 principles principle NOUN crl-16846 42 9 ” " PUNCT crl-16846 42 10 and and CCONJ crl-16846 42 11 “ " PUNCT crl-16846 42 12 observations observation NOUN crl-16846 42 13 ” " PUNCT crl-16846 42 14 preamble preamble ADJ crl-16846 42 15 to to ADP crl-16846 42 16 the the DET crl-16846 42 17 asa asa PROPN crl-16846 42 18 ’s ’s PART crl-16846 42 19 recommendations recommendation NOUN crl-16846 42 20 . . PUNCT crl-16846 43 1 specifically specifically ADV crl-16846 43 2 , , PUNCT crl-16846 43 3 the the DET crl-16846 43 4 principles principle NOUN crl-16846 43 5 recognize recognize VERB crl-16846 43 6 the the DET crl-16846 43 7 importance importance NOUN crl-16846 43 8 of of ADP crl-16846 43 9 using use VERB crl-16846 43 10 open open ADJ crl-16846 43 11 data datum NOUN crl-16846 43 12 whenever whenever SCONJ crl-16846 43 13 possible possible ADJ crl-16846 43 14 , , PUNCT crl-16846 43 15 publishing publish VERB crl-16846 43 16 data datum NOUN crl-16846 43 17 and and CCONJ crl-16846 43 18 code code NOUN crl-16846 43 19 in in ADP crl-16846 43 20 open open ADJ crl-16846 43 21 repositories repository NOUN crl-16846 43 22 , , PUNCT crl-16846 43 23 making make VERB crl-16846 43 24 data datum NOUN crl-16846 43 25 and and CCONJ crl-16846 43 26 code code NOUN crl-16846 43 27 citable citable ADJ crl-16846 43 28 and and CCONJ crl-16846 43 29 recognized recognize VERB crl-16846 43 30 as as ADP crl-16846 43 31 real real ADJ crl-16846 43 32 research research NOUN crl-16846 43 33 contributions contribution NOUN crl-16846 43 34 , , PUNCT crl-16846 43 35 and and CCONJ crl-16846 43 36 using use VERB crl-16846 43 37 computational computational ADJ crl-16846 43 38 practices practice NOUN crl-16846 43 39 during during ADP crl-16846 43 40 data datum NOUN crl-16846 43 41 analysis analysis NOUN crl-16846 43 42 and and CCONJ crl-16846 43 43 processing.33 processing.33 VERB crl-16846 43 44 major major ADJ crl-16846 43 45 research research NOUN crl-16846 43 46 funders funder NOUN crl-16846 43 47 have have AUX crl-16846 43 48 also also ADV crl-16846 43 49 started start VERB crl-16846 43 50 to to PART crl-16846 43 51 address address VERB crl-16846 43 52 reproducibility reproducibility NOUN crl-16846 43 53 . . PUNCT crl-16846 44 1 in in ADP crl-16846 44 2 2014 2014 NUM crl-16846 44 3 , , PUNCT crl-16846 44 4 the the DET crl-16846 44 5 national national PROPN crl-16846 44 6 institute institute PROPN crl-16846 44 7 of of ADP crl-16846 44 8 health health PROPN crl-16846 44 9 ( ( PUNCT crl-16846 44 10 nih nih PROPN crl-16846 44 11 ) ) PUNCT crl-16846 44 12 hosted host VERB crl-16846 44 13 a a DET crl-16846 44 14 joint joint ADJ crl-16846 44 15 workshop workshop NOUN crl-16846 44 16 with with ADP crl-16846 44 17 the the DET crl-16846 44 18 nature nature NOUN crl-16846 44 19 publishing publishing NOUN crl-16846 44 20 group group NOUN crl-16846 44 21 , , PUNCT crl-16846 44 22 the the DET crl-16846 44 23 journal journal NOUN crl-16846 44 24 science science NOUN crl-16846 44 25 , , PUNCT crl-16846 44 26 and and CCONJ crl-16846 44 27 journal journal NOUN crl-16846 44 28 editors editor NOUN crl-16846 44 29 representing represent VERB crl-16846 44 30 the the DET crl-16846 44 31 30 30 NUM crl-16846 44 32 journals journal NOUN crl-16846 44 33 where where SCONJ crl-16846 44 34 nih nih PROPN crl-16846 44 35 - - PUNCT crl-16846 44 36 funded fund VERB crl-16846 44 37 research research NOUN crl-16846 44 38 is be AUX crl-16846 44 39 most most ADV crl-16846 44 40 frequently frequently ADV crl-16846 44 41 published.34 published.34 VERB crl-16846 44 42 these these DET crl-16846 44 43 guidelines guideline NOUN crl-16846 44 44 call call VERB crl-16846 44 45 for for ADP crl-16846 44 46 improved improved ADJ crl-16846 44 47 rigor rigor NOUN crl-16846 44 48 in in ADP crl-16846 44 49 statistical statistical ADJ crl-16846 44 50 analysis analysis NOUN crl-16846 44 51 , , PUNCT crl-16846 44 52 reporting report VERB crl-16846 44 53 transparency transparency NOUN crl-16846 44 54 , , PUNCT crl-16846 44 55 data datum NOUN crl-16846 44 56 and and CCONJ crl-16846 44 57 material material NOUN crl-16846 44 58 sharing sharing NOUN crl-16846 44 59 , , PUNCT crl-16846 44 60 editorial editorial NOUN crl-16846 44 61     SPACE crl-16846 44 62 5 5 NUM crl-16846 44 63 consideration consideration NOUN crl-16846 44 64 of of ADP crl-16846 44 65 refutations refutation NOUN crl-16846 44 66 , , PUNCT crl-16846 44 67 considering consider VERB crl-16846 44 68 the the DET crl-16846 44 69 establishment establishment NOUN crl-16846 44 70 of of ADP crl-16846 44 71 best good ADJ crl-16846 44 72 practice practice NOUN crl-16846 44 73 guidelines guideline NOUN crl-16846 44 74 for for ADP crl-16846 44 75 certain certain ADJ crl-16846 44 76 images image NOUN crl-16846 44 77 and and CCONJ crl-16846 44 78 descriptions description NOUN crl-16846 44 79 of of ADP crl-16846 44 80 biological biological ADJ crl-16846 44 81 materials material NOUN crl-16846 44 82 . . PUNCT crl-16846 45 1 there there PRON crl-16846 45 2 are be VERB crl-16846 45 3 a a DET crl-16846 45 4 number number NOUN crl-16846 45 5 of of ADP crl-16846 45 6 other other ADJ crl-16846 45 7 guidelines guideline NOUN crl-16846 45 8 by by ADP crl-16846 45 9 funders funder NOUN crl-16846 45 10 , , PUNCT crl-16846 45 11 professional professional ADJ crl-16846 45 12 scientific scientific ADJ crl-16846 45 13 societies society NOUN crl-16846 45 14 , , PUNCT crl-16846 45 15 individual individual ADJ crl-16846 45 16 scientists scientist NOUN crl-16846 45 17 , , PUNCT crl-16846 45 18 institutions institution NOUN crl-16846 45 19 , , PUNCT crl-16846 45 20 and and CCONJ crl-16846 45 21 conferences conference NOUN crl-16846 45 22 , , PUNCT crl-16846 45 23 and and CCONJ crl-16846 45 24 we we PRON crl-16846 45 25 recommend recommend VERB crl-16846 45 26 that that SCONJ crl-16846 45 27 librarians librarian NOUN crl-16846 45 28 find find VERB crl-16846 45 29 guidelines guideline NOUN crl-16846 45 30 associated associate VERB crl-16846 45 31 with with ADP crl-16846 45 32 the the DET crl-16846 45 33 disciplines discipline NOUN crl-16846 45 34 they they PRON crl-16846 45 35 support support VERB crl-16846 45 36 . . PUNCT crl-16846 46 1 for for ADP crl-16846 46 2 example example NOUN crl-16846 46 3 , , PUNCT crl-16846 46 4 the the DET crl-16846 46 5 federation federation PROPN crl-16846 46 6 of of ADP crl-16846 46 7 american american PROPN crl-16846 46 8 societies society NOUN crl-16846 46 9 for for ADP crl-16846 46 10 experimental experimental ADJ crl-16846 46 11 biology biology NOUN crl-16846 46 12 has have VERB crl-16846 46 13 a a DET crl-16846 46 14 broad broad ADJ crl-16846 46 15 set set NOUN crl-16846 46 16 of of ADP crl-16846 46 17 recommendations recommendation NOUN crl-16846 46 18 regarding regard VERB crl-16846 46 19 research research NOUN crl-16846 46 20 using use VERB crl-16846 46 21 animal animal NOUN crl-16846 46 22 models model NOUN crl-16846 46 23 or or CCONJ crl-16846 46 24 antibodies antibody NOUN crl-16846 46 25 , , PUNCT crl-16846 46 26 intended intend VERB crl-16846 46 27 for for ADP crl-16846 46 28 research research NOUN crl-16846 46 29 organizations organization NOUN crl-16846 46 30 , , PUNCT crl-16846 46 31 individual individual ADJ crl-16846 46 32 investigators investigator NOUN crl-16846 46 33 , , PUNCT crl-16846 46 34 and and CCONJ crl-16846 46 35 publishers.35 publishers.35 VERB crl-16846 46 36 the the DET crl-16846 46 37 society society NOUN crl-16846 46 38 for for ADP crl-16846 46 39 neuroscience neuroscience NOUN crl-16846 46 40 ’s ’s PART crl-16846 46 41 “ " PUNCT crl-16846 46 42 research research NOUN crl-16846 46 43 practices practice NOUN crl-16846 46 44 for for ADP crl-16846 46 45 scientific scientific ADJ crl-16846 46 46 rigor rigor NOUN crl-16846 46 47 : : PUNCT crl-16846 46 48 a a DET crl-16846 46 49 resource resource NOUN crl-16846 46 50 for for ADP crl-16846 46 51 discussion discussion NOUN crl-16846 46 52 , , PUNCT crl-16846 46 53 training training NOUN crl-16846 46 54 , , PUNCT crl-16846 46 55 and and CCONJ crl-16846 46 56 practice practice NOUN crl-16846 46 57 ” " PUNCT crl-16846 46 58 has have VERB crl-16846 46 59 discussion discussion NOUN crl-16846 46 60 points point NOUN crl-16846 46 61 and and CCONJ crl-16846 46 62 recommendations recommendation NOUN crl-16846 46 63 covering cover VERB crl-16846 46 64 methodological methodological ADJ crl-16846 46 65 issues issue NOUN crl-16846 46 66 , , PUNCT crl-16846 46 67 data datum NOUN crl-16846 46 68 analysis analysis NOUN crl-16846 46 69 , , PUNCT crl-16846 46 70 and and CCONJ crl-16846 46 71 transparency.36 transparency.36 NOUN crl-16846 46 72 these these DET crl-16846 46 73 guidelines guideline NOUN crl-16846 46 74 are be AUX crl-16846 46 75 invaluable invaluable ADJ crl-16846 46 76 for for ADP crl-16846 46 77 liaisons liaison NOUN crl-16846 46 78 and and CCONJ crl-16846 46 79 functional functional ADJ crl-16846 46 80 specialists specialist NOUN crl-16846 46 81 working work VERB crl-16846 46 82 within within ADP crl-16846 46 83 these these DET crl-16846 46 84 areas area NOUN crl-16846 46 85 . . PUNCT crl-16846 47 1 a a DET crl-16846 47 2 future future ADJ crl-16846 47 3 publication publication NOUN crl-16846 47 4 by by ADP crl-16846 47 5 the the DET crl-16846 47 6 authors author NOUN crl-16846 47 7 will will AUX crl-16846 47 8 address address VERB crl-16846 47 9 a a DET crl-16846 47 10 comprehensive comprehensive ADJ crl-16846 47 11 review review NOUN crl-16846 47 12 of of ADP crl-16846 47 13 reproducibility reproducibility NOUN crl-16846 47 14 guidelines guideline NOUN crl-16846 47 15 . . PUNCT crl-16846 48 1 recommendations recommendation NOUN crl-16846 48 2 to to PART crl-16846 48 3 improve improve VERB crl-16846 48 4 the the DET crl-16846 48 5 reproducibility reproducibility NOUN crl-16846 48 6 of of ADP crl-16846 48 7 research research NOUN crl-16846 48 8 can can AUX crl-16846 48 9 be be AUX crl-16846 48 10 conceptualized conceptualize VERB crl-16846 48 11 as as ADP crl-16846 48 12 falling fall VERB crl-16846 48 13 into into ADP crl-16846 48 14 two two NUM crl-16846 48 15 realms realm NOUN crl-16846 48 16 : : PUNCT crl-16846 48 17 those those PRON crl-16846 48 18 that that PRON crl-16846 48 19 belong belong VERB crl-16846 48 20 to to ADP crl-16846 48 21 the the DET crl-16846 48 22 practice practice NOUN crl-16846 48 23 of of ADP crl-16846 48 24 science science NOUN crl-16846 48 25 itself itself PRON crl-16846 48 26 and and CCONJ crl-16846 48 27 those those PRON crl-16846 48 28 that that PRON crl-16846 48 29 belong belong VERB crl-16846 48 30 to to ADP crl-16846 48 31 the the DET crl-16846 48 32 packaging packaging NOUN crl-16846 48 33 and and CCONJ crl-16846 48 34 reporting reporting NOUN crl-16846 48 35 of of ADP crl-16846 48 36 science science NOUN crl-16846 48 37 . . PUNCT crl-16846 49 1 for for ADP crl-16846 49 2 example example NOUN crl-16846 49 3 , , PUNCT crl-16846 49 4 recommendations recommendation NOUN crl-16846 49 5 relating relate VERB crl-16846 49 6 to to PART crl-16846 49 7 study study VERB crl-16846 49 8 design design NOUN crl-16846 49 9 and and CCONJ crl-16846 49 10 statistics statistic NOUN crl-16846 49 11 clearly clearly ADV crl-16846 49 12 belong belong VERB crl-16846 49 13 to to ADP crl-16846 49 14 the the DET crl-16846 49 15 practice practice NOUN crl-16846 49 16 of of ADP crl-16846 49 17 science science NOUN crl-16846 49 18 ; ; PUNCT crl-16846 49 19 recommendations recommendation NOUN crl-16846 49 20 related relate VERB crl-16846 49 21 to to ADP crl-16846 49 22 these these DET crl-16846 49 23 areas area NOUN crl-16846 49 24 will will AUX crl-16846 49 25 differ differ VERB crl-16846 49 26 depending depend VERB crl-16846 49 27 on on ADP crl-16846 49 28 the the DET crl-16846 49 29 discipline discipline NOUN crl-16846 49 30 , , PUNCT crl-16846 49 31 and and CCONJ crl-16846 49 32 librarians librarian NOUN crl-16846 49 33 will will AUX crl-16846 49 34 likely likely ADV crl-16846 49 35 have have VERB crl-16846 49 36 a a DET crl-16846 49 37 limited limited ADJ crl-16846 49 38 role role NOUN crl-16846 49 39 to to PART crl-16846 49 40 play play VERB crl-16846 49 41 . . PUNCT crl-16846 50 1 on on ADP crl-16846 50 2 the the DET crl-16846 50 3 other other ADJ crl-16846 50 4 hand hand NOUN crl-16846 50 5 , , PUNCT crl-16846 50 6 recommendations recommendation NOUN crl-16846 50 7 related relate VERB crl-16846 50 8 to to ADP crl-16846 50 9 the the DET crl-16846 50 10 packaging packaging NOUN crl-16846 50 11 of of ADP crl-16846 50 12 science science NOUN crl-16846 50 13 such such ADJ crl-16846 50 14 as as ADP crl-16846 50 15 preregistration preregistration NOUN crl-16846 50 16 of of ADP crl-16846 50 17 studies study NOUN crl-16846 50 18 and and CCONJ crl-16846 50 19 analysis analysis NOUN crl-16846 50 20 plans plan NOUN crl-16846 50 21 or or CCONJ crl-16846 50 22 improvements improvement NOUN crl-16846 50 23 to to ADP crl-16846 50 24 transparency transparency NOUN crl-16846 50 25 such such ADJ crl-16846 50 26 as as ADP crl-16846 50 27 data data NOUN crl-16846 50 28 sharing sharing NOUN crl-16846 50 29 have have VERB crl-16846 50 30 clear clear ADJ crl-16846 50 31 implications implication NOUN crl-16846 50 32 for for ADP crl-16846 50 33 the the DET crl-16846 50 34 services service NOUN crl-16846 50 35 and and CCONJ crl-16846 50 36 expertise expertise NOUN crl-16846 50 37 that that PRON crl-16846 50 38 academic academic ADJ crl-16846 50 39 librarians librarians PROPN crl-16846 50 40 provide provide VERB crl-16846 50 41 . . PUNCT crl-16846 51 1 indeed indeed ADV crl-16846 51 2 , , PUNCT crl-16846 51 3 in in ADP crl-16846 51 4 most most ADJ crl-16846 51 5 cases case NOUN crl-16846 51 6 , , PUNCT crl-16846 51 7 services service NOUN crl-16846 51 8 and and CCONJ crl-16846 51 9 expertise expertise NOUN crl-16846 51 10 related relate VERB crl-16846 51 11 to to ADP crl-16846 51 12 these these DET crl-16846 51 13 issues issue NOUN crl-16846 51 14 are be AUX crl-16846 51 15 already already ADV crl-16846 51 16 being be AUX crl-16846 51 17 offered offer VERB crl-16846 51 18 by by ADP crl-16846 51 19 academic academic ADJ crl-16846 51 20 libraries library NOUN crl-16846 51 21 ; ; PUNCT crl-16846 51 22 extending extend VERB crl-16846 51 23 them they PRON crl-16846 51 24 to to PART crl-16846 51 25 support support VERB crl-16846 51 26 reproducibility reproducibility NOUN crl-16846 51 27 will will AUX crl-16846 51 28 require require VERB crl-16846 51 29 only only ADV crl-16846 51 30 that that SCONJ crl-16846 51 31 we we PRON crl-16846 51 32 effectively effectively ADV crl-16846 51 33 frame frame VERB crl-16846 51 34 them they PRON crl-16846 51 35 as as ADP crl-16846 51 36 supporting support VERB crl-16846 51 37 reproducible reproducible ADJ crl-16846 51 38 research research NOUN crl-16846 51 39 . . PUNCT crl-16846 52 1 in in ADP crl-16846 52 2 a a DET crl-16846 52 3 future future ADJ crl-16846 52 4 publication publication NOUN crl-16846 52 5 , , PUNCT crl-16846 52 6 the the DET crl-16846 52 7 authors author NOUN crl-16846 52 8 will will AUX crl-16846 52 9 set set VERB crl-16846 52 10 out out ADP crl-16846 52 11 an an DET crl-16846 52 12 explicit explicit ADJ crl-16846 52 13 model model NOUN crl-16846 52 14 of of ADP crl-16846 52 15 services service NOUN crl-16846 52 16 and and CCONJ crl-16846 52 17 expertise expertise NOUN crl-16846 52 18 related relate VERB crl-16846 52 19 to to ADP crl-16846 52 20 reproducibility reproducibility NOUN crl-16846 52 21 . . PUNCT crl-16846 53 1 discussion discussion NOUN crl-16846 53 2 the the DET crl-16846 53 3 systems system NOUN crl-16846 53 4 needed need VERB crl-16846 53 5 to to PART crl-16846 53 6 promote promote VERB crl-16846 53 7 reproducible reproducible ADJ crl-16846 53 8 research research NOUN crl-16846 53 9 must must AUX crl-16846 53 10 come come VERB crl-16846 53 11 from from ADP crl-16846 53 12 institutions institution NOUN crl-16846 53 13 — — PUNCT crl-16846 53 14 scientists scientist NOUN crl-16846 53 15 , , PUNCT crl-16846 53 16 funders funder NOUN crl-16846 53 17 and and CCONJ crl-16846 53 18 journals journal NOUN crl-16846 53 19 can can AUX crl-16846 53 20 not not PART crl-16846 53 21 build build VERB crl-16846 53 22 them they PRON crl-16846 53 23 on on ADP crl-16846 53 24 their their PRON crl-16846 53 25 own own ADJ crl-16846 53 26 . . PUNCT crl-16846 54 1 these these DET crl-16846 54 2 kinds kind NOUN crl-16846 54 3 of of ADP crl-16846 54 4 changes change NOUN crl-16846 54 5 will will AUX crl-16846 54 6 require require VERB crl-16846 54 7 additional additional ADJ crl-16846 54 8 money money NOUN crl-16846 54 9 , , PUNCT crl-16846 54 10 infrastructure infrastructure NOUN crl-16846 54 11 , , PUNCT crl-16846 54 12 personnel personnel NOUN crl-16846 54 13 and and CCONJ crl-16846 54 14 paperwork paperwork NOUN crl-16846 54 15 . . PUNCT crl-16846 55 1 the the DET crl-16846 55 2 load load NOUN crl-16846 55 3 on on ADP crl-16846 55 4 institutions institution NOUN crl-16846 55 5 and and CCONJ crl-16846 55 6 investigators investigator NOUN crl-16846 55 7 will will AUX crl-16846 55 8 be be AUX crl-16846 55 9 real real ADJ crl-16846 55 10 , , PUNCT crl-16846 55 11 but but CCONJ crl-16846 55 12 so so ADV crl-16846 55 13 is be AUX crl-16846 55 14 the the DET crl-16846 55 15 burden burden NOUN crl-16846 55 16 of of ADP crl-16846 55 17 irreproducible irreproducible ADJ crl-16846 55 18 research.37 research.37 NOUN crl-16846 55 19 — — PUNCT crl-16846 55 20 c. c. PROPN crl-16846 55 21 glenn glenn PROPN crl-16846 55 22 begley begley PROPN crl-16846 55 23 , , PUNCT crl-16846 55 24 alastair alastair NOUN crl-16846 55 25 m m PROPN crl-16846 55 26 buchan buchan NOUN crl-16846 55 27 , , PUNCT crl-16846 55 28 and and CCONJ crl-16846 55 29 ulrich ulrich PROPN crl-16846 55 30 dirnagl dirnagl NOUN crl-16846 55 31 research research NOUN crl-16846 55 32 institutions institution NOUN crl-16846 55 33 have have VERB crl-16846 55 34 a a DET crl-16846 55 35 responsibility responsibility NOUN crl-16846 55 36 to to PART crl-16846 55 37 work work VERB crl-16846 55 38 with with ADP crl-16846 55 39 researchers researcher NOUN crl-16846 55 40 , , PUNCT crl-16846 55 41 funders funder NOUN crl-16846 55 42 , , PUNCT crl-16846 55 43 journals journal NOUN crl-16846 55 44 , , PUNCT crl-16846 55 45 and and CCONJ crl-16846 55 46 professional professional ADJ crl-16846 55 47 societies society NOUN crl-16846 55 48 to to PART crl-16846 55 49 address address VERB crl-16846 55 50 issues issue NOUN crl-16846 55 51 with with ADP crl-16846 55 52 reproducibility reproducibility NOUN crl-16846 55 53 . . PUNCT crl-16846 56 1 the the DET crl-16846 56 2 academic academic ADJ crl-16846 56 3 library library NOUN crl-16846 56 4 is be AUX crl-16846 56 5 one one NUM crl-16846 56 6 of of ADP crl-16846 56 7 the the DET crl-16846 56 8 few few ADJ crl-16846 56 9 organizations organization NOUN crl-16846 56 10 within within ADP crl-16846 56 11 an an DET crl-16846 56 12 academic academic ADJ crl-16846 56 13 institution institution NOUN crl-16846 56 14 that that PRON crl-16846 56 15 has have VERB crl-16846 56 16 the the DET crl-16846 56 17 expertise expertise NOUN crl-16846 56 18 and and CCONJ crl-16846 56 19 infrastructure infrastructure NOUN crl-16846 56 20 to to PART crl-16846 56 21 broadly broadly ADV crl-16846 56 22 support support VERB crl-16846 56 23 reproducible reproducible ADJ crl-16846 56 24 research research NOUN crl-16846 56 25 . . PUNCT crl-16846 57 1 academic academic ADJ crl-16846 57 2 librarians librarians PROPN crl-16846 57 3 have have VERB crl-16846 57 4 extensive extensive ADJ crl-16846 57 5 experience experience NOUN crl-16846 57 6 with with ADP crl-16846 57 7 finding finding NOUN crl-16846 57 8 and and CCONJ crl-16846 57 9 evaluating evaluate VERB crl-16846 57 10 scientific scientific ADJ crl-16846 57 11 literature literature NOUN crl-16846 57 12 , , PUNCT crl-16846 57 13 scholarly scholarly ADJ crl-16846 57 14 communication communication NOUN crl-16846 57 15 , , PUNCT crl-16846 57 16 research research NOUN crl-16846 57 17 metrics metric NOUN crl-16846 57 18 , , PUNCT crl-16846 57 19 and and CCONJ crl-16846 57 20 data data NOUN crl-16846 57 21 management management NOUN crl-16846 57 22 and and CCONJ crl-16846 57 23 sharing sharing NOUN crl-16846 57 24 . . PUNCT crl-16846 58 1 we we PRON crl-16846 58 2 support support VERB crl-16846 58 3 computational computational ADJ crl-16846 58 4 and and CCONJ crl-16846 58 5 data data NOUN crl-16846 58 6 - - PUNCT crl-16846 58 7 intensive intensive ADJ crl-16846 58 8 research research NOUN crl-16846 58 9 such such ADJ crl-16846 58 10 as as ADP crl-16846 58 11 gis gis ADJ crl-16846 58 12 , , PUNCT crl-16846 58 13 bibliometrics bibliometric NOUN crl-16846 58 14 , , PUNCT crl-16846 58 15 data datum NOUN crl-16846 58 16 mining mining NOUN crl-16846 58 17 , , PUNCT crl-16846 58 18 and and CCONJ crl-16846 58 19 digital digital ADJ crl-16846 58 20 humanities humanity NOUN crl-16846 58 21 . . PUNCT crl-16846 59 1 most most ADJ crl-16846 59 2 academic academic ADJ crl-16846 59 3 libraries library NOUN crl-16846 59 4 have have VERB crl-16846 59 5 subject subject ADJ crl-16846 59 6 specialists specialist NOUN crl-16846 59 7 assigned assign VERB crl-16846 59 8 to to ADP crl-16846 59 9 every every DET crl-16846 59 10 discipline discipline NOUN crl-16846 59 11 , , PUNCT crl-16846 59 12 whose whose DET crl-16846 59 13 job job NOUN crl-16846 59 14 it it PRON crl-16846 59 15 is be AUX crl-16846 59 16 to to PART crl-16846 59 17 build build VERB crl-16846 59 18 and and CCONJ crl-16846 59 19 maintain maintain VERB crl-16846 59 20 relationships relationship NOUN crl-16846 59 21 and and CCONJ crl-16846 59 22 support support NOUN crl-16846 59 23 students student NOUN crl-16846 59 24 , , PUNCT crl-16846 59 25 faculty faculty NOUN crl-16846 59 26 , , PUNCT crl-16846 59 27 and and CCONJ crl-16846 59 28 researchers researcher NOUN crl-16846 59 29 and and CCONJ crl-16846 59 30 understand understand VERB crl-16846 59 31 issues issue NOUN crl-16846 59 32 within within ADP crl-16846 59 33 the the DET crl-16846 59 34 discipline discipline NOUN crl-16846 59 35 . . PUNCT crl-16846 60 1 academic academic ADJ crl-16846 60 2 libraries library NOUN crl-16846 60 3 are be AUX crl-16846 60 4 thus thus ADV crl-16846 60 5 well well ADV crl-16846 60 6 placed place VERB crl-16846 60 7 to to PART crl-16846 60 8 lead lead VERB crl-16846 60 9 support support NOUN crl-16846 60 10 for for ADP crl-16846 60 11 many many ADJ crl-16846 60 12 aspects aspect NOUN crl-16846 60 13 of of ADP crl-16846 60 14 reproducible reproducible ADJ crl-16846 60 15 research research NOUN crl-16846 60 16 . . PUNCT crl-16846 61 1 the the DET crl-16846 61 2 role role NOUN crl-16846 61 3 that that PRON crl-16846 61 4 academic academic ADJ crl-16846 61 5 librarians librarian NOUN crl-16846 61 6 can can AUX crl-16846 61 7 play play VERB crl-16846 61 8 in in ADP crl-16846 61 9 supporting support VERB crl-16846 61 10 reproducibility reproducibility NOUN crl-16846 61 11 is be AUX crl-16846 61 12 beginning begin VERB crl-16846 61 13 to to PART crl-16846 61 14 be be AUX crl-16846 61 15 recognized recognize VERB crl-16846 61 16 . . PUNCT crl-16846 62 1 stodden stodden VERB crl-16846 62 2 et et PROPN crl-16846 63 1 al al PROPN crl-16846 63 2 . . PROPN crl-16846 63 3 highlighted highlight VERB crl-16846 63 4 the the DET crl-16846 63 5 role role NOUN crl-16846 63 6 libraries library NOUN crl-16846 63 7 could could AUX crl-16846 63 8 play play VERB crl-16846 63 9 in in ADP crl-16846 63 10 “ " PUNCT crl-16846 63 11 supporting support VERB crl-16846 63 12 a a DET crl-16846 63 13 culture culture NOUN crl-16846 63 14 change change NOUN crl-16846 63 15 toward toward ADP crl-16846 63 16 reproducible reproducible ADJ crl-16846 63 17 research research NOUN crl-16846 63 18 , , PUNCT crl-16846 63 19 ” " PUNCT crl-16846 63 20 including include VERB crl-16846 63 21 assistance assistance NOUN crl-16846 63 22 with with ADP crl-16846 63 23 data data NOUN crl-16846 63 24 management management NOUN crl-16846 63 25 plans plan NOUN crl-16846 63 26 and and CCONJ crl-16846 63 27 archiving.38 archiving.38 NOUN crl-16846 63 28 in in ADP crl-16846 63 29 the the DET crl-16846 63 30 same same ADJ crl-16846 63 31 article article NOUN crl-16846 63 32 , , PUNCT crl-16846 63 33 stodden stodden VERB crl-16846 63 34 et et PROPN crl-16846 63 35 al al PROPN crl-16846 63 36 . . PROPN crl-16846 63 37 wrote write VERB crl-16846 63 38 that that SCONJ crl-16846 63 39 “ " PUNCT crl-16846 63 40 co6 co6 PROPN crl-16846 63 41     SPACE crl-16846 63 42 college college PROPN crl-16846 63 43 & & CCONJ crl-16846 63 44 research research PROPN crl-16846 63 45 libraries librarie VERB crl-16846 63 46 january january PROPN crl-16846 63 47 2018 2018 NUM crl-16846 63 48 ordination ordination NOUN crl-16846 63 49 between between ADP crl-16846 63 50 departments department NOUN crl-16846 63 51 and and CCONJ crl-16846 63 52 the the DET crl-16846 63 53 institute institute PROPN crl-16846 63 54 ’s ’s PART crl-16846 63 55 library library NOUN crl-16846 63 56 system system NOUN crl-16846 63 57 could could AUX crl-16846 63 58 help help VERB crl-16846 63 59 provide provide VERB crl-16846 63 60 the the DET crl-16846 63 61 support support NOUN crl-16846 63 62 and and CCONJ crl-16846 63 63 resources resource NOUN crl-16846 63 64 necessary necessary ADJ crl-16846 63 65 to to PART crl-16846 63 66 manage manage VERB crl-16846 63 67 and and CCONJ crl-16846 63 68 maintain maintain VERB crl-16846 63 69 digital digital ADJ crl-16846 63 70 scholarly scholarly ADJ crl-16846 63 71 output output NOUN crl-16846 63 72 , , PUNCT crl-16846 63 73 including include VERB crl-16846 63 74 datasets dataset NOUN crl-16846 63 75 and and CCONJ crl-16846 63 76 code code NOUN crl-16846 63 77 . . PUNCT crl-16846 64 1 ”39 ”39 PUNCT crl-16846 65 1 in in ADP crl-16846 65 2 a a DET crl-16846 65 3 report report NOUN crl-16846 65 4 to to ADP crl-16846 65 5 the the DET crl-16846 65 6 director director NOUN crl-16846 65 7 of of ADP crl-16846 65 8 nih nih PROPN crl-16846 65 9 about about ADP crl-16846 65 10 the the DET crl-16846 65 11 future future NOUN crl-16846 65 12 of of ADP crl-16846 65 13 the the DET crl-16846 65 14 national national ADJ crl-16846 65 15 library library NOUN crl-16846 65 16 of of ADP crl-16846 65 17 medicine medicine NOUN crl-16846 65 18 ( ( PUNCT crl-16846 65 19 nlm nlm PROPN crl-16846 65 20 ) ) PUNCT crl-16846 65 21 , , PUNCT crl-16846 65 22 the the DET crl-16846 65 23 advisory advisory ADJ crl-16846 65 24 committee committee NOUN crl-16846 65 25 recommended recommend VERB crl-16846 65 26 that that SCONJ crl-16846 65 27 nlm nlm PROPN crl-16846 65 28 “ " PUNCT crl-16846 65 29 lead lead VERB crl-16846 65 30 efforts effort NOUN crl-16846 65 31 to to PART crl-16846 65 32 support support VERB crl-16846 65 33 and and CCONJ crl-16846 65 34 catalyze catalyze VERB crl-16846 65 35 open open ADJ crl-16846 65 36 science science NOUN crl-16846 65 37 , , PUNCT crl-16846 65 38 data datum NOUN crl-16846 65 39 sharing sharing NOUN crl-16846 65 40 , , PUNCT crl-16846 65 41 and and CCONJ crl-16846 65 42 research research NOUN crl-16846 65 43 reproducibility reproducibility NOUN crl-16846 65 44 , , PUNCT crl-16846 65 45 striving strive VERB crl-16846 65 46 to to PART crl-16846 65 47 promote promote VERB crl-16846 65 48 the the DET crl-16846 65 49 concept concept NOUN crl-16846 65 50 that that SCONJ crl-16846 65 51 biomedical biomedical ADJ crl-16846 65 52 information information NOUN crl-16846 65 53 and and CCONJ crl-16846 65 54 its its PRON crl-16846 65 55 transparent transparent ADJ crl-16846 65 56 analysis analysis NOUN crl-16846 65 57 are be AUX crl-16846 65 58 public public ADJ crl-16846 65 59 goods good NOUN crl-16846 65 60 . . PUNCT crl-16846 66 1 ”40 ”40 PROPN crl-16846 66 2 the the DET crl-16846 66 3 journal journal PROPN crl-16846 66 4 of of ADP crl-16846 66 5 visualized visualized ADJ crl-16846 66 6 experiments experiment NOUN crl-16846 66 7 ( ( PUNCT crl-16846 66 8 jove jove NOUN crl-16846 66 9 ) ) PUNCT crl-16846 66 10 has have AUX crl-16846 66 11 recently recently ADV crl-16846 66 12 started start VERB crl-16846 66 13 giving give VERB crl-16846 66 14 librarians librarians PROPN crl-16846 66 15 travel travel NOUN crl-16846 66 16 awards award NOUN crl-16846 66 17 and and CCONJ crl-16846 66 18 highlighting highlight VERB crl-16846 66 19 the the DET crl-16846 66 20 work work NOUN crl-16846 66 21 they they PRON crl-16846 66 22 are be AUX crl-16846 66 23 doing do VERB crl-16846 66 24 to to PART crl-16846 66 25 support support VERB crl-16846 66 26 reproducibility.41 reproducibility.41 NOUN crl-16846 66 27 some some DET crl-16846 66 28 academic academic ADJ crl-16846 66 29 libraries library NOUN crl-16846 66 30 have have AUX crl-16846 66 31 begun begin VERB crl-16846 66 32 hiring hire VERB crl-16846 66 33 librarians librarian NOUN crl-16846 66 34 specifically specifically ADV crl-16846 66 35 to to PART crl-16846 66 36 support support VERB crl-16846 66 37 reproducibility reproducibility NOUN crl-16846 66 38 . . PUNCT crl-16846 67 1 new new PROPN crl-16846 67 2 york york PROPN crl-16846 67 3 university university PROPN crl-16846 67 4 ’s ’s PART crl-16846 67 5 division division NOUN crl-16846 67 6 of of ADP crl-16846 67 7 librarians librarian NOUN crl-16846 67 8 and and CCONJ crl-16846 67 9 the the DET crl-16846 67 10 center center NOUN crl-16846 67 11 for for ADP crl-16846 67 12 data datum NOUN crl-16846 67 13 sciences science NOUN crl-16846 67 14 hired hire VERB crl-16846 67 15 a a DET crl-16846 67 16 dual dual ADJ crl-16846 67 17 appointment appointment NOUN crl-16846 67 18 librarian librarian NOUN crl-16846 67 19 for for ADP crl-16846 67 20 research research NOUN crl-16846 67 21 data datum NOUN crl-16846 67 22 management management NOUN crl-16846 67 23 and and CCONJ crl-16846 67 24 reproducibility.42 reproducibility.42 VERB crl-16846 67 25 the the DET crl-16846 67 26 university university PROPN crl-16846 67 27 of of ADP crl-16846 67 28 utah utah PROPN crl-16846 67 29 ’s ’s PART crl-16846 67 30 spencer spencer PROPN crl-16846 67 31 s. s. PROPN crl-16846 67 32 eccles eccles PROPN crl-16846 67 33 health health PROPN crl-16846 67 34 sciences sciences PROPN crl-16846 67 35 library library PROPN crl-16846 67 36 ( ( PUNCT crl-16846 67 37 ehsl ehsl PROPN crl-16846 67 38 ) ) PUNCT crl-16846 67 39 has have AUX crl-16846 67 40 posted post VERB crl-16846 67 41 a a DET crl-16846 67 42 job job NOUN crl-16846 67 43 opening opening NOUN crl-16846 67 44 for for ADP crl-16846 67 45 a a DET crl-16846 67 46 faculty faculty NOUN crl-16846 67 47 librarian librarian NOUN crl-16846 67 48 with with ADP crl-16846 67 49 reproducibility reproducibility NOUN crl-16846 67 50 job job NOUN crl-16846 67 51 components component NOUN crl-16846 67 52 including include VERB crl-16846 67 53 outreach outreach NOUN crl-16846 67 54 and and CCONJ crl-16846 67 55 education education NOUN crl-16846 67 56 . . PUNCT crl-16846 68 1 eligible eligible ADJ crl-16846 68 2 candidates candidate NOUN crl-16846 68 3 are be AUX crl-16846 68 4 required require VERB crl-16846 68 5 to to PART crl-16846 68 6 demonstrate demonstrate VERB crl-16846 68 7 knowledge knowledge NOUN crl-16846 68 8 of of ADP crl-16846 68 9 “ " PUNCT crl-16846 68 10 research research NOUN crl-16846 68 11 integrity integrity NOUN crl-16846 68 12 , , PUNCT crl-16846 68 13 research research NOUN crl-16846 68 14 reproducibility reproducibility NOUN crl-16846 68 15 , , PUNCT crl-16846 68 16 and and CCONJ crl-16846 68 17 open open ADJ crl-16846 68 18 science science NOUN crl-16846 68 19 ” " PUNCT crl-16846 68 20 while while SCONJ crl-16846 68 21 also also ADV crl-16846 68 22 developing develop VERB crl-16846 68 23 and and CCONJ crl-16846 68 24 teaching teach VERB crl-16846 68 25 workshops workshop NOUN crl-16846 68 26 on on ADP crl-16846 68 27 various various ADJ crl-16846 68 28 tools tool NOUN crl-16846 68 29 like like ADP crl-16846 68 30 open open ADJ crl-16846 68 31 science science NOUN crl-16846 68 32 framework framework NOUN crl-16846 68 33 , , PUNCT crl-16846 68 34 and and CCONJ crl-16846 68 35 specialized specialized ADJ crl-16846 68 36 software software NOUN crl-16846 68 37 like like ADP crl-16846 68 38 r.43 r.43 ADP crl-16846 68 39 other other ADJ crl-16846 68 40 institutions institution NOUN crl-16846 68 41 have have AUX crl-16846 68 42 started start VERB crl-16846 68 43 adding add VERB crl-16846 68 44 reproducibility reproducibility NOUN crl-16846 68 45 to to ADP crl-16846 68 46 job job NOUN crl-16846 68 47 descriptions description NOUN crl-16846 68 48 along along ADP crl-16846 68 49 with with ADP crl-16846 68 50 research research NOUN crl-16846 68 51 services service NOUN crl-16846 68 52 and and CCONJ crl-16846 68 53 data datum NOUN crl-16846 68 54 management management NOUN crl-16846 68 55 . . PUNCT crl-16846 69 1 libraries library NOUN crl-16846 69 2 have have AUX crl-16846 69 3 also also ADV crl-16846 69 4 begun begin VERB crl-16846 69 5 hosting host VERB crl-16846 69 6 events event NOUN crl-16846 69 7 and and CCONJ crl-16846 69 8 partnering partner VERB crl-16846 69 9 with with ADP crl-16846 69 10 others other NOUN crl-16846 69 11 to to PART crl-16846 69 12 address address VERB crl-16846 69 13 reproducibility reproducibility NOUN crl-16846 69 14 . . PUNCT crl-16846 70 1 nyu nyu PROPN crl-16846 70 2 , , PUNCT crl-16846 70 3 ehsl ehsl PROPN crl-16846 70 4 , , PUNCT crl-16846 70 5 and and CCONJ crl-16846 70 6 the the DET crl-16846 70 7 medical medical ADJ crl-16846 70 8 library library PROPN crl-16846 70 9 association association PROPN crl-16846 70 10 have have AUX crl-16846 70 11 hosted host VERB crl-16846 70 12 reproducibility reproducibility NOUN crl-16846 70 13 symposiums.44 symposiums.44 NOUN crl-16846 70 14 the the DET crl-16846 70 15 nyu nyu PROPN crl-16846 70 16 reproducibility reproducibility NOUN crl-16846 70 17 symposium symposium NOUN crl-16846 70 18 included include VERB crl-16846 70 19 faculty faculty NOUN crl-16846 70 20 , , PUNCT crl-16846 70 21 doctoral doctoral ADJ crl-16846 70 22 candidates candidate NOUN crl-16846 70 23 , , PUNCT crl-16846 70 24 and and CCONJ crl-16846 70 25 others other NOUN crl-16846 70 26 with with ADP crl-16846 70 27 the the DET crl-16846 70 28 largest large ADJ crl-16846 70 29 disciplinary disciplinary ADJ crl-16846 70 30 representation representation NOUN crl-16846 70 31 from from ADP crl-16846 70 32 psychology psychology NOUN crl-16846 70 33 and and CCONJ crl-16846 70 34 data datum NOUN crl-16846 70 35 sciences.45 sciences.45 VERB crl-16846 70 36 the the DET crl-16846 70 37 university university PROPN crl-16846 70 38 of of ADP crl-16846 70 39 utah utah PROPN crl-16846 70 40 ehsl ehsl PROPN crl-16846 70 41 hosted host VERB crl-16846 70 42 a a DET crl-16846 70 43 two two NUM crl-16846 70 44 - - PUNCT crl-16846 70 45 day day NOUN crl-16846 70 46 conference conference NOUN crl-16846 70 47 in in ADP crl-16846 70 48 2016 2016 NUM crl-16846 70 49 that that PRON crl-16846 70 50 was be AUX crl-16846 70 51 nationally nationally ADV crl-16846 70 52 and and CCONJ crl-16846 70 53 internationally internationally ADV crl-16846 70 54 attended attend VERB crl-16846 70 55 and and CCONJ crl-16846 70 56 positioned position VERB crl-16846 70 57 the the DET crl-16846 70 58 libraries library NOUN crl-16846 70 59 to to PART crl-16846 70 60 lead lead VERB crl-16846 70 61 change change NOUN crl-16846 70 62 at at ADP crl-16846 70 63 that that DET crl-16846 70 64 institution.46 institution.46 NOUN crl-16846 70 65 the the DET crl-16846 70 66 university university PROPN crl-16846 70 67 of of ADP crl-16846 70 68 minnesota minnesota PROPN crl-16846 70 69 has have AUX crl-16846 70 70 been be AUX crl-16846 70 71 building build VERB crl-16846 70 72 capacity capacity NOUN crl-16846 70 73 to to PART crl-16846 70 74 support support VERB crl-16846 70 75 reproducibility reproducibility NOUN crl-16846 70 76 . . PUNCT crl-16846 71 1 in in ADP crl-16846 71 2 2016 2016 NUM crl-16846 71 3 , , PUNCT crl-16846 71 4 the the DET crl-16846 71 5 university university PROPN crl-16846 71 6 of of ADP crl-16846 71 7 minnesota minnesota PROPN crl-16846 71 8 libraries library NOUN crl-16846 71 9 cohosted cohoste VERB crl-16846 71 10 a a DET crl-16846 71 11 lecture lecture NOUN crl-16846 71 12 by by ADP crl-16846 71 13 brian brian PROPN crl-16846 71 14 nosek nosek PROPN crl-16846 71 15 , , PUNCT crl-16846 71 16 cofounder cofounder NOUN crl-16846 71 17 of of ADP crl-16846 71 18 the the DET crl-16846 71 19 center center NOUN crl-16846 71 20 for for ADP crl-16846 71 21 open open ADJ crl-16846 71 22 science science NOUN crl-16846 71 23 . . PUNCT crl-16846 72 1 following follow VERB crl-16846 72 2 this this DET crl-16846 72 3 talk talk NOUN crl-16846 72 4 , , PUNCT crl-16846 72 5 we we PRON crl-16846 72 6 cohosted cohoste VERB crl-16846 72 7 a a DET crl-16846 72 8 reproducibility reproducibility NOUN crl-16846 72 9 in in ADP crl-16846 72 10 research research NOUN crl-16846 72 11 event event NOUN crl-16846 72 12 that that PRON crl-16846 72 13 featured feature VERB crl-16846 72 14 lightning lightning NOUN crl-16846 72 15 talks talk NOUN crl-16846 72 16 on on ADP crl-16846 72 17 various various ADJ crl-16846 72 18 topics topic NOUN crl-16846 72 19 related relate VERB crl-16846 72 20 to to ADP crl-16846 72 21 transparent transparent ADJ crl-16846 72 22 , , PUNCT crl-16846 72 23 open open ADJ crl-16846 72 24 , , PUNCT crl-16846 72 25 and and CCONJ crl-16846 72 26 reproducible reproducible ADJ crl-16846 72 27 research research NOUN crl-16846 72 28 , , PUNCT crl-16846 72 29 including include VERB crl-16846 72 30 numerous numerous ADJ crl-16846 72 31 speakers speaker NOUN crl-16846 72 32 who who PRON crl-16846 72 33 highlighted highlight VERB crl-16846 72 34 library library NOUN crl-16846 72 35 expertise expertise NOUN crl-16846 72 36 and and CCONJ crl-16846 72 37 services.47 services.47 NOUN crl-16846 72 38 this this DET crl-16846 72 39 internal internal ADJ crl-16846 72 40 event event NOUN crl-16846 72 41 served serve VERB crl-16846 72 42 as as ADP crl-16846 72 43 an an DET crl-16846 72 44 opportunity opportunity NOUN crl-16846 72 45 to to PART crl-16846 72 46 showcase showcase VERB crl-16846 72 47 how how SCONJ crl-16846 72 48 library library NOUN crl-16846 72 49 services service NOUN crl-16846 72 50 connect connect VERB crl-16846 72 51 to to ADP crl-16846 72 52 reproducibility reproducibility NOUN crl-16846 72 53 and and CCONJ crl-16846 72 54 connect connect VERB crl-16846 72 55 our our PRON crl-16846 72 56 staff staff NOUN crl-16846 72 57 with with ADP crl-16846 72 58 staff staff NOUN crl-16846 72 59 from from ADP crl-16846 72 60 other other ADJ crl-16846 72 61 research research NOUN crl-16846 72 62 support support NOUN crl-16846 72 63 units unit NOUN crl-16846 72 64 . . PUNCT crl-16846 73 1 following follow VERB crl-16846 73 2 this this DET crl-16846 73 3 event event NOUN crl-16846 73 4 , , PUNCT crl-16846 73 5 we we PRON crl-16846 73 6 partnered partner VERB crl-16846 73 7 with with ADP crl-16846 73 8 other other ADJ crl-16846 73 9 research research NOUN crl-16846 73 10 support support NOUN crl-16846 73 11 units unit NOUN crl-16846 73 12 on on ADP crl-16846 73 13 campus campus NOUN crl-16846 73 14 to to PART crl-16846 73 15 develop develop VERB crl-16846 73 16 a a DET crl-16846 73 17 web web NOUN crl-16846 73 18 portal portal NOUN crl-16846 73 19 ( ( PUNCT crl-16846 73 20 https://www.lib.umn.edu/researchsupport/reproducibility https://www.lib.umn.edu/researchsupport/reproducibility NOUN crl-16846 73 21 ) ) PUNCT crl-16846 73 22 with with ADP crl-16846 73 23 the the DET crl-16846 73 24 goal goal NOUN crl-16846 73 25 of of ADP crl-16846 73 26 bringing bring VERB crl-16846 73 27 together together ADV crl-16846 73 28 campus campus NOUN crl-16846 73 29 stakeholders stakeholder NOUN crl-16846 73 30 to to PART crl-16846 73 31 help help VERB crl-16846 73 32 improve improve VERB crl-16846 73 33 research research NOUN crl-16846 73 34 practices.48 practices.48 NOUN crl-16846 73 35 these these DET crl-16846 73 36 activities activity NOUN crl-16846 73 37 have have AUX crl-16846 73 38 led lead VERB crl-16846 73 39 to to ADP crl-16846 73 40 numerous numerous ADJ crl-16846 73 41 invitations invitation NOUN crl-16846 73 42 to to PART crl-16846 73 43 speak speak VERB crl-16846 73 44 to to PART crl-16846 73 45 research research VERB crl-16846 73 46 groups group NOUN crl-16846 73 47 about about ADP crl-16846 73 48 reproducibility reproducibility NOUN crl-16846 73 49 . . PUNCT crl-16846 74 1 to to PART crl-16846 74 2 support support VERB crl-16846 74 3 reproducibility reproducibility NOUN crl-16846 74 4 , , PUNCT crl-16846 74 5 librarians librarians PROPN crl-16846 74 6 will will AUX crl-16846 74 7 have have VERB crl-16846 74 8 to to PART crl-16846 74 9 develop develop VERB crl-16846 74 10 expertise expertise NOUN crl-16846 74 11 in in ADP crl-16846 74 12 how how SCONJ crl-16846 74 13 the the DET crl-16846 74 14 disciplines discipline NOUN crl-16846 74 15 they they PRON crl-16846 74 16 support support VERB crl-16846 74 17 define define NOUN crl-16846 74 18 reproducibility reproducibility NOUN crl-16846 74 19 , , PUNCT crl-16846 74 20 the the DET crl-16846 74 21 disciplinary disciplinary ADJ crl-16846 74 22 norms norm NOUN crl-16846 74 23 regarding regard VERB crl-16846 74 24 transparency transparency NOUN crl-16846 74 25 , , PUNCT crl-16846 74 26 and and CCONJ crl-16846 74 27 the the DET crl-16846 74 28 methods method NOUN crl-16846 74 29 used use VERB crl-16846 74 30 in in ADP crl-16846 74 31 these these DET crl-16846 74 32 disciplines discipline NOUN crl-16846 74 33 . . PUNCT crl-16846 75 1 librarians librarian NOUN crl-16846 75 2 will will AUX crl-16846 75 3 also also ADV crl-16846 75 4 need need VERB crl-16846 75 5 to to PART crl-16846 75 6 consider consider VERB crl-16846 75 7 gaining gain VERB crl-16846 75 8 the the DET crl-16846 75 9 expertise expertise NOUN crl-16846 75 10 needed need VERB crl-16846 75 11 to to PART crl-16846 75 12 support support VERB crl-16846 75 13 computational computational ADJ crl-16846 75 14 research research NOUN crl-16846 75 15 and and CCONJ crl-16846 75 16 workflow workflow NOUN crl-16846 75 17 technology technology NOUN crl-16846 75 18 ( ( PUNCT crl-16846 75 19 such such ADJ crl-16846 75 20 as as ADP crl-16846 75 21 osf osf NOUN crl-16846 75 22 , , PUNCT crl-16846 75 23 r r NOUN crl-16846 75 24 , , PUNCT crl-16846 75 25 python python NOUN crl-16846 75 26 ) ) PUNCT crl-16846 75 27 . . PUNCT crl-16846 76 1 finally finally ADV crl-16846 76 2 , , PUNCT crl-16846 76 3 academic academic ADJ crl-16846 76 4 libraries library NOUN crl-16846 76 5 will will AUX crl-16846 76 6 need need VERB crl-16846 76 7 to to PART crl-16846 76 8 reframe reframe VERB crl-16846 76 9 existing exist VERB crl-16846 76 10 services service NOUN crl-16846 76 11 and and CCONJ crl-16846 76 12 expertise expertise NOUN crl-16846 76 13 as as ADP crl-16846 76 14 impacting impact VERB crl-16846 76 15 reproducibility reproducibility NOUN crl-16846 76 16 and and CCONJ crl-16846 76 17 strongly strongly ADV crl-16846 76 18 advocate advocate VERB crl-16846 76 19 for for ADP crl-16846 76 20 our our PRON crl-16846 76 21 role role NOUN crl-16846 76 22 in in ADP crl-16846 76 23 addressing address VERB crl-16846 76 24 these these DET crl-16846 76 25 issues issue NOUN crl-16846 76 26 . . PUNCT crl-16846 77 1 what what PRON crl-16846 77 2 we we PRON crl-16846 77 3 can can AUX crl-16846 77 4 do do AUX crl-16846 77 5 individually individually ADV crl-16846 77 6 and and CCONJ crl-16846 77 7 collectively collectively ADV crl-16846 77 8 to to PART crl-16846 77 9 support support VERB crl-16846 77 10 reproducibility reproducibility NOUN crl-16846 77 11 will will AUX crl-16846 77 12 depend depend VERB crl-16846 77 13 on on ADP crl-16846 77 14 many many ADJ crl-16846 77 15 factors factor NOUN crl-16846 77 16 , , PUNCT crl-16846 77 17 including include VERB crl-16846 77 18 professional professional ADJ crl-16846 77 19 development development NOUN crl-16846 77 20 . . PUNCT crl-16846 78 1 future future ADJ crl-16846 78 2 iterations iteration NOUN crl-16846 78 3 of of ADP crl-16846 78 4 reproducibility reproducibility NOUN crl-16846 78 5 symposiums symposium NOUN crl-16846 78 6 such such ADJ crl-16846 78 7 as as ADP crl-16846 78 8 those those PRON crl-16846 78 9 offered offer VERB crl-16846 78 10 by by ADP crl-16846 78 11 mla mla NOUN crl-16846 78 12 2017 2017 NUM crl-16846 78 13 annual annual ADJ crl-16846 78 14 conference conference NOUN crl-16846 78 15 and and CCONJ crl-16846 78 16 at at ADP crl-16846 78 17 the the DET crl-16846 78 18 university university PROPN crl-16846 78 19 of of ADP crl-16846 78 20 utah utah PROPN crl-16846 78 21 may may AUX crl-16846 78 22 be be AUX crl-16846 78 23 an an DET crl-16846 78 24 option option NOUN crl-16846 78 25 for for ADP crl-16846 78 26 professional professional ADJ crl-16846 78 27 development development NOUN crl-16846 78 28 . . PUNCT crl-16846 79 1 librarians librarian NOUN crl-16846 79 2 could could AUX crl-16846 79 3 also also ADV crl-16846 79 4 attend attend VERB crl-16846 79 5 disciplinary disciplinary ADJ crl-16846 79 6 conferences conference NOUN crl-16846 79 7 and and CCONJ crl-16846 79 8 symposiums symposium NOUN crl-16846 79 9 about about ADP crl-16846 79 10 reproducibility reproducibility NOUN crl-16846 79 11 . . PUNCT crl-16846 80 1 for for ADP crl-16846 80 2 librarians librarian NOUN crl-16846 80 3 in in ADP crl-16846 80 4 the the DET crl-16846 80 5 social social ADJ crl-16846 80 6 sciences sciences PROPN crl-16846 80 7 , , PUNCT crl-16846 80 8 research research NOUN crl-16846 80 9 transparency transparency NOUN crl-16846 80 10 and and CCONJ crl-16846 80 11 reproducibility reproducibility NOUN crl-16846 80 12 trainings training NOUN crl-16846 80 13 are be AUX crl-16846 80 14 https://www.lib.umn.edu/researchsupport/reproducibility https://www.lib.umn.edu/researchsupport/reproducibility NOUN crl-16846 80 15 editorial editorial NOUN crl-16846 80 16     SPACE crl-16846 80 17 7 7 NUM crl-16846 80 18 hosted host VERB crl-16846 80 19 by by ADP crl-16846 80 20 the the DET crl-16846 80 21 berkeley berkeley PROPN crl-16846 80 22 initiative initiative NOUN crl-16846 80 23 for for ADP crl-16846 80 24 transparency transparency NOUN crl-16846 80 25 in in ADP crl-16846 80 26 the the DET crl-16846 80 27 social social ADJ crl-16846 80 28 sciences.49 sciences.49 PROPN crl-16846 80 29 one one NUM crl-16846 80 30 iteration iteration NOUN crl-16846 80 31 in in ADP crl-16846 80 32 june june PROPN crl-16846 80 33 2017 2017 NUM crl-16846 80 34 at at ADP crl-16846 80 35 university university PROPN crl-16846 80 36 of of ADP crl-16846 80 37 california california PROPN crl-16846 80 38 , , PUNCT crl-16846 80 39 berkeley berkeley PROPN crl-16846 80 40 included include VERB crl-16846 80 41 academic academic ADJ crl-16846 80 42 librarians librarian NOUN crl-16846 80 43 in in ADP crl-16846 80 44 attendance attendance NOUN crl-16846 80 45 . . PUNCT crl-16846 81 1 we we PRON crl-16846 81 2 believe believe VERB crl-16846 81 3 that that SCONJ crl-16846 81 4 academic academic ADJ crl-16846 81 5 institutions institution NOUN crl-16846 81 6 have have VERB crl-16846 81 7 a a DET crl-16846 81 8 clear clear ADJ crl-16846 81 9 responsibility responsibility NOUN crl-16846 81 10 to to PART crl-16846 81 11 address address VERB crl-16846 81 12 issues issue NOUN crl-16846 81 13 with with ADP crl-16846 81 14 research research NOUN crl-16846 81 15 reproducibility reproducibility NOUN crl-16846 81 16 and and CCONJ crl-16846 81 17 that that SCONJ crl-16846 81 18 academic academic ADJ crl-16846 81 19 libraries library NOUN crl-16846 81 20 are be AUX crl-16846 81 21 positioned position VERB crl-16846 81 22 to to PART crl-16846 81 23 be be AUX crl-16846 81 24 natural natural ADJ crl-16846 81 25 leaders leader NOUN crl-16846 81 26 on on ADP crl-16846 81 27 these these DET crl-16846 81 28 issues issue NOUN crl-16846 81 29 . . PUNCT crl-16846 82 1 many many ADJ crl-16846 82 2 of of ADP crl-16846 82 3 the the DET crl-16846 82 4 measures measure NOUN crl-16846 82 5 recommended recommend VERB crl-16846 82 6 to to PART crl-16846 82 7 improve improve VERB crl-16846 82 8 reproducibility reproducibility NOUN crl-16846 82 9 represent represent VERB crl-16846 82 10 core core NOUN crl-16846 82 11 areas area NOUN crl-16846 82 12 of of ADP crl-16846 82 13 academic academic ADJ crl-16846 82 14 librarianship librarianship NOUN crl-16846 82 15 , , PUNCT crl-16846 82 16 including include VERB crl-16846 82 17 data data NOUN crl-16846 82 18 management management NOUN crl-16846 82 19 , , PUNCT crl-16846 82 20 scholarly scholarly ADJ crl-16846 82 21 communication communication NOUN crl-16846 82 22 , , PUNCT crl-16846 82 23 and and CCONJ crl-16846 82 24 support support NOUN crl-16846 82 25 for for ADP crl-16846 82 26 data datum NOUN crl-16846 82 27 and and CCONJ crl-16846 82 28 computationally computationally ADV crl-16846 82 29 intensive intensive ADJ crl-16846 82 30 research research NOUN crl-16846 82 31 . . PUNCT crl-16846 83 1 by by ADP crl-16846 83 2 increasing increase VERB crl-16846 83 3 our our PRON crl-16846 83 4 knowledge knowledge NOUN crl-16846 83 5 of of ADP crl-16846 83 6 disciplinary disciplinary ADJ crl-16846 83 7 , , PUNCT crl-16846 83 8 journal journal NOUN crl-16846 83 9 , , PUNCT crl-16846 83 10 funder funder VERB crl-16846 83 11 , , PUNCT crl-16846 83 12 and and CCONJ crl-16846 83 13 society society NOUN crl-16846 83 14 perspectives perspective NOUN crl-16846 83 15 on on ADP crl-16846 83 16 reproducibility reproducibility NOUN crl-16846 83 17 , , PUNCT crl-16846 83 18 and and CCONJ crl-16846 83 19 reframing reframe VERB crl-16846 83 20 existing exist VERB crl-16846 83 21 librarian librarian ADJ crl-16846 83 22 expertise expertise NOUN crl-16846 83 23 and and CCONJ crl-16846 83 24 services service NOUN crl-16846 83 25 , , PUNCT crl-16846 83 26 academic academic ADJ crl-16846 83 27 librarians librarian NOUN crl-16846 83 28 will will AUX crl-16846 83 29 be be AUX crl-16846 83 30 well well ADV crl-16846 83 31 positioned position VERB crl-16846 83 32 to to PART crl-16846 83 33 support support VERB crl-16846 83 34 reproducible reproducible ADJ crl-16846 83 35 research research NOUN crl-16846 83 36 . . PUNCT crl-16846 84 1 acknowledgements acknowledgement NOUN crl-16846 84 2 the the DET crl-16846 84 3 authors author NOUN crl-16846 84 4 acknowledge acknowledge VERB crl-16846 84 5 helpful helpful ADJ crl-16846 84 6 and and CCONJ crl-16846 84 7 insightful insightful ADJ crl-16846 84 8 feedback feedback NOUN crl-16846 84 9 from from ADP crl-16846 84 10 colleagues colleague NOUN crl-16846 84 11 including include VERB crl-16846 84 12 lisa lisa PROPN crl-16846 84 13 federer federer PROPN crl-16846 84 14 , , PUNCT crl-16846 84 15 melissa melissa PROPN crl-16846 84 16 rethlefsen rethlefsen PROPN crl-16846 84 17 , , PUNCT crl-16846 84 18 and and CCONJ crl-16846 84 19 jeffrey jeffrey PROPN crl-16846 84 20 spies spy NOUN crl-16846 84 21 . . PUNCT crl-16846 85 1 franklin franklin PROPN crl-16846 85 2 sayre sayre PROPN crl-16846 85 3 pharmacy pharmacy PROPN crl-16846 85 4 librarian librarian PROPN crl-16846 85 5 at at ADP crl-16846 85 6 university university PROPN crl-16846 85 7 of of ADP crl-16846 85 8 minnesota minnesota PROPN crl-16846 85 9 amy amy PROPN crl-16846 85 10 riegelman riegelman PROPN crl-16846 85 11 social social PROPN crl-16846 85 12 sciences sciences PROPN crl-16846 85 13 librarian librarian NOUN crl-16846 85 14 at at ADP crl-16846 85 15 the the DET crl-16846 85 16 university university PROPN crl-16846 85 17 of of ADP crl-16846 85 18 minnesota minnesota PROPN crl-16846 85 19 notes notes PROPN crl-16846 85 20 1 1 NUM crl-16846 85 21 . . PUNCT crl-16846 85 22 open open ADJ crl-16846 85 23 science science NOUN crl-16846 85 24 collaboration collaboration NOUN crl-16846 85 25 , , PUNCT crl-16846 85 26 “ " PUNCT crl-16846 85 27 estimating estimate VERB crl-16846 85 28 the the DET crl-16846 85 29 reproducibility reproducibility NOUN crl-16846 85 30 of of ADP crl-16846 85 31 psychological psychological ADJ crl-16846 85 32 science science NOUN crl-16846 85 33 , , PUNCT crl-16846 85 34 ” " PUNCT crl-16846 85 35 science science NOUN crl-16846 85 36 349 349 NUM crl-16846 85 37 ( ( PUNCT crl-16846 85 38 2015 2015 NUM crl-16846 85 39 ) ) PUNCT crl-16846 85 40 . . PUNCT crl-16846 86 1 2 2 X crl-16846 86 2 . . X crl-16846 86 3 keith keith PROPN crl-16846 86 4 a. a. PROPN crl-16846 86 5 baggerly baggerly ADV crl-16846 86 6 and and CCONJ crl-16846 86 7 kevin kevin PROPN crl-16846 86 8 r. r. PROPN crl-16846 86 9 coombes coombes PROPN crl-16846 86 10 , , PUNCT crl-16846 86 11 “ " PUNCT crl-16846 86 12 deriving derive VERB crl-16846 86 13 chemosensitivity chemosensitivity NOUN crl-16846 86 14 from from ADP crl-16846 86 15 cell cell NOUN crl-16846 86 16 lines line NOUN crl-16846 86 17 : : PUNCT crl-16846 86 18 forensic forensic ADJ crl-16846 86 19 bioinformatics bioinformatic NOUN crl-16846 86 20 and and CCONJ crl-16846 86 21 reproducible reproducible ADJ crl-16846 86 22 research research NOUN crl-16846 86 23 in in ADP crl-16846 86 24 high high ADJ crl-16846 86 25 - - PUNCT crl-16846 86 26 throughput throughput NOUN crl-16846 86 27 biology biology NOUN crl-16846 86 28 , , PUNCT crl-16846 86 29 ” " PUNCT crl-16846 86 30 annals annal NOUN crl-16846 86 31 of of ADP crl-16846 86 32 applied apply VERB crl-16846 86 33 statistics statistic NOUN crl-16846 86 34 3 3 NUM crl-16846 86 35 ( ( PUNCT crl-16846 86 36 2009 2009 NUM crl-16846 86 37 ) ) PUNCT crl-16846 86 38 . . PUNCT crl-16846 87 1 3 3 X crl-16846 87 2 . . X crl-16846 87 3 john john PROPN crl-16846 87 4 p.a p.a PROPN crl-16846 87 5 . . PUNCT crl-16846 88 1 ioannidis ioannidis PROPN crl-16846 88 2 , , PUNCT crl-16846 88 3 “ " PUNCT crl-16846 88 4 why why SCONJ crl-16846 88 5 most most ADV crl-16846 88 6 published publish VERB crl-16846 88 7 research research NOUN crl-16846 88 8 findings finding NOUN crl-16846 88 9 are be AUX crl-16846 88 10 false false ADJ crl-16846 88 11 , , PUNCT crl-16846 88 12 ” " PUNCT crl-16846 88 13 plos plos PROPN crl-16846 88 14 medicine medicine PROPN crl-16846 88 15 2 2 NUM crl-16846 88 16 ( ( PUNCT crl-16846 88 17 2005 2005 NUM crl-16846 88 18 ) ) PUNCT crl-16846 88 19 ; ; PUNCT crl-16846 88 20 iain iain ADJ crl-16846 88 21 chalmers chalmer NOUN crl-16846 88 22 et et PROPN crl-16846 88 23 al al PROPN crl-16846 88 24 . . PROPN crl-16846 88 25 , , PUNCT crl-16846 88 26 “ " PUNCT crl-16846 88 27 how how SCONJ crl-16846 88 28 to to PART crl-16846 88 29 increase increase VERB crl-16846 88 30 value value NOUN crl-16846 88 31 and and CCONJ crl-16846 88 32 reduce reduce VERB crl-16846 88 33 waste waste NOUN crl-16846 88 34 when when SCONJ crl-16846 88 35 research research NOUN crl-16846 88 36 priorities priority NOUN crl-16846 88 37 are be AUX crl-16846 88 38 set set VERB crl-16846 88 39 , , PUNCT crl-16846 88 40 ” " PUNCT crl-16846 88 41 lancet lancet PROPN crl-16846 88 42 383 383 NUM crl-16846 88 43 ( ( PUNCT crl-16846 88 44 2014 2014 NUM crl-16846 88 45 ) ) PUNCT crl-16846 88 46 . . PUNCT crl-16846 89 1 4 4 X crl-16846 89 2 . . PROPN crl-16846 89 3 rick rick PROPN crl-16846 89 4 o. o. PROPN crl-16846 89 5 gilmore gilmore PROPN crl-16846 89 6 et et PROPN crl-16846 90 1 al al PROPN crl-16846 90 2 . . PROPN crl-16846 90 3 , , PUNCT crl-16846 90 4 “ " PUNCT crl-16846 90 5 progress progress NOUN crl-16846 90 6 toward toward ADP crl-16846 90 7 openness openness NOUN crl-16846 90 8 , , PUNCT crl-16846 90 9 transparency transparency NOUN crl-16846 90 10 , , PUNCT crl-16846 90 11 and and CCONJ crl-16846 90 12 reproducibility reproducibility NOUN crl-16846 90 13 in in ADP crl-16846 90 14 cognitive cognitive ADJ crl-16846 90 15 neuroscience neuroscience NOUN crl-16846 90 16 , , PUNCT crl-16846 90 17 ” " PUNCT crl-16846 90 18 annals annal NOUN crl-16846 90 19 of of ADP crl-16846 90 20 the the DET crl-16846 90 21 new new PROPN crl-16846 90 22 york york PROPN crl-16846 90 23 academy academy PROPN crl-16846 90 24 of of ADP crl-16846 90 25 sciences science NOUN crl-16846 90 26 1396 1396 NUM crl-16846 90 27 ( ( PUNCT crl-16846 90 28 2017 2017 NUM crl-16846 90 29 ) ) PUNCT crl-16846 90 30 . . PUNCT crl-16846 91 1 5 5 X crl-16846 91 2 . . PROPN crl-16846 91 3 c. c. PROPN crl-16846 91 4 glenn glenn PROPN crl-16846 91 5 begley begley PROPN crl-16846 91 6 and and CCONJ crl-16846 91 7 lee lee PROPN crl-16846 91 8 m. m. PROPN crl-16846 91 9 ellis ellis PROPN crl-16846 91 10 , , PUNCT crl-16846 91 11 “ " PUNCT crl-16846 91 12 drug drug NOUN crl-16846 91 13 development development NOUN crl-16846 91 14 : : PUNCT crl-16846 91 15 raise raise VERB crl-16846 91 16 standards standard NOUN crl-16846 91 17 for for ADP crl-16846 91 18 preclinical preclinical ADJ crl-16846 91 19 cancer cancer NOUN crl-16846 91 20 research research NOUN crl-16846 91 21 , , PUNCT crl-16846 91 22 ” " PUNCT crl-16846 91 23 nature nature NOUN crl-16846 91 24 483 483 NUM crl-16846 91 25 ( ( PUNCT crl-16846 91 26 2012 2012 NUM crl-16846 91 27 ) ) PUNCT crl-16846 91 28 . . PUNCT crl-16846 92 1 6 6 X crl-16846 92 2 . . X crl-16846 92 3 bruce bruce PROPN crl-16846 92 4 c. c. PROPN crl-16846 92 5 gibb gibb PROPN crl-16846 92 6 , , PUNCT crl-16846 92 7 “ " PUNCT crl-16846 92 8 reproducibility reproducibility NOUN crl-16846 92 9 , , PUNCT crl-16846 92 10 ” " PUNCT crl-16846 92 11 nature nature NOUN crl-16846 92 12 chemistry chemistry NOUN crl-16846 92 13 6 6 NUM crl-16846 92 14 ( ( PUNCT crl-16846 92 15 2014 2014 NUM crl-16846 92 16 ) ) PUNCT crl-16846 92 17 . . PUNCT crl-16846 93 1 7 7 X crl-16846 93 2 . . X crl-16846 93 3 rasmus rasmus VERB crl-16846 93 4 e. e. PROPN crl-16846 93 5 benestad benestad PROPN crl-16846 93 6 et et PROPN crl-16846 94 1 al al PROPN crl-16846 94 2 . . PROPN crl-16846 94 3 , , PUNCT crl-16846 94 4 “ " PUNCT crl-16846 94 5 learning learn VERB crl-16846 94 6 from from ADP crl-16846 94 7 mistakes mistake NOUN crl-16846 94 8 in in ADP crl-16846 94 9 climate climate NOUN crl-16846 94 10 research research NOUN crl-16846 94 11 , , PUNCT crl-16846 94 12 ” " PUNCT crl-16846 94 13 theoretical theoretical ADJ crl-16846 94 14 and and CCONJ crl-16846 94 15 applied applied ADJ crl-16846 94 16 climatology climatology NOUN crl-16846 94 17 126 126 NUM crl-16846 94 18 ( ( PUNCT crl-16846 94 19 2016 2016 NUM crl-16846 94 20 ) ) PUNCT crl-16846 94 21 . . PUNCT crl-16846 95 1 8 8 X crl-16846 95 2 . . X crl-16846 95 3 thomas thomas PROPN crl-16846 95 4 herndon herndon PROPN crl-16846 95 5 , , PUNCT crl-16846 95 6 michael michael PROPN crl-16846 95 7 ash ash PROPN crl-16846 95 8 , , PUNCT crl-16846 95 9 and and CCONJ crl-16846 95 10 robert robert PROPN crl-16846 95 11 pollin pollin PROPN crl-16846 95 12 , , PUNCT crl-16846 95 13 “ " PUNCT crl-16846 95 14 does do AUX crl-16846 95 15 high high ADJ crl-16846 95 16 public public ADJ crl-16846 95 17 debt debt NOUN crl-16846 95 18 consistently consistently ADV crl-16846 95 19 stifle stifle VERB crl-16846 95 20 economic economic ADJ crl-16846 95 21 growth growth NOUN crl-16846 95 22 ? ? PUNCT crl-16846 96 1 a a DET crl-16846 96 2 critique critique NOUN crl-16846 96 3 of of ADP crl-16846 96 4 reinhart reinhart NOUN crl-16846 96 5 and and CCONJ crl-16846 96 6 rogoff rogoff NOUN crl-16846 96 7 , , PUNCT crl-16846 96 8 ” " PUNCT crl-16846 96 9 political political ADJ crl-16846 96 10 economy economy NOUN crl-16846 96 11 research research PROPN crl-16846 96 12 institute institute PROPN crl-16846 96 13 working working PROPN crl-16846 96 14 paper paper PROPN crl-16846 96 15 series series PROPN crl-16846 96 16 ( ( PUNCT crl-16846 96 17 2013 2013 NUM crl-16846 96 18 ) ) PUNCT crl-16846 96 19 . . PUNCT crl-16846 97 1 9 9 X crl-16846 97 2 . . PROPN crl-16846 97 3 matthew matthew PROPN crl-16846 97 4 c. c. PROPN crl-16846 97 5 makel makel PROPN crl-16846 97 6 and and CCONJ crl-16846 97 7 jonathan jonathan PROPN crl-16846 97 8 a. a. PROPN crl-16846 97 9 plucker plucker PROPN crl-16846 97 10 , , PUNCT crl-16846 97 11 “ " PUNCT crl-16846 97 12 facts fact NOUN crl-16846 97 13 are be AUX crl-16846 97 14 more more ADV crl-16846 97 15 important important ADJ crl-16846 97 16 than than ADP crl-16846 97 17 novelty novelty NOUN crl-16846 97 18 : : PUNCT crl-16846 97 19 replication replication NOUN crl-16846 97 20 in in ADP crl-16846 97 21 the the DET crl-16846 97 22 education education NOUN crl-16846 97 23 sciences science NOUN crl-16846 97 24 , , PUNCT crl-16846 97 25 ” " PUNCT crl-16846 97 26 educational educational ADJ crl-16846 97 27 researcher researcher NOUN crl-16846 97 28 43 43 NUM crl-16846 97 29 ( ( PUNCT crl-16846 97 30 2014 2014 NUM crl-16846 97 31 ) ) PUNCT crl-16846 97 32 . . PUNCT crl-16846 98 1 10 10 NUM crl-16846 98 2 . . PUNCT crl-16846 99 1 leonard leonard PROPN crl-16846 99 2 p. p. PROPN crl-16846 99 3 freedman freedman PROPN crl-16846 99 4 , , PUNCT crl-16846 99 5 iain iain NOUN crl-16846 99 6 m. m. NOUN crl-16846 99 7 cockburn cockburn NOUN crl-16846 99 8 , , PUNCT crl-16846 99 9 and and CCONJ crl-16846 99 10 timothy timothy PROPN crl-16846 99 11 s. s. PROPN crl-16846 99 12 simcoe simcoe PROPN crl-16846 99 13 , , PUNCT crl-16846 99 14 “ " PUNCT crl-16846 99 15 the the DET crl-16846 99 16 economics economic NOUN crl-16846 99 17 of of ADP crl-16846 99 18 reproducibility reproducibility NOUN crl-16846 99 19 in in ADP crl-16846 99 20 preclinical preclinical ADJ crl-16846 99 21 research research NOUN crl-16846 99 22 , , PUNCT crl-16846 99 23 ” " PUNCT crl-16846 99 24 plos plos PROPN crl-16846 99 25 biology biology PROPN crl-16846 99 26 13 13 NUM crl-16846 99 27 ( ( PUNCT crl-16846 99 28 2015 2015 NUM crl-16846 99 29 ) ) PUNCT crl-16846 99 30 . . PUNCT crl-16846 100 1 11 11 NUM crl-16846 100 2 . . PUNCT crl-16846 100 3 open open ADJ crl-16846 100 4 science science NOUN crl-16846 100 5 collaboration collaboration NOUN crl-16846 100 6 , , PUNCT crl-16846 100 7 “ " PUNCT crl-16846 100 8 an an DET crl-16846 100 9 open open ADJ crl-16846 100 10 , , PUNCT crl-16846 100 11 large large ADJ crl-16846 100 12 - - PUNCT crl-16846 100 13 scale scale NOUN crl-16846 100 14 , , PUNCT crl-16846 100 15 collaborative collaborative ADJ crl-16846 100 16 effort effort NOUN crl-16846 100 17 to to PART crl-16846 100 18 estimate estimate VERB crl-16846 100 19 the the DET crl-16846 100 20 reproducibility reproducibility NOUN crl-16846 100 21 of of ADP crl-16846 100 22 psychological psychological ADJ crl-16846 100 23 science science NOUN crl-16846 100 24 , , PUNCT crl-16846 100 25 ” " PUNCT crl-16846 100 26 perspectives perspective NOUN crl-16846 100 27 on on ADP crl-16846 100 28 psychological psychological ADJ crl-16846 100 29 science science NOUN crl-16846 100 30 7 7 NUM crl-16846 100 31 ( ( PUNCT crl-16846 100 32 2012 2012 NUM crl-16846 100 33 ) ) PUNCT crl-16846 100 34 . . PUNCT crl-16846 101 1 12 12 NUM crl-16846 101 2 . . PUNCT crl-16846 102 1 open open ADJ crl-16846 102 2 science science NOUN crl-16846 102 3 collaboration collaboration NOUN crl-16846 102 4 , , PUNCT crl-16846 102 5 “ " PUNCT crl-16846 102 6 estimating estimate VERB crl-16846 102 7 the the DET crl-16846 102 8 reproducibility reproducibility NOUN crl-16846 102 9 of of ADP crl-16846 102 10 psychological psychological ADJ crl-16846 102 11 science science NOUN crl-16846 102 12 . . PUNCT crl-16846 102 13 ” " PUNCT crl-16846 103 1 13 13 NUM crl-16846 103 2 . . PUNCT crl-16846 103 3 benedict benedict PROPN crl-16846 103 4 carey carey PROPN crl-16846 103 5 , , PUNCT crl-16846 103 6 “ " PUNCT crl-16846 103 7 psychology psychology NOUN crl-16846 103 8 ’s ’s PART crl-16846 103 9 fears fear NOUN crl-16846 103 10 confirmed confirm VERB crl-16846 103 11 : : PUNCT crl-16846 103 12 rechecked rechecke VERB crl-16846 103 13 studies study NOUN crl-16846 103 14 do do AUX crl-16846 103 15 n’t not PART crl-16846 103 16 hold hold VERB crl-16846 103 17 up up ADP crl-16846 103 18 , , PUNCT crl-16846 103 19 ” " PUNCT crl-16846 103 20 in in ADP crl-16846 103 21 new new PROPN crl-16846 103 22 york york PROPN crl-16846 103 23 times times PROPN crl-16846 103 24 ( ( PUNCT crl-16846 103 25 2015 2015 NUM crl-16846 103 26 ) ) PUNCT crl-16846 103 27 ; ; PUNCT crl-16846 103 28 “ " PUNCT crl-16846 103 29 analysis analysis NOUN crl-16846 103 30 casting cast VERB crl-16846 103 31 doubt doubt NOUN crl-16846 103 32 on on ADP crl-16846 103 33 their their PRON crl-16846 103 34 work work NOUN crl-16846 103 35 is be AUX crl-16846 103 36 still still ADV crl-16846 103 37 welcomed welcome VERB crl-16846 103 38 by by ADP crl-16846 103 39 many many ADJ crl-16846 103 40 psychologists psychologist NOUN crl-16846 103 41 , , PUNCT crl-16846 103 42 ” " PUNCT crl-16846 103 43 in in ADP crl-16846 103 44 new new PROPN crl-16846 103 45 york york PROPN crl-16846 103 46 times times PROPN crl-16846 103 47 ( ( PUNCT crl-16846 103 48 2015 2015 NUM crl-16846 103 49 ) ) PUNCT crl-16846 103 50 ; ; PUNCT crl-16846 103 51 “ " PUNCT crl-16846 103 52 report report VERB crl-16846 103 53 questioning question VERB crl-16846 103 54 psychology psychology NOUN crl-16846 103 55 studies study NOUN crl-16846 103 56 is be AUX crl-16846 103 57 criticized criticize VERB crl-16846 103 58 , , PUNCT crl-16846 103 59 ” " PUNCT crl-16846 103 60 in in ADP crl-16846 103 61 new new PROPN crl-16846 103 62 york york PROPN crl-16846 103 63 times times PROPN crl-16846 103 64 ( ( PUNCT crl-16846 103 65 2016 2016 NUM crl-16846 103 66 ) ) PUNCT crl-16846 103 67 . . PUNCT crl-16846 104 1 14 14 NUM crl-16846 104 2 . . PUNCT crl-16846 105 1 ioannidis ioannidi NOUN crl-16846 105 2 , , PUNCT crl-16846 105 3 “ " PUNCT crl-16846 105 4 why why SCONJ crl-16846 105 5 most most ADV crl-16846 105 6 published publish VERB crl-16846 105 7 research research NOUN crl-16846 105 8 findings finding NOUN crl-16846 105 9 are be AUX crl-16846 105 10 false false ADJ crl-16846 105 11 , , PUNCT crl-16846 105 12 ” " PUNCT crl-16846 105 13 e124 e124 PROPN crl-16846 105 14 . . PROPN crl-16846 106 1 15 15 NUM crl-16846 106 2 . . PUNCT crl-16846 107 1 a.j a.j PROPN crl-16846 107 2 . . PROPN crl-16846 107 3 wakefield wakefield PROPN crl-16846 107 4 et et PROPN crl-16846 108 1 al al PROPN crl-16846 108 2 . . PROPN crl-16846 108 3 , , PUNCT crl-16846 108 4 “ " PUNCT crl-16846 108 5 retracted retract VERB crl-16846 108 6 : : PUNCT crl-16846 108 7 ileal ileal NOUN crl-16846 108 8 - - PUNCT crl-16846 108 9 lymphoid lymphoid NOUN crl-16846 108 10 - - PUNCT crl-16846 108 11 nodular nodular ADJ crl-16846 108 12 hyperplasia hyperplasia PROPN crl-16846 108 13 , , PUNCT crl-16846 108 14 non non ADJ crl-16846 108 15 - - ADJ crl-16846 108 16 specific specific ADJ crl-16846 108 17 colitis colitis NOUN crl-16846 108 18 , , PUNCT crl-16846 108 19 and and CCONJ crl-16846 108 20 pervasive pervasive ADJ crl-16846 108 21 developmental developmental ADJ crl-16846 108 22 disorder disorder NOUN crl-16846 108 23 in in ADP crl-16846 108 24 children child NOUN crl-16846 108 25 , , PUNCT crl-16846 108 26 ” " PUNCT crl-16846 108 27 lancet lancet PROPN crl-16846 108 28 351 351 NUM crl-16846 108 29 , , PUNCT crl-16846 108 30 no no NOUN crl-16846 108 31 . . NOUN crl-16846 108 32 9103 9103 NUM crl-16846 108 33 ( ( PUNCT crl-16846 108 34 1998 1998 NUM crl-16846 108 35 ) ) PUNCT crl-16846 108 36 ; ; PUNCT crl-16846 108 37 m.j m.j PROPN crl-16846 108 38 . . PROPN crl-16846 108 39 lacour lacour PROPN crl-16846 108 40 and and CCONJ crl-16846 108 41 8 8 NUM crl-16846 108 42     SPACE crl-16846 108 43 college college PROPN crl-16846 108 44 & & CCONJ crl-16846 108 45 research research PROPN crl-16846 108 46 libraries librarie VERB crl-16846 108 47 january january PROPN crl-16846 108 48 2018 2018 NUM crl-16846 109 1 d.p d.p PROPN crl-16846 109 2 . . PROPN crl-16846 109 3 green green PROPN crl-16846 109 4 , , PUNCT crl-16846 109 5 “ " PUNCT crl-16846 109 6 political political ADJ crl-16846 109 7 science science NOUN crl-16846 109 8 . . PUNCT crl-16846 110 1 when when SCONJ crl-16846 110 2 contact contact NOUN crl-16846 110 3 changes change VERB crl-16846 110 4 minds mind NOUN crl-16846 110 5 : : PUNCT crl-16846 110 6 an an DET crl-16846 110 7 experiment experiment NOUN crl-16846 110 8 on on ADP crl-16846 110 9 transmission transmission NOUN crl-16846 110 10 of of ADP crl-16846 110 11 support support NOUN crl-16846 110 12 for for ADP crl-16846 110 13 gay gay ADJ crl-16846 110 14 equality equality NOUN crl-16846 110 15 , , PUNCT crl-16846 110 16 ” " PUNCT crl-16846 110 17 science science NOUN crl-16846 110 18 346 346 NUM crl-16846 110 19 , , PUNCT crl-16846 110 20 no no INTJ crl-16846 110 21 . . NOUN crl-16846 110 22 6215 6215 NUM crl-16846 110 23 ( ( PUNCT crl-16846 110 24 2014 2014 NUM crl-16846 110 25 ) ) PUNCT crl-16846 110 26 . . PUNCT crl-16846 111 1 16 16 NUM crl-16846 111 2 . . PUNCT crl-16846 111 3 d.r d.r PROPN crl-16846 111 4 . . PROPN crl-16846 111 5 carney carney PROPN crl-16846 111 6 , , PUNCT crl-16846 111 7 a.j a.j PROPN crl-16846 111 8 . . PROPN crl-16846 111 9 cuddy cuddy PROPN crl-16846 111 10 , , PUNCT crl-16846 111 11 and and CCONJ crl-16846 111 12 a.j a.j PROPN crl-16846 111 13 . . PROPN crl-16846 111 14 yap yap PROPN crl-16846 111 15 , , PUNCT crl-16846 111 16 “ " PUNCT crl-16846 111 17 power power NOUN crl-16846 111 18 posing posing NOUN crl-16846 111 19 : : PUNCT crl-16846 111 20 brief brief ADJ crl-16846 111 21 nonverbal nonverbal ADJ crl-16846 111 22 displays display NOUN crl-16846 111 23 affect affect VERB crl-16846 111 24 neuroendocrine neuroendocrine NOUN crl-16846 111 25 levels level NOUN crl-16846 111 26 and and CCONJ crl-16846 111 27 risk risk NOUN crl-16846 111 28 tolerance tolerance NOUN crl-16846 111 29 , , PUNCT crl-16846 111 30 ” " PUNCT crl-16846 111 31 psychological psychological ADJ crl-16846 111 32 science science NOUN crl-16846 111 33 21 21 NUM crl-16846 111 34 , , PUNCT crl-16846 111 35 no no INTJ crl-16846 111 36 . . NOUN crl-16846 111 37 10 10 NUM crl-16846 111 38 ( ( PUNCT crl-16846 111 39 2010 2010 NUM crl-16846 111 40 ) ) PUNCT crl-16846 111 41 ; ; PUNCT crl-16846 111 42 amy amy PROPN crl-16846 111 43 cuddy cuddy PROPN crl-16846 111 44 , , PUNCT crl-16846 111 45 “ " PUNCT crl-16846 111 46 your your PRON crl-16846 111 47 body body NOUN crl-16846 111 48 language language NOUN crl-16846 111 49 may may AUX crl-16846 111 50 shape shape VERB crl-16846 111 51 who who PRON crl-16846 111 52 you you PRON crl-16846 111 53 are be AUX crl-16846 111 54 , , PUNCT crl-16846 111 55 ” " PUNCT crl-16846 111 56 ted ted PROPN crl-16846 111 57 ( ( PUNCT crl-16846 111 58 2012 2012 NUM crl-16846 111 59 ) ) PUNCT crl-16846 111 60 . . PUNCT crl-16846 112 1 17 17 NUM crl-16846 112 2 . . PUNCT crl-16846 113 1 susan susan PROPN crl-16846 113 2 dominus dominus PROPN crl-16846 113 3 , , PUNCT crl-16846 113 4 “ " PUNCT crl-16846 113 5 when when SCONJ crl-16846 113 6 the the DET crl-16846 113 7 revolution revolution NOUN crl-16846 113 8 came come VERB crl-16846 113 9 for for ADP crl-16846 113 10 amy amy PROPN crl-16846 113 11 cuddy cuddy PROPN crl-16846 113 12 , , PUNCT crl-16846 113 13 ” " PUNCT crl-16846 113 14 new new PROPN crl-16846 113 15 york york PROPN crl-16846 113 16 times times PROPN crl-16846 113 17 , , PUNCT crl-16846 113 18 october october PROPN crl-16846 113 19 18 18 NUM crl-16846 113 20 , , PUNCT crl-16846 113 21 2017 2017 NUM crl-16846 113 22 ; ; PUNCT crl-16846 113 23 andrew andrew PROPN crl-16846 113 24 gelman gelman PROPN crl-16846 113 25 and and CCONJ crl-16846 113 26 kaiser kaiser PROPN crl-16846 113 27 fung fung VERB crl-16846 113 28 , , PUNCT crl-16846 113 29 “ " PUNCT crl-16846 113 30 amy amy PROPN crl-16846 113 31 cuddy cuddy PROPN crl-16846 113 32 ’s ’s PART crl-16846 113 33 power power NOUN crl-16846 113 34 pose pose VERB crl-16846 113 35 research research NOUN crl-16846 113 36 is be AUX crl-16846 113 37 the the DET crl-16846 113 38 latest late ADJ crl-16846 113 39 example example NOUN crl-16846 113 40 of of ADP crl-16846 113 41 scientific scientific ADJ crl-16846 113 42 overreach overreach NOUN crl-16846 113 43 , , PUNCT crl-16846 113 44 ” " PUNCT crl-16846 113 45 in in ADP crl-16846 113 46 slate slate NOUN crl-16846 113 47 , , PUNCT crl-16846 113 48 january january PROPN crl-16846 113 49 19 19 NUM crl-16846 113 50 , , PUNCT crl-16846 113 51 2016 2016 NUM crl-16846 113 52 . . PUNCT crl-16846 114 1 18 18 NUM crl-16846 114 2 . . X crl-16846 114 3 monya monya PROPN crl-16846 114 4 baker baker PROPN crl-16846 114 5 , , PUNCT crl-16846 114 6 “ " PUNCT crl-16846 114 7 is be AUX crl-16846 114 8 there there PRON crl-16846 114 9 a a DET crl-16846 114 10 reproducibility reproducibility NOUN crl-16846 114 11 crisis crisis NOUN crl-16846 114 12 ? ? PUNCT crl-16846 114 13 ” " PUNCT crl-16846 115 1 nature nature NOUN crl-16846 115 2 533 533 NUM crl-16846 115 3 ( ( PUNCT crl-16846 115 4 2016 2016 NUM crl-16846 115 5 ) ) PUNCT crl-16846 115 6 . . PUNCT crl-16846 116 1 19 19 NUM crl-16846 116 2 . . X crl-16846 116 3 ibid ibid VERB crl-16846 116 4 . . PUNCT crl-16846 117 1 20 20 NUM crl-16846 117 2 . . X crl-16846 117 3 ibid ibid VERB crl-16846 117 4 . . PUNCT crl-16846 118 1 21 21 NUM crl-16846 118 2 . . PUNCT crl-16846 119 1 steven steven PROPN crl-16846 119 2 n. n. PROPN crl-16846 119 3 goodman goodman PROPN crl-16846 119 4 , , PUNCT crl-16846 119 5 daniele daniele PROPN crl-16846 119 6 fanelli fanelli PROPN crl-16846 119 7 , , PUNCT crl-16846 119 8 and and CCONJ crl-16846 119 9 john john PROPN crl-16846 119 10 p.a p.a PROPN crl-16846 119 11 . . PUNCT crl-16846 120 1 ioannidis ioannidis PROPN crl-16846 120 2 , , PUNCT crl-16846 120 3 “ " PUNCT crl-16846 120 4 what what PRON crl-16846 120 5 does do AUX crl-16846 120 6 research research NOUN crl-16846 120 7 reproducibility reproducibility NOUN crl-16846 120 8 mean mean VERB crl-16846 120 9 ? ? PUNCT crl-16846 120 10 ” " PUNCT crl-16846 121 1 science science NOUN crl-16846 121 2 translational translational ADJ crl-16846 121 3 medicine medicine NOUN crl-16846 121 4 8 8 NUM crl-16846 121 5 , , PUNCT crl-16846 121 6 no no INTJ crl-16846 121 7 . . PUNCT crl-16846 121 8 ( ( PUNCT crl-16846 121 9 2016 2016 NUM crl-16846 121 10 ): ): PUNCT crl-16846 121 11 1 1 X crl-16846 121 12 . . NUM crl-16846 121 13 22 22 NUM crl-16846 121 14 . . PUNCT crl-16846 122 1 prasad prasad PROPN crl-16846 122 2 patil patil PROPN crl-16846 122 3 , , PUNCT crl-16846 122 4 roger roger PROPN crl-16846 122 5 d. d. PROPN crl-16846 122 6 peng peng PROPN crl-16846 122 7 , , PUNCT crl-16846 122 8 and and CCONJ crl-16846 122 9 jeffrey jeffrey PROPN crl-16846 122 10 t. t. PROPN crl-16846 122 11 leek leek PROPN crl-16846 122 12 , , PUNCT crl-16846 122 13 “ " PUNCT crl-16846 122 14 a a DET crl-16846 122 15 statistical statistical ADJ crl-16846 122 16 definition definition NOUN crl-16846 122 17 for for ADP crl-16846 122 18 reproducibility reproducibility NOUN crl-16846 122 19 and and CCONJ crl-16846 122 20 replicability replicability NOUN crl-16846 122 21 , , PUNCT crl-16846 122 22 ” " PUNCT crl-16846 122 23 biorxiv biorxiv NOUN crl-16846 122 24 , , PUNCT crl-16846 122 25 https://www.biorxiv.org/content/early/2016/07/29/066803 https://www.biorxiv.org/content/early/2016/07/29/066803 PROPN crl-16846 122 26 [ [ X crl-16846 122 27 accessed access VERB crl-16846 122 28 september september PROPN crl-16846 122 29 13 13 NUM crl-16846 122 30 , , PUNCT crl-16846 122 31 2017 2017 NUM crl-16846 122 32 ] ] PUNCT crl-16846 122 33 . . PUNCT crl-16846 123 1 23 23 NUM crl-16846 123 2 . . PUNCT crl-16846 124 1 kenneth kenneth PROPN crl-16846 124 2 bollen bollen PROPN crl-16846 124 3 et et PROPN crl-16846 124 4 al al PROPN crl-16846 124 5 . . PROPN crl-16846 124 6 , , PUNCT crl-16846 124 7 “ " PUNCT crl-16846 124 8 social social ADJ crl-16846 124 9 , , PUNCT crl-16846 124 10 behavioral behavioral ADJ crl-16846 124 11 , , PUNCT crl-16846 124 12 and and CCONJ crl-16846 124 13 economic economic ADJ crl-16846 124 14 sciences science NOUN crl-16846 124 15 perspectives perspective NOUN crl-16846 124 16 on on ADP crl-16846 124 17 robust robust ADJ crl-16846 124 18 and and CCONJ crl-16846 124 19 reliable reliable ADJ crl-16846 124 20 science science NOUN crl-16846 124 21 ” " PUNCT crl-16846 124 22 ( ( PUNCT crl-16846 124 23 paper paper NOUN crl-16846 124 24 presented present VERB crl-16846 124 25 at at ADP crl-16846 124 26 the the DET crl-16846 124 27 report report NOUN crl-16846 124 28 of of ADP crl-16846 124 29 the the DET crl-16846 124 30 subcommittee subcommittee NOUN crl-16846 124 31 on on ADP crl-16846 124 32 replicability replicability NOUN crl-16846 124 33 in in ADP crl-16846 124 34 science science NOUN crl-16846 124 35 advisory advisory PROPN crl-16846 124 36 committee committee NOUN crl-16846 124 37 to to ADP crl-16846 124 38 the the DET crl-16846 124 39 national national PROPN crl-16846 124 40 science science PROPN crl-16846 124 41 foundation foundation PROPN crl-16846 124 42 directorate directorate NOUN crl-16846 124 43 for for ADP crl-16846 124 44 social social ADJ crl-16846 124 45 , , PUNCT crl-16846 124 46 behavioral behavioral ADJ crl-16846 124 47 , , PUNCT crl-16846 124 48 and and CCONJ crl-16846 124 49 economic economic ADJ crl-16846 124 50 sciences science NOUN crl-16846 124 51 , , PUNCT crl-16846 124 52 2015 2015 NUM crl-16846 124 53 ) ) PUNCT crl-16846 124 54 , , PUNCT crl-16846 124 55 3 3 NUM crl-16846 124 56 . . NUM crl-16846 124 57 24 24 NUM crl-16846 124 58 . . PUNCT crl-16846 125 1 ibid ibid PROPN crl-16846 125 2 . . PUNCT crl-16846 125 3 , , PUNCT crl-16846 125 4 4 4 NUM crl-16846 125 5 . . NUM crl-16846 125 6 25 25 NUM crl-16846 125 7 . . PUNCT crl-16846 126 1 jeffrey jeffrey PROPN crl-16846 126 2 t. t. PROPN crl-16846 126 3 leek leek PROPN crl-16846 126 4 and and CCONJ crl-16846 126 5 leah leah PROPN crl-16846 126 6 r. r. PROPN crl-16846 126 7 jager jager PROPN crl-16846 126 8 , , PUNCT crl-16846 126 9 “ " PUNCT crl-16846 126 10 is be AUX crl-16846 126 11 most most ADV crl-16846 126 12 published publish VERB crl-16846 126 13 research research NOUN crl-16846 126 14 really really ADV crl-16846 126 15 false false ADJ crl-16846 126 16 ? ? PUNCT crl-16846 126 17 ” " PUNCT crl-16846 127 1 annual annual ADJ crl-16846 127 2 review review NOUN crl-16846 127 3 of of ADP crl-16846 127 4 statistics statistic NOUN crl-16846 127 5 and and CCONJ crl-16846 127 6 its its PRON crl-16846 127 7 application application NOUN crl-16846 127 8 4 4 NUM crl-16846 127 9 ( ( PUNCT crl-16846 127 10 2017 2017 NUM crl-16846 127 11 ): ): PUNCT crl-16846 127 12 111 111 NUM crl-16846 127 13 . . NUM crl-16846 127 14 26 26 NUM crl-16846 127 15 . . PUNCT crl-16846 128 1 karl karl PROPN crl-16846 128 2 broman broman PROPN crl-16846 128 3 et et PROPN crl-16846 129 1 al al PROPN crl-16846 129 2 . . PROPN crl-16846 129 3 , , PUNCT crl-16846 129 4 “ " PUNCT crl-16846 129 5 recommendations recommendation NOUN crl-16846 129 6 to to ADP crl-16846 129 7 funding funding NOUN crl-16846 129 8 agencies agency NOUN crl-16846 129 9 for for ADP crl-16846 129 10 supporting support VERB crl-16846 129 11 reproducible reproducible ADJ crl-16846 129 12 research research NOUN crl-16846 129 13 ” " PUNCT crl-16846 129 14 ( ( PUNCT crl-16846 129 15 paper paper NOUN crl-16846 129 16 presented present VERB crl-16846 129 17 at at ADP crl-16846 129 18 the the DET crl-16846 129 19 american american PROPN crl-16846 129 20 statistical statistical PROPN crl-16846 129 21 association association PROPN crl-16846 129 22 , , PUNCT crl-16846 129 23 2017 2017 NUM crl-16846 129 24 ) ) PUNCT crl-16846 129 25 , , PUNCT crl-16846 129 26 2 2 NUM crl-16846 129 27 . . NUM crl-16846 129 28 27 27 NUM crl-16846 129 29 . . PUNCT crl-16846 130 1 b.a b.a PROPN crl-16846 130 2 . . PROPN crl-16846 130 3 nosek nosek PROPN crl-16846 130 4 et et PROPN crl-16846 131 1 al al PROPN crl-16846 131 2 . . PROPN crl-16846 131 3 , , PUNCT crl-16846 131 4 “ " PUNCT crl-16846 131 5 promoting promote VERB crl-16846 131 6 an an DET crl-16846 131 7 open open ADJ crl-16846 131 8 research research NOUN crl-16846 131 9 culture culture NOUN crl-16846 131 10 , , PUNCT crl-16846 131 11 ” " PUNCT crl-16846 131 12 science science NOUN crl-16846 131 13 348 348 NUM crl-16846 131 14 , , PUNCT crl-16846 131 15 no no INTJ crl-16846 131 16 . . NOUN crl-16846 131 17 6242 6242 NUM crl-16846 131 18 ( ( PUNCT crl-16846 131 19 2015 2015 NUM crl-16846 131 20 ) ) PUNCT crl-16846 131 21 . . PUNCT crl-16846 132 1 28 28 X crl-16846 132 2 . . PUNCT crl-16846 133 1 “ " PUNCT crl-16846 133 2 a a DET crl-16846 133 3 brief brief ADJ crl-16846 133 4 history history NOUN crl-16846 133 5 of of ADP crl-16846 133 6 cos cos PROPN crl-16846 133 7 , , PUNCT crl-16846 133 8 ” " PUNCT crl-16846 133 9 https://cos.io/about/brief-history-cos-2013-2017 https://cos.io/about/brief-history-cos-2013-2017 NOUN crl-16846 133 10 [ [ X crl-16846 133 11 accessed access VERB crl-16846 133 12 october october PROPN crl-16846 133 13 19 19 NUM crl-16846 133 14 , , PUNCT crl-16846 133 15 2017 2017 NUM crl-16846 133 16 ] ] PUNCT crl-16846 133 17 . . PUNCT crl-16846 133 18 29 29 NUM crl-16846 133 19 . . PUNCT crl-16846 134 1 “ " PUNCT crl-16846 134 2 top top ADJ crl-16846 134 3 guidelines guideline NOUN crl-16846 134 4 , , PUNCT crl-16846 134 5 ” " PUNCT crl-16846 134 6 accessed access VERB crl-16846 134 7 september september PROPN crl-16846 134 8 13 13 NUM crl-16846 134 9 , , PUNCT crl-16846 134 10 2017 2017 NUM crl-16846 134 11 . . PUNCT crl-16846 135 1 https://cos.io/our-services/top-guidelines/ https://cos.io/our-services/top-guidelines/ PROPN crl-16846 135 2 30 30 NUM crl-16846 135 3 . . PUNCT crl-16846 136 1 “ " PUNCT crl-16846 136 2 center center NOUN crl-16846 136 3 for for ADP crl-16846 136 4 open open ADJ crl-16846 136 5 science science NOUN crl-16846 136 6 announces announce NOUN crl-16846 136 7 elsevier elsevi ADJ crl-16846 136 8 as as ADP crl-16846 136 9 new new ADJ crl-16846 136 10 signatory signatory NOUN crl-16846 136 11 to to ADP crl-16846 136 12 top top ADJ crl-16846 136 13 guidelines guideline NOUN crl-16846 136 14 , , PUNCT crl-16846 136 15 ” " PUNCT crl-16846 136 16 https://cos.io/about/news/centre-open-science-announces-elsevier-new-signatory-top-guidelines/ https://cos.io/about/news/centre-open-science-announces-elsevier-new-signatory-top-guidelines/ PROPN crl-16846 136 17 [ [ X crl-16846 136 18 accessed access VERB crl-16846 136 19 september september PROPN crl-16846 136 20 30 30 NUM crl-16846 136 21 , , PUNCT crl-16846 136 22 2017 2017 NUM crl-16846 136 23 ] ] PUNCT crl-16846 136 24 . . PUNCT crl-16846 137 1 31 31 NUM crl-16846 137 2 . . PUNCT crl-16846 137 3 center center NOUN crl-16846 137 4 for for ADP crl-16846 137 5 open open ADJ crl-16846 137 6 science science NOUN crl-16846 137 7 , , PUNCT crl-16846 137 8 “ " PUNCT crl-16846 137 9 guidelines guideline NOUN crl-16846 137 10 for for ADP crl-16846 137 11 transparency transparency NOUN crl-16846 137 12 and and CCONJ crl-16846 137 13 openness openness NOUN crl-16846 137 14 promotion promotion NOUN crl-16846 137 15 ( ( PUNCT crl-16846 137 16 top top NOUN crl-16846 137 17 ) ) PUNCT crl-16846 137 18 in in ADP crl-16846 137 19 journal journal NOUN crl-16846 137 20 policies policy NOUN crl-16846 137 21 and and CCONJ crl-16846 137 22 practices practice NOUN crl-16846 137 23 ” " PUNCT crl-16846 137 24 ( ( PUNCT crl-16846 137 25 paper paper NOUN crl-16846 137 26 presented present VERB crl-16846 137 27 at at ADP crl-16846 137 28 the the DET crl-16846 137 29 cos cos PROPN crl-16846 137 30 , , PUNCT crl-16846 137 31 2015 2015 NUM crl-16846 137 32 ) ) PUNCT crl-16846 137 33 . . PUNCT crl-16846 138 1 32 32 NUM crl-16846 138 2 . . PUNCT crl-16846 139 1 broman broman PROPN crl-16846 139 2 et et PROPN crl-16846 140 1 al al PROPN crl-16846 140 2 . . PROPN crl-16846 140 3 , , PUNCT crl-16846 140 4 “ " PUNCT crl-16846 140 5 recommendations recommendation NOUN crl-16846 140 6 to to ADP crl-16846 140 7 funding funding NOUN crl-16846 140 8 agencies agency NOUN crl-16846 140 9 for for ADP crl-16846 140 10 supporting support VERB crl-16846 140 11 reproducible reproducible ADJ crl-16846 140 12 research research NOUN crl-16846 140 13 , , PUNCT crl-16846 140 14 ” " PUNCT crl-16846 140 15 3–4 3–4 NUM crl-16846 140 16 . . PROPN crl-16846 140 17 33 33 NUM crl-16846 140 18 . . PUNCT crl-16846 140 19 ibid ibid VERB crl-16846 140 20 . . PUNCT crl-16846 141 1 34 34 NUM crl-16846 141 2 . . PUNCT crl-16846 142 1 nih nih PROPN crl-16846 142 2 , , PUNCT crl-16846 142 3 “ " PUNCT crl-16846 142 4 principles principle NOUN crl-16846 142 5 and and CCONJ crl-16846 142 6 guidelines guideline NOUN crl-16846 142 7 for for ADP crl-16846 142 8 reporting report VERB crl-16846 142 9 preclinical preclinical ADJ crl-16846 142 10 research research NOUN crl-16846 142 11 , , PUNCT crl-16846 142 12 ” " PUNCT crl-16846 142 13 national national PROPN crl-16846 142 14 institute institute PROPN crl-16846 142 15 of of ADP crl-16846 142 16 health health PROPN crl-16846 142 17 ( ( PUNCT crl-16846 142 18 2014 2014 NUM crl-16846 142 19 ) ) PUNCT crl-16846 142 20 . . PUNCT crl-16846 143 1 35 35 NUM crl-16846 143 2 . . X crl-16846 143 3 federation federation PROPN crl-16846 143 4 of of ADP crl-16846 143 5 american american PROPN crl-16846 143 6 societies society NOUN crl-16846 143 7 for for ADP crl-16846 143 8 experimental experimental ADJ crl-16846 143 9 biology biology NOUN crl-16846 143 10 , , PUNCT crl-16846 143 11 “ " PUNCT crl-16846 143 12 enhancing enhance VERB crl-16846 143 13 research research NOUN crl-16846 143 14 reproducibility reproducibility NOUN crl-16846 143 15 : : PUNCT crl-16846 143 16 recommendations recommendation NOUN crl-16846 143 17 from from ADP crl-16846 143 18 the the DET crl-16846 143 19 federation federation PROPN crl-16846 143 20 of of ADP crl-16846 143 21 american american PROPN crl-16846 143 22 societies society NOUN crl-16846 143 23 for for ADP crl-16846 143 24 experimental experimental ADJ crl-16846 143 25 biology biology NOUN crl-16846 143 26 , , PUNCT crl-16846 143 27 ” " PUNCT crl-16846 143 28 http://faseb.org/science-policy--advocacy-and-communications/science-policy-and-researchissues/research-reproducibility.aspx http://faseb.org/science-policy--advocacy-and-communications/science-policy-and-researchissues/research-reproducibility.aspx PROPN crl-16846 143 29 [ [ PUNCT crl-16846 143 30 accessed access VERB crl-16846 143 31 may may AUX crl-16846 143 32 25 25 NUM crl-16846 143 33 , , PUNCT crl-16846 143 34 2017 2017 NUM crl-16846 143 35 ] ] PUNCT crl-16846 143 36 . . PUNCT crl-16846 144 1 36 36 NUM crl-16846 144 2 . . X crl-16846 144 3 society society NOUN crl-16846 144 4 for for ADP crl-16846 144 5 neuroscience neuroscience NOUN crl-16846 144 6 , , PUNCT crl-16846 144 7 “ " PUNCT crl-16846 144 8 research research NOUN crl-16846 144 9 practices practice NOUN crl-16846 144 10 for for ADP crl-16846 144 11 scientific scientific ADJ crl-16846 144 12 rigor rigor NOUN crl-16846 144 13 : : PUNCT crl-16846 144 14 a a DET crl-16846 144 15 resource resource NOUN crl-16846 144 16 for for ADP crl-16846 144 17 discussion discussion NOUN crl-16846 144 18 , , PUNCT crl-16846 144 19 training training NOUN crl-16846 144 20 , , PUNCT crl-16846 144 21 and and CCONJ crl-16846 144 22 practice practice VERB crl-16846 144 23 , , PUNCT crl-16846 144 24 ” " PUNCT crl-16846 144 25 http://www.sfn.org/advocacy/policy-positions/research-practicesfor-scientific-rigor http://www.sfn.org/advocacy/policy-positions/research-practicesfor-scientific-rigor SPACE crl-16846 144 26 [ [ X crl-16846 144 27 accessed access VERB crl-16846 144 28 september september PROPN crl-16846 144 29 13 13 NUM crl-16846 144 30 , , PUNCT crl-16846 144 31 2017 2017 NUM crl-16846 144 32 ] ] PUNCT crl-16846 144 33 . . PUNCT crl-16846 145 1 37 37 NUM crl-16846 145 2 . . PUNCT crl-16846 145 3 c. c. PROPN crl-16846 145 4 glenn glenn PROPN crl-16846 145 5 begley begley PROPN crl-16846 145 6 , , PUNCT crl-16846 145 7 alastair alastair NOUN crl-16846 145 8 m m PROPN crl-16846 145 9 buchan buchan NOUN crl-16846 145 10 , , PUNCT crl-16846 145 11 and and CCONJ crl-16846 145 12 ulrich ulrich PROPN crl-16846 145 13 dirnagl dirnagl NOUN crl-16846 145 14 , , PUNCT crl-16846 145 15 “ " PUNCT crl-16846 145 16 robust robust ADJ crl-16846 145 17 research research NOUN crl-16846 145 18 : : PUNCT crl-16846 145 19 institutions institution NOUN crl-16846 145 20 must must AUX crl-16846 145 21 do do VERB crl-16846 145 22 their their PRON crl-16846 145 23 part part NOUN crl-16846 145 24 for for ADP crl-16846 145 25 reproducibility reproducibility NOUN crl-16846 145 26 , , PUNCT crl-16846 145 27 ” " PUNCT crl-16846 145 28 nature nature NOUN crl-16846 145 29 525 525 NUM crl-16846 145 30 ( ( PUNCT crl-16846 145 31 2015 2015 NUM crl-16846 145 32 ): ): PUNCT crl-16846 145 33 27 27 NUM crl-16846 145 34 . . NUM crl-16846 146 1 38 38 NUM crl-16846 146 2 . . PUNCT crl-16846 147 1 victoria victoria PROPN crl-16846 147 2 stodden stodden VERB crl-16846 147 3 et et PROPN crl-16846 147 4 al al PROPN crl-16846 147 5 . . PROPN crl-16846 147 6 , , PUNCT crl-16846 147 7 “ " PUNCT crl-16846 147 8 setting set VERB crl-16846 147 9 the the DET crl-16846 147 10 default default NOUN crl-16846 147 11 to to PART crl-16846 147 12 reproducible reproducible VERB crl-16846 147 13 reproducibility reproducibility NOUN crl-16846 147 14 in in ADP crl-16846 147 15 computational computational ADJ crl-16846 147 16 and and CCONJ crl-16846 147 17 experimental experimental ADJ crl-16846 147 18 mathematics mathematic NOUN crl-16846 147 19 , , PUNCT crl-16846 147 20 ” " PUNCT crl-16846 147 21 ( ( PUNCT crl-16846 147 22 2013 2013 NUM crl-16846 147 23 ) ) PUNCT crl-16846 147 24 , , PUNCT crl-16846 147 25 http://stodden.net/icerm_report.pdf http://stodden.net/icerm_report.pdf ADV crl-16846 147 26 [ [ X crl-16846 147 27 accessed access VERB crl-16846 147 28 july july PROPN crl-16846 147 29 26 26 NUM crl-16846 147 30 , , PUNCT crl-16846 147 31 2017 2017 NUM crl-16846 147 32 ] ] PUNCT crl-16846 147 33 . . PUNCT crl-16846 148 1 39 39 NUM crl-16846 148 2 . . PUNCT crl-16846 148 3 stodden stodden VERB crl-16846 148 4 et et PROPN crl-16846 148 5 al al PROPN crl-16846 148 6 . . PROPN crl-16846 148 7 , , PUNCT crl-16846 148 8 “ " PUNCT crl-16846 148 9 setting set VERB crl-16846 148 10 the the DET crl-16846 148 11 default default NOUN crl-16846 148 12 , , PUNCT crl-16846 148 13 ” " PUNCT crl-16846 148 14 7 7 NUM crl-16846 148 15 . . PROPN crl-16846 148 16 40 40 NUM crl-16846 148 17 . . PUNCT crl-16846 149 1 eric eric PROPN crl-16846 149 2 green green PROPN crl-16846 149 3 et et PROPN crl-16846 150 1 al al PROPN crl-16846 150 2 . . PROPN crl-16846 150 3 , , PUNCT crl-16846 150 4 “ " PUNCT crl-16846 150 5 national national ADJ crl-16846 150 6 institutes institute NOUN crl-16846 150 7 of of ADP crl-16846 150 8 health health PROPN crl-16846 150 9 advisory advisory ADJ crl-16846 150 10 committee committee NOUN crl-16846 150 11 to to ADP crl-16846 150 12 the the DET crl-16846 150 13 director director NOUN crl-16846 150 14 national national PROPN crl-16846 150 15 library library NOUN crl-16846 150 16 of of ADP crl-16846 150 17 medicine medicine PROPN crl-16846 150 18 working working NOUN crl-16846 150 19 group group NOUN crl-16846 150 20 final final ADJ crl-16846 150 21 report report NOUN crl-16846 150 22 , , PUNCT crl-16846 150 23 ” " PUNCT crl-16846 150 24 ( ( PUNCT crl-16846 150 25 2015 2015 NUM crl-16846 150 26 ) ) PUNCT crl-16846 150 27 , , PUNCT crl-16846 150 28 https://acd.od.nih.gov/documents/ https://acd.od.nih.gov/documents/ PROPN crl-16846 150 29 reports report VERB crl-16846 150 30 / / SYM crl-16846 150 31 report report NOUN crl-16846 150 32 - - PUNCT crl-16846 150 33 nlm-06112015 nlm-06112015 NOUN crl-16846 150 34 - - PUNCT crl-16846 150 35 acd.pdf acd.pdf PROPN crl-16846 150 36 [ [ PUNCT crl-16846 150 37 accessed access VERB crl-16846 150 38 july july PROPN crl-16846 150 39 22 22 NUM crl-16846 150 40 , , PUNCT crl-16846 150 41 2017 2017 NUM crl-16846 150 42 ] ] PUNCT crl-16846 150 43 . . PUNCT crl-16846 151 1 41 41 NUM crl-16846 151 2 . . PUNCT crl-16846 152 1 “ " PUNCT crl-16846 152 2 jove jove PROPN crl-16846 152 3 librarian librarian PROPN crl-16846 152 4 travel travel PROPN crl-16846 152 5 award award PROPN crl-16846 152 6 , , PUNCT crl-16846 152 7 ” " PUNCT crl-16846 152 8 https://www.jove.com/blog/2017/08/21/jove-librariantravel-award/ https://www.jove.com/blog/2017/08/21/jove-librariantravel-award/ PROPN crl-16846 152 9 [ [ X crl-16846 152 10 accessed access VERB crl-16846 152 11 september september PROPN crl-16846 152 12 20 20 NUM crl-16846 152 13 , , PUNCT crl-16846 152 14 2017 2017 NUM crl-16846 152 15 ] ] PUNCT crl-16846 152 16 . . PUNCT crl-16846 153 1 42 42 NUM crl-16846 153 2 . . PUNCT crl-16846 154 1 vicky vicky PROPN crl-16846 154 2 steeves steeve NOUN crl-16846 154 3 , , PUNCT crl-16846 154 4 “ " PUNCT crl-16846 154 5 reproducibility reproducibility NOUN crl-16846 154 6 librarianship librarianship NOUN crl-16846 154 7 , , PUNCT crl-16846 154 8 ” " PUNCT crl-16846 154 9 collaborative collaborative ADJ crl-16846 154 10 librarianship librarianship NOUN crl-16846 154 11 9 9 NUM crl-16846 154 12 ( ( PUNCT crl-16846 154 13 2017 2017 NUM crl-16846 154 14 ) ) PUNCT crl-16846 154 15 . . PUNCT crl-16846 155 1 43 43 NUM crl-16846 155 2 . . PUNCT crl-16846 156 1 “ " PUNCT crl-16846 156 2 assistant assistant ADJ crl-16846 156 3 or or CCONJ crl-16846 156 4 associate associate ADJ crl-16846 156 5 librarian librarian NOUN crl-16846 156 6 , , PUNCT crl-16846 156 7 ” " PUNCT crl-16846 156 8 university university PROPN crl-16846 156 9 of of ADP crl-16846 156 10 utah utah PROPN crl-16846 156 11 job job NOUN crl-16846 156 12 posting post VERB crl-16846 156 13 since since SCONJ crl-16846 156 14 deleted delete VERB crl-16846 156 15 . . PUNCT crl-16846 156 16 find find VERB crl-16846 156 17 similar similar ADJ crl-16846 156 18 postings posting NOUN crl-16846 156 19 at at ADP crl-16846 156 20 https://utah.peopleadmin.com/postings/ https://utah.peopleadmin.com/postings/ NOUN crl-16846 156 21 [ [ X crl-16846 156 22 accessed access VERB crl-16846 156 23 11 11 NUM crl-16846 156 24 december december PROPN crl-16846 156 25 2017 2017 NUM crl-16846 156 26 ] ] PUNCT crl-16846 156 27 . . PUNCT crl-16846 157 1 44 44 NUM crl-16846 157 2 . . PUNCT crl-16846 158 1 “ " PUNCT crl-16846 158 2 research research NOUN crl-16846 158 3 reproducibility reproducibility NOUN crl-16846 158 4 conference conference NOUN crl-16846 158 5 , , PUNCT crl-16846 158 6 ” " PUNCT crl-16846 158 7 accessed access VERB crl-16846 158 8 august august PROPN crl-16846 158 9 11 11 NUM crl-16846 158 10 , , PUNCT crl-16846 158 11 2017 2017 NUM crl-16846 158 12 . . PUNCT crl-16846 159 1 http://campusguides http://campusguides X crl-16846 159 2 . . PUNCT crl-16846 160 1 lib.utah.edu/utahrr16 lib.utah.edu/utahrr16 PROPN crl-16846 160 2 ; ; PUNCT crl-16846 160 3 “ " PUNCT crl-16846 160 4 the the DET crl-16846 160 5 librarian librarian ADJ crl-16846 160 6 ’s ’s NOUN crl-16846 160 7 role role NOUN crl-16846 160 8 in in ADP crl-16846 160 9 reproducibility reproducibility NOUN crl-16846 160 10 of of ADP crl-16846 160 11 research research NOUN crl-16846 160 12 symposium symposium NOUN crl-16846 160 13 , , PUNCT crl-16846 160 14 ” " PUNCT crl-16846 160 15 http:// http:// NOUN crl-16846 160 16 mlasymposium.libguides.com/2017 mlasymposium.libguides.com/2017 X crl-16846 160 17 [ [ X crl-16846 160 18 accessed access VERB crl-16846 160 19 august august PROPN crl-16846 160 20 11 11 NUM crl-16846 160 21 , , PUNCT crl-16846 160 22 2017 2017 NUM crl-16846 160 23 ] ] PUNCT crl-16846 160 24 . . PUNCT crl-16846 161 1 https://www.biorxiv.org/content/early/2016/07/29/066803 https://www.biorxiv.org/content/early/2016/07/29/066803 VERB crl-16846 161 2 https://cos.io/about/brief-history-cos-2013-2017 https://cos.io/about/brief-history-cos-2013-2017 PRON crl-16846 161 3 https://cos.io/our-services/top-guidelines https://cos.io/our-services/top-guideline VERB crl-16846 161 4 https://cos.io/about/news/centre-open-science-announces-elsevier-new-signatory-top-guidelines/ https://cos.io/about/news/centre-open-science-announces-elsevier-new-signatory-top-guidelines/ NOUN crl-16846 161 5 http://faseb.org/science-policy--advocacy-and-communications/science-policy-and-research-issues/research-reproducibility.aspx http://faseb.org/science-policy--advocacy-and-communications/science-policy-and-research-issues/research-reproducibility.aspx NOUN crl-16846 161 6 http://faseb.org/science-policy--advocacy-and-communications/science-policy-and-research-issues/research-reproducibility.aspx http://faseb.org/science-policy--advocacy-and-communications/science-policy-and-research-issues/research-reproducibility.aspx NOUN crl-16846 161 7 http://www.sfn.org/advocacy/policy-positions/research-practices-for-scientific-rigor http://www.sfn.org/advocacy/policy-positions/research-practices-for-scientific-rigor SPACE crl-16846 161 8 http://www.sfn.org/advocacy/policy-positions/research-practices-for-scientific-rigor http://www.sfn.org/advocacy/policy-positions/research-practices-for-scientific-rigor SPACE crl-16846 162 1 http://stodden.net/icerm_report.pdf http://stodden.net/icerm_report.pdf DET crl-16846 162 2 https://acd.od.nih.gov/documents/reports/report-nlm-06112015-acd.pdf https://acd.od.nih.gov/documents/reports/report-nlm-06112015-acd.pdf NOUN crl-16846 162 3 https://acd.od.nih.gov/documents/reports/report-nlm-06112015-acd.pdf https://acd.od.nih.gov/documents/reports/report-nlm-06112015-acd.pdf NOUN crl-16846 162 4 https://www.jove.com/blog/2017/08/21/jove-librarian-travel-award/ https://www.jove.com/blog/2017/08/21/jove-librarian-travel-award/ ADV crl-16846 162 5 https://www.jove.com/blog/2017/08/21/jove-librarian-travel-award/ https://www.jove.com/blog/2017/08/21/jove-librarian-travel-award/ PROPN crl-16846 162 6 https://utah.peopleadmin.com/postings/ https://utah.peopleadmin.com/postings/ NOUN crl-16846 162 7 http://campusguides.lib.utah.edu/utahrr16 http://campusguides.lib.utah.edu/utahrr16 PROPN crl-16846 162 8 http://campusguides.lib.utah.edu/utahrr16 http://campusguides.lib.utah.edu/utahrr16 VERB crl-16846 162 9 http://mlasymposium.libguides.com/2017 http://mlasymposium.libguides.com/2017 ADP crl-16846 162 10 http://mlasymposium.libguides.com/2017 http://mlasymposium.libguides.com/2017 ADP crl-16846 162 11 editorial editorial NOUN crl-16846 162 12     SPACE crl-16846 162 13 9 9 NUM crl-16846 162 14 45 45 NUM crl-16846 162 15 . . PUNCT crl-16846 163 1 steeves steeve NOUN crl-16846 163 2 , , PUNCT crl-16846 163 3 “ " PUNCT crl-16846 163 4 reproducibility reproducibility NOUN crl-16846 163 5 librarianship librarianship NOUN crl-16846 163 6 . . PUNCT crl-16846 163 7 ” " PUNCT crl-16846 164 1 46 46 NUM crl-16846 164 2 . . PUNCT crl-16846 165 1 melissa melissa PROPN crl-16846 165 2 l. l. PROPN crl-16846 165 3 rethlefsen rethlefsen PROPN crl-16846 165 4 , , PUNCT crl-16846 165 5 mellanye mellanye PROPN crl-16846 165 6 lackey lackey PROPN crl-16846 165 7 , , PUNCT crl-16846 165 8 and and CCONJ crl-16846 165 9 shirley shirley NOUN crl-16846 165 10 zhao zhao PROPN crl-16846 165 11 , , PUNCT crl-16846 165 12 “ " PUNCT crl-16846 165 13 building building NOUN crl-16846 165 14 capacity capacity NOUN crl-16846 165 15 to to PART crl-16846 165 16 encourage encourage VERB crl-16846 165 17 research research NOUN crl-16846 165 18 reproducibility reproducibility NOUN crl-16846 165 19 and and CCONJ crl-16846 165 20 # # SYM crl-16846 165 21 makeresearchtrue makeresearchtrue ADJ crl-16846 165 22 , , PUNCT crl-16846 165 23 ” " PUNCT crl-16846 165 24 journal journal NOUN crl-16846 165 25 of of ADP crl-16846 165 26 the the DET crl-16846 165 27 medical medical PROPN crl-16846 165 28 library library PROPN crl-16846 165 29 association association NOUN crl-16846 165 30 ( ( PUNCT crl-16846 165 31 forthcoming forthcoming ADJ crl-16846 165 32 article article NOUN crl-16846 165 33 ) ) PUNCT crl-16846 165 34 . . PUNCT crl-16846 166 1 47 47 NUM crl-16846 166 2 . . PUNCT crl-16846 167 1 “ " PUNCT crl-16846 167 2 research research NOUN crl-16846 167 3 data data PROPN crl-16846 167 4 management management NOUN crl-16846 167 5 ( ( PUNCT crl-16846 167 6 rdm rdm NOUN crl-16846 167 7 ) ) PUNCT crl-16846 167 8 icop icop NOUN crl-16846 167 9 , , PUNCT crl-16846 167 10 ” " PUNCT crl-16846 167 11 https://sites.google.com/a/umn.edu/rdm-cop/ https://sites.google.com/a/umn.edu/rdm-cop/ NOUN crl-16846 167 12 home home NOUN crl-16846 167 13 [ [ X crl-16846 167 14 accessed access VERB crl-16846 167 15 august august PROPN crl-16846 167 16 29 29 NUM crl-16846 167 17 , , PUNCT crl-16846 167 18 2017 2017 NUM crl-16846 167 19 ] ] PUNCT crl-16846 167 20 . . PUNCT crl-16846 168 1 48 48 NUM crl-16846 168 2 . . PUNCT crl-16846 169 1 jon jon PROPN crl-16846 169 2 jeffryes jeffryes PROPN crl-16846 169 3 , , PUNCT crl-16846 169 4 “ " PUNCT crl-16846 169 5 improving improve VERB crl-16846 169 6 research research NOUN crl-16846 169 7 through through ADP crl-16846 169 8 reproducibility reproducibility NOUN crl-16846 169 9 , , PUNCT crl-16846 169 10 ” " PUNCT crl-16846 169 11 in in ADP crl-16846 169 12 continuum continuum PROPN crl-16846 169 13 ( ( PUNCT crl-16846 169 14 2017 2017 NUM crl-16846 169 15 ) ) PUNCT crl-16846 169 16 , , PUNCT crl-16846 169 17 https:// https:// NOUN crl-16846 169 18 www.continuum.umn.edu/2017/05/improving-research-reproducibility/ www.continuum.umn.edu/2017/05/improving-research-reproducibility/ PROPN crl-16846 169 19 [ [ PUNCT crl-16846 169 20 accessed access VERB crl-16846 169 21 august august PROPN crl-16846 169 22 11 11 NUM crl-16846 169 23 , , PUNCT crl-16846 169 24 2017 2017 NUM crl-16846 169 25 ] ] PUNCT crl-16846 169 26 . . PUNCT crl-16846 170 1 49 49 NUM crl-16846 170 2 . . PUNCT crl-16846 171 1 “ " PUNCT crl-16846 171 2 institutes institute NOUN crl-16846 171 3 , , PUNCT crl-16846 171 4 ” " PUNCT crl-16846 171 5 berkeley berkeley PROPN crl-16846 171 6 initiative initiative NOUN crl-16846 171 7 for for ADP crl-16846 171 8 transparency transparency NOUN crl-16846 171 9 in in ADP crl-16846 171 10 the the DET crl-16846 171 11 social social ADJ crl-16846 171 12 sciences sciences PROPN crl-16846 171 13 , , PUNCT crl-16846 171 14 https://www.bitss https://www.bitss PROPN crl-16846 171 15 . . PUNCT crl-16846 172 1 org org PROPN crl-16846 172 2 / / SYM crl-16846 172 3 event event NOUN crl-16846 172 4 - - PUNCT crl-16846 172 5 types type NOUN crl-16846 172 6 / / SYM crl-16846 172 7 institute/ institute/ NUM crl-16846 172 8 [ [ X crl-16846 172 9 accessed access VERB crl-16846 172 10 october october PROPN crl-16846 172 11 30 30 NUM crl-16846 172 12 , , PUNCT crl-16846 172 13 2017 2017 NUM crl-16846 172 14 ] ] PUNCT crl-16846 172 15 . . PUNCT crl-16846 173 1 https://sites.google.com/a/umn.edu/rdm-cop/home https://sites.google.com/a/umn.edu/rdm-cop/home ADJ crl-16846 173 2 https://sites.google.com/a/umn.edu/rdm-cop/home https://sites.google.com/a/umn.edu/rdm-cop/home ADJ crl-16846 173 3 https://www.continuum.umn.edu/2017/05/improving-research-reproducibility/ https://www.continuum.umn.edu/2017/05/improving-research-reproducibility/ NUM crl-16846 173 4 https://www.continuum.umn.edu/2017/05/improving-research-reproducibility/ https://www.continuum.umn.edu/2017/05/improving-research-reproducibility/ PROPN crl-16846 173 5 https://www.bitss.org/event-types/institute/ https://www.bitss.org/event-types/institute/ PROPN crl-16846 173 6 https://www.bitss.org/event-types/institute/ https://www.bitss.org/event-types/institute/ NOUN crl-16846 173 7 _ _ PUNCT crl-16846 173 8 goback goback NOUN