{rfName}

Indexed in

License and use

Icono OpenAccess

Altmetrics

Grant support

H.H. received support for the project PID2020-115439GB-I00 funded by MCIN/AEI/10.13039/501100011033. This publication is also supported as part of a project (BCLLATLAS and ESPACE) that has received funding from the European Research Council under the European Union's Horizon 2020 Research and Innovation Programme (grant agreement numbers 810287 and 874710). This work was supported by a European Research Council Consolidator grant to S.A. (724226_cis-CONTROL), KU Leuven (C14/22/125 to S.A.), Foundation Against Cancer (F/2020/1396 to S.A.), F.W.O. (grants G0I2722N, G0B5619N and G094121N to S.A. and a PhD fellowship to F.D.) and Aligning Science Across Parkinson's (grant number ASAP-000430 to S.A.). K.B.M. and S.A.T. are supported by Wellcome (WT211276/Z/18/Z and Sanger core grant WT206194). Computing was performed at the Vlaams Supercomputer Center and high-throughput sequencing at the Genomics Core Leuven. M.R.C. is supported by the National Institutes on Aging K99/R00AG059918. This work was supported by funding from the Rita Allen Foundation (W.J.G.) and the Human Frontiers Science Program (RGY006S; W.J.G.). W.J.G. is a Chan Zuckerberg Biohub investigator and acknowledges grants 2017-174468 and 2018-182817 from the Chan Zuckerberg Initiative and National Institutes of Health grants RM1-HG007735, UM1-HG009442, UM1-HG009436, R01-HG00990901 and U19-AI057266 (to W.J.G.). W.J.G. acknowledges funding from Emerson Collective. B.D. received financial support by Swiss National Science Foundation 310030_197082 and the EPFL. L.S.L. receives support from an Emmy Noether fellowship by the German Research Foundation (LU 2336/2-1), a National Institutes of Health grant UM1HG012076, a Longevity Impetus grant and a Hector Research Career Development Award by the Hector Fellow Academy. A.C.A. is supported by National Institutes of Health grants RF1-MH128842, R35-GM124704 and R01-DA047237 as well as a Silver Family Foundation Innovator Award.

Analysis of institutional authors

Rafels, AAuthorMarchese, DAuthorCaratu, GAuthorIglesias, MAuthorNajle, SrAuthorSebe-Pedros, AAuthorHeyn, HCorresponding Author

Share

October 11, 2023
Publications
>
Article

Systematic benchmarking of single-cell ATAC-sequencing protocols

Publicated to:Nature Biotechnology. - 2023-08-03 (), DOI: 10.1038/s41587-023-01881-x

Authors: De Rop FV; Hulselmans G; Flerin C; Soler-Vila P; Rafels A; Christiaens V; González-Blas CB; Marchese D; Caratù G; Poovathingal S; Rozenblatt-Rosen O; Slyper M; Luo W; Muus C; Duarte F; Shrestha R; Bagdatli ST; Corces MR; Mamanova L; Knights A; Meyer KB; Mulqueen R; Taherinasab A; Maschmeyer P; Pezoldt J; Lambert CLG; Iglesias M; Najle SR; Dossani ZY; Martelotto LG; Burkett Z; Lebofsky R; Martin-Subero JI; Pillai S; Sebé-Pedrós A; Deplancke B; Teichmann SA; Ludwig LS; Braun TP; Adey AC; Greenleaf WJ; Buenrostro JD; Regev A; Aerts S; Heyn H

Affiliations

Barcelona Inst Sci & Technol BIST, Ctr Genom Regulat CRG, CNAG CRG, Barcelona, Spain - Author
Berlin Inst Med Syst Biol BIMSB, Max Delbruck Ctr Mol Med Helmholtz Assoc MDC, Berlin, Germany - Author
Bio Rad, Digital Biol Grp, Pleasanton, CA USA - Author
Broad Inst & Harvard, Cambridge, MA USA - Author
Broad Inst & MIT & Harvard, Gene Regulat Observ, Cambridge, MA USA - Author
Broad Inst & MIT & Harvard, Klarman Cell Observ, Cambridge, MA USA - Author
Chan Zuckerberg Biohub, San Francisco, CA USA - Author
Charite Univ Med Berlin, Berlin Inst Hlth, Berlin, Germany - Author
Ctr Invest Biomed Red Canc CIBERONC, Madrid, Spain - Author
Ecole Polytech Fed Lausanne EPFL, Inst Bioengn, Sch Life Sci, Lab Syst Biol & Genet, Lausanne, Switzerland - Author
Gladstone Inst Neurol Dis, San Francisco, CA USA - Author
Harvard Univ, Dept Stem Cell & Regenerat Biol, Cambridge, MA USA - Author
ICREA, Barcelona, Spain - Author
Inst Catalana Recerca & Estudis Avancats ICREA, Barcelona, Spain - Author
Inst Invest Biomed August Pi i Sunyer IDIBAPS, Barcelona, Spain - Author
Katholieke Univ Leuven, Dept Human Genet, Leuven, Belgium - Author
Koch Inst Integrat Canc Res, Cambridge, MA USA - Author
Massachusetts Inst Technol MIT, Howard Hughes Med Inst, Dept Biol, Cambridge, MA USA - Author
Oregon Hlth & Sci Univ, Dept Mol & Med Genet, Portland, OR USA - Author
Oregon Hlth & Sci Univ, Knight Canc Inst, Div Hematol & Med Oncol, Portland, OR USA - Author
Oregon Hlth & Sci Univ, Knight Canc Inst, Div Oncol Sci, Portland, OR USA - Author
Stanford Univ, Dept Genet, Stanford, CA USA - Author
Swiss Inst Bioinformat SIB, Lausanne, Switzerland - Author
Univ Adelaide, Adelaide Ctr Epigenet, Fac Hlth & Med Sci, Adelaide, SA, Australia - Author
Univ Adelaide, South Australian Immunogen Canc Inst, Fac Hlth & Med Sci, Adelaide, SA, Australia - Author
Univ Barcelona, Dept Fonaments Clin, Fac Med, Barcelona, Spain - Author
Univ Calif San Francisco, Dept Lab Med, San Francisco, CA USA - Author
Univ Cambridge, Dept Phys, Cavendish Lab, Cambridge, England - Author
Univ Melbourne, Victoria Comprehens Canc Ctr, Ctr Canc Res, Melbourne, Vic, Australia - Author
Univ Pompeu Fabra UPF, Barcelona, Spain - Author
VIB Ctr Brain & Dis Res, Leuven, Belgium - Author
Vitalant Res Inst, San Francisco, CA USA - Author
Wellcome Sanger Inst, Cambridge, England - Author
See more

Abstract

Benchmarking of scATAC-seq protocols demonstrates the effects of data quality on downstream analyses. Single-cell assay for transposase-accessible chromatin by sequencing (scATAC-seq) has emerged as a powerful tool for dissecting regulatory landscapes and cellular heterogeneity. However, an exploration of systemic biases among scATAC-seq technologies has remained absent. In this study, we benchmark the performance of eight scATAC-seq methods across 47 experiments using human peripheral blood mononuclear cells (PBMCs) as a reference sample and develop PUMATAC, a universal preprocessing pipeline, to handle the various sequencing data formats. Our analyses reveal significant differences in sequencing library complexity and tagmentation specificity, which impact cell-type annotation, genotype demultiplexing, peak calling, differential region accessibility and transcription factor motif enrichment. Our findings underscore the importance of sample extraction, method selection, data processing and total cost of experiments, offering valuable guidance for future research. Finally, our data and analysis pipeline encompasses 169,000 PBMC scATAC-seq profiles and a best practices code repository for scATAC-seq data analysis, which are freely available to extend this benchmarking effort to future protocols.

Keywords

BenchmarkingCell typesCellularsCytologyData handlingHuman peripheral bloodPerformancePeripheral blood mononuclear cellsPipelinesSequencing methodSingle cell assaysSingle cellsTranscriptionTransposaseType annotations

Quality index

Bibliometric impact. Analysis of the contribution and dissemination channel

The work has been published in the journal NATURE BIOTECHNOLOGY due to its progression and the good impact it has achieved in recent years, according to the agency WoS (JCR), it has become a reference in its field. In the year of publication of the work, 2023, it was in position 2/174, thus managing to position itself as a Q1 (Primer Cuartil), in the category Biotechnology & Applied Microbiology. Notably, the journal is positioned above the 90th percentile.

From a relative perspective, and based on the normalized impact indicator calculated from World Citations provided by WoS (ESI, Clarivate), it yields a value for the citation normalization relative to the expected citation rate of: 3.46. This indicates that, compared to works in the same discipline and in the same year of publication, it ranks as a work cited above average. (source consulted: ESI Nov 14, 2024)

This information is reinforced by other indicators of the same type, which, although dynamic over time and dependent on the set of average global citations at the time of their calculation, consistently position the work at some point among the top 50% most cited in its field:

  • Weighted Average of Normalized Impact by the Scopus agency: 2.44 (source consulted: FECYT Feb 2024)
  • Field Citation Ratio (FCR) from Dimensions: 14.15 (source consulted: Dimensions Aug 2025)

Specifically, and according to different indexing agencies, this work has accumulated citations as of 2025-08-10, the following number of citations:

  • WoS: 19
  • Scopus: 20
  • Europe PMC: 20

Impact and social visibility

From the perspective of influence or social adoption, and based on metrics associated with mentions and interactions provided by agencies specializing in calculating the so-called "Alternative or Social Metrics," we can highlight as of 2025-08-10:

  • The use, from an academic perspective evidenced by the Altmetric agency indicator referring to aggregations made by the personal bibliographic manager Mendeley, gives us a total of: 127.
  • The use of this contribution in bookmarks, code forks, additions to favorite lists for recurrent reading, as well as general views, indicates that someone is using the publication as a basis for their current work. This may be a notable indicator of future more formal and academic citations. This claim is supported by the result of the "Capture" indicator, which yields a total of: 127 (PlumX).

With a more dissemination-oriented intent and targeting more general audiences, we can observe other more global scores such as:

  • The Total Score from Altmetric: 160.15.
  • The number of mentions on the social network Facebook: 2 (Altmetric).
  • The number of mentions on the social network X (formerly Twitter): 293 (Altmetric).

It is essential to present evidence supporting full alignment with institutional principles and guidelines on Open Science and the Conservation and Dissemination of Intellectual Heritage. A clear example of this is:

  • The work has been submitted to a journal whose editorial policy allows open Open Access publication.

Leadership analysis of institutional authors

This work has been carried out with international collaboration, specifically with researchers from: Australia; Belgium; Germany; Switzerland; United Kingdom; United States of America.

There is a significant leadership presence as some of the institution’s authors appear as the first or last signer, detailed as follows: Last Author (Heyn, Holger).

the author responsible for correspondence tasks has been Heyn, Holger.