Coffea Columnar Object Framework For Effective Analysis

Affordable Access

Download Read

Coffea Columnar Object Framework For Effective Analysis

Authors
  • Smith, Nicholas
  • Gray, Lindsey
  • Cremonesi, Matteo
  • Jayatilaka, Bo
  • Gutsche, Oliver
  • Hall, Allison
  • Pedro, Kevin
  • Acosta, Maria
  • Melo, Andrew
  • Belforte, Stefano
  • Pivarski, Jim
Type
Published Article
Journal
EPJ Web of Conferences
Publisher
EDP Sciences
Publication Date
Nov 16, 2020
Volume
245
Identifiers
DOI: 10.1051/epjconf/202024506012
Source
EDP Sciences
Disciplines
  • 6 - Physics Analysis
License
Green
External links

Abstract

The coffea framework provides a new approach to High-Energy Physics analysis, via columnar operations, that improves time-to-insight, scalability, portability, and reproducibility of analysis. It is implemented with the Python programming language, the scientific python package ecosystem, and commodity big data technologies. To achieve this suite of improvements across many use cases, coffea takes a factorized approach, separating the analysis implementation and data delivery scheme. All analysis operations are implemented using the NumPy or awkward-array packages which are wrapped to yield user code whose purpose is quickly intuited. Various data delivery schemes are wrapped into a common front-end which accepts user inputs and code, and returns user defined outputs. We will discuss our experience in implementing analysis of CMS data using the coffea framework along with a discussion of the user experience and future directions.

Report this publication

Statistics

Seen <100 times
Downloaded <100 times