Records |
Author |
Fernandez Casani, A.; Garcia Montoro, C.; Gonzalez de la Hoz, S.; Salt, J.; Sanchez, J.; Villaplana Perez, M. |
Title |
Big Data Analytics for the ATLAS EventIndex Project with Apache Spark |
Type |
Journal Article |
Year |
2023 |
Publication |
Computational and Mathematical Methods |
Abbreviated Journal |
Comput. Math. Methods |
Volume |
2023 |
Issue |
|
Pages |
6900908 - 19pp |
Keywords |
|
Abstract |
The ATLAS EventIndex was designed to provide a global event catalogue and limited event-level metadata for ATLAS experiment of the Large Hadron Collider (LHC) and their analysis groups and users during Run 2 (2015-2018) and has been running in production since. The LHC Run 3, started in 2022, has seen increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. A new core storage service is being developed in HBase/Phoenix, and there is work in progress to provide at least the same functionality as the current one for increased data ingestion and search rates and with increasing volumes of stored data. In addition, new tools are being developed for solving the needed access cases within the new storage. This paper describes a new tool using Spark and implemented in Scala for accessing the big data quantities of the EventIndex project stored in HBase/Phoenix. With this tool, we can offer data discovery capabilities at different granularities, providing Spark Dataframes that can be used or refined within the same framework. Data analytic cases of the EventIndex project are implemented, like the search for duplicates of events from the same or different datasets. An algorithm and implementation for the calculation of overlap matrices of events across different datasets are presented. Our approach can be used by other higher-level tools and users, to ease access to the data in a performant and standard way using Spark abstractions. The provided tools decouple data access from the actual data schema, which makes it convenient to hide complexity and possible changes on the backed storage. |
Address |
[Casani, Alvaro Fernandez; Montoro, Carlos Garcia; de la Hoz, Santiago Gonzalez; Salt, Jose; Sanchez, Javier; Perez, Miguel Villaplana] CSIC UV, Inst Corpuscular Phys IFIC, E-46980 Paterna, Spain, Email: alvaro.fernandez@ific.uv.es; |
Corporate Author |
|
Thesis |
|
Publisher |
Wiley-Hindawi |
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
|
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
WOS:001079548500001 |
Approved |
no |
Is ISI |
yes |
International Collaboration |
no |
Call Number |
IFIC @ pastor @ |
Serial |
5706 |
Permanent link to this record |
|
|
|
Author |
Barberis, D. et al; Fernandez Casani, A.; Garcia Montoro, C.; Gonzalez de la Hoz, S.; Salt, J.; Sanchez, J.; Villaplana Perez, M. |
Title |
The ATLAS EventIndex: A BigData Catalogue for All ATLAS Experiment Events |
Type |
Journal Article |
Year |
2023 |
Publication |
Computing and Software for Big Science |
Abbreviated Journal |
Comput. Softw. Big Sci. |
Volume |
7 |
Issue |
|
Pages |
2 - 21pp |
Keywords |
|
Abstract |
The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle interactions every year of operation, processes them for analysis and generates even larger simulated data samples; a global catalogue is needed to keep track of the location of each event record and be able to search and retrieve specific events for in-depth investigations. Each EventIndex record includes summary information on the event itself and the pointers to the files containing the full event. Most components of the EventIndex system are implemented using BigData free and open-source software. This paper describes the architectural choices and their evolution in time, as well as the past, current and foreseen future implementations of all EventIndex components. |
Address |
|
Corporate Author |
|
Thesis |
|
Publisher |
|
Place of Publication |
|
Editor |
|
Language |
|
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
|
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
|
Approved |
no |
Is ISI |
yes |
International Collaboration |
yes |
Call Number |
IFIC @ pastor @ |
Serial |
6079 |
Permanent link to this record |
|
|
|
Author |
ATLAS Collaboration (Aad, G. et al); Cabrera Urban, S.; Castillo Gimenez, V.; Costa, M.J.; Ferrer, A.; Fiorini, L.; Fuster, J.; Garcia, C.; Garcia Navarro, J.E.; Gonzalez de la Hoz, S.; Hernandez Jimenez, Y.; Higon-Rodriguez, E.; Irles Quiles, A.; Kaci, M.; Lacasta, C.; Lacuesta, V.R.; Marti-Garcia, S.; Miñano, M.; Mitsou, V.A.; Moles-Valls, R.; Moreno Llacer, M.; Oliver Garcia, E.; Perez Garcia-Estañ, M.T.; Romero Adam, E.; Ros, E.; Salt, J.; Sanchez Martinez, V.; Solans, C.A.; Soldevila, U.; Sanchez, J.; Torro Pastor, E.; Valladolid Gallego, E.; Valls Ferrer, J.A.; Villaplana Perez, M.; Vos, M.; Wildauer, A. |
Title |
Underlying event characteristics and their dependence on jet size of charged-particle jet events in pp collisions at root(s)=7 TeV with the ATLAS detector |
Type |
Journal Article |
Year |
2012 |
Publication |
Physical Review D |
Abbreviated Journal |
Phys. Rev. D |
Volume |
86 |
Issue |
7 |
Pages |
072004 - 34pp |
Keywords |
|
Abstract |
Distributions sensitive to the underlying event are studied in events containing one or more chargedparticle jets produced in pp collisions at root s = 7 TeV with the ATLAS detector at the Large Hadron Collider (LHC). These measurements reflect 800 μb(-1) of data taken during 2010. Jets are reconstructed using the anti-k(t) algorithm with radius parameter R varying between 0.2 and 1.0. Distributions of the charged-particle multiplicity, the scalar sum of the transverse momentum of charged particles, and the average charged-particle p(T) are measured as functions of p(T)(jet) in regions transverse to and opposite the leading jet for 4 GeV < p(T)(jet) < 100 GeV. In addition, the R dependence of the mean values of these observables is studied. In the transverse region, both the multiplicity and the scalar sum of the transverse momentum at fixed p(T)(jet) vary significantly with R, while the average charged- particle transverse momentum has a minimal dependence on R. Predictions from several Monte Carlo tunes have been compared to the data; the predictions from Pythia 6, based on tunes that have been determined using LHC data, show reasonable agreement with the data, including the dependence on R. Comparisons with other generators indicate that additional tuning of soft-QCD parameters is necessary for these generators. The measurements presented here provide a testing ground for further development of the Monte Carlo models. |
Address |
[Aad, G.; Ahles, F.; Barber, T.; Bernhard, R.; Bitenc, U.; Bruneliere, R.; Christov, A.; Consorti, V.; Fehling-Kaschek, M.; Flechl, M.; Glatzer, J.; Hartert, J.; Herten, G.; Horner, S.; Jakobs, K.; Janus, M.; Kollefrath, M.; Kononov, A. I.; Kuehn, S.; Lai, S.; Landgraf, U.; Lohwasser, K.; Ludwig, I.; Ludwig, J.; Lumb, D.; Mahboubi, K.; Mohr, W.; Nilsen, H.; Parzefall, U.; Rammensee, M.; Rave, T. C.; Runge, K.; Rurikova, Z.; Schmidt, E.; Schumacher, M.; Siegert, F.; Stoerig, K.; Sundermann, J. E.; Temming, K. K.; Thoma, S.; Tsiskaridze, V.; Venturi, M.; Vivarelli, I.; von Radziewski, H.; Anh, T. Vu; Warsinsky, M.; Weiser, C.; Werner, M.; Wiik-Fuchs, L. A. M.; Winkelmann, S.; Xie, S.; Zimmermann, S.] Univ Freiburg, Fak Math & Phys, D-79106 Freiburg, Germany |
Corporate Author |
|
Thesis |
|
Publisher |
Amer Physical Soc |
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
1550-7998 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
WOS:000309585500002 |
Approved |
no |
Is ISI |
yes |
International Collaboration |
yes |
Call Number |
IFIC @ pastor @ |
Serial |
1181 |
Permanent link to this record |
|
|
|
Author |
ATLAS Collaboration (Aad, G. et al); Cabrera Urban, S.; Castillo Gimenez, V.; Costa, M.J.; Ferrer, A.; Fiorini, L.; Fuster, J.; Garcia, C.; Garcia Navarro, J.E.; Gonzalez de la Hoz, S.; Hernandez Jimenez, Y.; Higon-Rodriguez, E.; Irles Quiles, A.; Kaci, M.; Lacasta, C.; Lacuesta, V.R.; Marti-Garcia, S.; Miñano, M.; Mitsou, V.A.; Moles-Valls, R.; Moreno Llacer, M.; Oliver Garcia, E.; Perez Garcia-Estañ, M.T.; Romero Adam, E.; Ros, E.; Salt, J.; Sanchez Martinez, V.; Solans, C.A.; Soldevila, U.; Sanchez, J.; Torro Pastor, E.; Valladolid Gallego, E.; Valls Ferrer, J.A.; Villaplana Perez, M.; Vos, M.; Wildauer, A. |
Title |
Search for the decay B-s(0) -> mu(+)mu(-) with the ATLAS detector |
Type |
Journal Article |
Year |
2012 |
Publication |
Physics Letters B |
Abbreviated Journal |
Phys. Lett. B |
Volume |
713 |
Issue |
4-5 |
Pages |
387-407 |
Keywords |
B meson; Rare decays; FCNC; ATLAS; LHC |
Abstract |
A blind analysis searching for the decay B-s(0) -> mu(+)mu(-) has been performed using proton-proton collisions at a centre-of-mass energy of 7 TeV recorded with the ATLAS detector at the LHC. With an integrated luminosity of 2.4 fb(-1) no excess of events over the background expectation is found and an upper limit is set on the branching fraction BR(B-s(0) -> mu(+)mu(-)) <2.2(1.9) x 10(-8) at 95% (90%) confidence level. |
Address |
[Aad, G.; Ahles, F.; Barber, T.; Bernhard, R.; Bitenc, U.; Bruneliere, R.; Christov, A.; Consorti, V.; Fehling-Kaschek, M.; Flechl, M.; Glatzer, J.; Hartert, J.; Herten, G.; Horner, S.; Jakobs, K.; Janus, M.; Kollefrath, M.; Kononov, A. I.; Kuehn, S.; Lai, S.; Landgraf, U.; Lohwasser, K.; Ludwig, I.; Ludwig, J.; Lumb, D.; Mahboubi, K.; Mohr, W.; Nilsen, H.; Parzefall, U.; Rammensee, M.; Rave, T. C.; Runge, K.; Rurikova, Z.; Schmidt, E.; Schumacher, M.; Siegert, F.; Stoerig, K.; Sundermann, J. E.; Temming, K. K.; Thoma, S.; Tsiskaridze, V.; Venturi, M.; Vivarelli, I.; von Radziewski, H.; Anh, T. Vu; Warsinsky, M.; Weiser, C.; Werner, M.; Winkelmann, S.; Xie, S.; Zimmermann, S.] Univ Freiburg, Fak Math & Phys, D-79106 Freiburg, Germany |
Corporate Author |
|
Thesis |
|
Publisher |
Elsevier Science Bv |
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
0370-2693 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
WOS:000306637900006 |
Approved |
no |
Is ISI |
yes |
International Collaboration |
yes |
Call Number |
IFIC @ pastor @ |
Serial |
1124 |
Permanent link to this record |
|
|
|
Author |
ATLAS Collaboration (Aad, G. et al); Cabrera Urban, S.; Castillo Gimenez, V.; Costa, M.J.; Ferrer, A.; Fiorini, L.; Fuster, J.; Garcia, C.; Garcia Navarro, J.E.; Gonzalez de la Hoz, S.; Hernandez Jimenez, Y.; Higon-Rodriguez, E.; Irles Quiles, A.; Kaci, M.; Lacasta, C.; Lacuesta, V.R.; Marti-Garcia, S.; Miñano, M.; Mitsou, V.A.; Moles-Valls, R.; Moreno Llacer, M.; Oliver Garcia, E.; Perez Garcia-Estañ, M.T.; Romero Adam, E.; Ros, E.; Salt, J.; Sanchez Martinez, V.; Solans, C.A.; Soldevila, U.; Sanchez, J.; Torro Pastor, E.; Valladolid Gallego, E.; Valls Ferrer, J.A.; Villaplana Perez, M.; Vos, M.; Wildauer, A. |
Title |
A search for t (t)over-bar resonances with the ATLAS detector in 2.05 fb(-1) of proton-proton collisions at root s=7 TeV |
Type |
Journal Article |
Year |
2012 |
Publication |
European Physical Journal C |
Abbreviated Journal |
Eur. Phys. J. C |
Volume |
72 |
Issue |
7 |
Pages |
2083 - 23pp |
Keywords |
|
Abstract |
A search for top quark pair resonances in final states containing at least one electron or muon has been performed with the ATLAS experiment at the CERN Large Hadron Collider. The search uses a data sample corresponding to an integrated luminosity of 2.05 fb(-1), which was recorded in 2011 at a proton-proton centre-of-mass energy of 7 TeV. No evidence for a resonance is found and limits are set on the production cross-section times branching ratio to t (t) over bar for narrow and wide resonances. For narrow Z' bosons, the observed 95 % Bayesian credibility level limits range from 9.3 pb to 0.95 pb for masses in the range of m(Z') = 500 GeV to m(Z') = 1300 GeV. The corresponding excluded mass region for a leptophobic topcolour Z' boson (Kaluza-Klein gluon excitation in the Randall-Sundrum model) is m(Z') < 880 GeV (m(gKK) < 1130 GeV). |
Address |
[Aad, G.; Ahles, F.; Barber, T.; Bernhard, R.; Bitenc, U.; Bruneliere, R.; Christov, A.; Consorti, V.; Fehling-Kaschek, M.; Flechl, M.; Glatzer, J.; Hartert, J.; Herten, G.; Horner, S.; Jakobs, K.; Janus, M.; Kollefrath, M.; Kononov, A. I.; Kuehn, S.; Lai, S.; Landgraf, U.; Lohwasser, K.; Ludwig, I.; Ludwig, J.; Lumb, D.; Mahboubi, K.; Mohr, W.; Nilsen, H.; Parzefall, U.; Rammensee, M.; Rave, T. C.; Rurikova, Z.; Schmidt, E.; Schumacher, M.; Siegert, F.; Stoerig, K.; Sundermann, J. E.; Temming, K. K.; Thoma, S.; Tsiskaridze, V.; Venturi, M.; Vivarelli, I.; von Radziewski, H.; Anh, T. Vu; Warsinsky, M.; Weiser, C.; Werner, M.; Wiik-Fuchs, L. A. M.; Winkelmann, S.; Xie, S.; Zimmermann, S.] Univ Freiburg, Fak Math & Phys, D-79106 Freiburg, Germany |
Corporate Author |
|
Thesis |
|
Publisher |
Springer |
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
1434-6044 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
WOS:000307269400029 |
Approved |
no |
Is ISI |
yes |
International Collaboration |
yes |
Call Number |
IFIC @ pastor @ |
Serial |
1132 |
Permanent link to this record |