|
Records |
Links |
|
Author |
Fernandez Casani, A.; Garcia Montoro, C.; Gonzalez de la Hoz, S.; Salt, J.; Sanchez, J.; Villaplana Perez, M. |
|
|
Title |
Big Data Analytics for the ATLAS EventIndex Project with Apache Spark |
Type |
Journal Article |
|
Year |
2023 |
Publication |
Computational and Mathematical Methods |
Abbreviated Journal |
Comput. Math. Methods |
|
|
Volume |
2023 |
Issue |
|
Pages |
6900908 - 19pp |
|
|
Keywords |
|
|
|
Abstract |
The ATLAS EventIndex was designed to provide a global event catalogue and limited event-level metadata for ATLAS experiment of the Large Hadron Collider (LHC) and their analysis groups and users during Run 2 (2015-2018) and has been running in production since. The LHC Run 3, started in 2022, has seen increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. A new core storage service is being developed in HBase/Phoenix, and there is work in progress to provide at least the same functionality as the current one for increased data ingestion and search rates and with increasing volumes of stored data. In addition, new tools are being developed for solving the needed access cases within the new storage. This paper describes a new tool using Spark and implemented in Scala for accessing the big data quantities of the EventIndex project stored in HBase/Phoenix. With this tool, we can offer data discovery capabilities at different granularities, providing Spark Dataframes that can be used or refined within the same framework. Data analytic cases of the EventIndex project are implemented, like the search for duplicates of events from the same or different datasets. An algorithm and implementation for the calculation of overlap matrices of events across different datasets are presented. Our approach can be used by other higher-level tools and users, to ease access to the data in a performant and standard way using Spark abstractions. The provided tools decouple data access from the actual data schema, which makes it convenient to hide complexity and possible changes on the backed storage. |
|
|
Address |
[Casani, Alvaro Fernandez; Montoro, Carlos Garcia; de la Hoz, Santiago Gonzalez; Salt, Jose; Sanchez, Javier; Perez, Miguel Villaplana] CSIC UV, Inst Corpuscular Phys IFIC, E-46980 Paterna, Spain, Email: alvaro.fernandez@ific.uv.es; |
|
|
Corporate Author |
|
Thesis |
|
|
|
Publisher |
Wiley-Hindawi |
Place of Publication |
|
Editor |
|
|
|
Language |
English |
Summary Language |
|
Original Title |
|
|
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
|
Series Volume |
|
Series Issue |
|
Edition |
|
|
|
ISSN |
|
ISBN |
|
Medium |
|
|
|
Area |
|
Expedition |
|
Conference |
|
|
|
Notes |
WOS:001079548500001 |
Approved |
no |
|
|
Is ISI |
yes |
International Collaboration |
no |
|
|
Call Number |
IFIC @ pastor @ |
Serial |
5706 |
|
Permanent link to this record |
|
|
|
|
Author |
Barberis, D. et al; Fernandez Casani, A.; Garcia Montoro, C.; Gonzalez de la Hoz, S.; Salt, J.; Sanchez, J.; Villaplana Perez, M. |
|
|
Title |
The ATLAS EventIndex: A BigData Catalogue for All ATLAS Experiment Events |
Type |
Journal Article |
|
Year |
2023 |
Publication |
Computing and Software for Big Science |
Abbreviated Journal |
Comput. Softw. Big Sci. |
|
|
Volume |
7 |
Issue |
|
Pages |
2 - 21pp |
|
|
Keywords |
|
|
|
Abstract |
The ATLAS EventIndex system comprises the catalogue of all events collected, processed or generated by the ATLAS experiment at the CERN LHC accelerator, and all associated software tools to collect, store and query this information. ATLAS records several billion particle interactions every year of operation, processes them for analysis and generates even larger simulated data samples; a global catalogue is needed to keep track of the location of each event record and be able to search and retrieve specific events for in-depth investigations. Each EventIndex record includes summary information on the event itself and the pointers to the files containing the full event. Most components of the EventIndex system are implemented using BigData free and open-source software. This paper describes the architectural choices and their evolution in time, as well as the past, current and foreseen future implementations of all EventIndex components. |
|
|
Address |
|
|
|
Corporate Author |
|
Thesis |
|
|
|
Publisher |
|
Place of Publication |
|
Editor |
|
|
|
Language |
|
Summary Language |
|
Original Title |
|
|
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
|
Series Volume |
|
Series Issue |
|
Edition |
|
|
|
ISSN |
|
ISBN |
|
Medium |
|
|
|
Area |
|
Expedition |
|
Conference |
|
|
|
Notes |
|
Approved |
no |
|
|
Is ISI |
yes |
International Collaboration |
yes |
|
|
Call Number |
IFIC @ pastor @ |
Serial |
6079 |
|
Permanent link to this record |
|
|
|
|
Author |
ATLAS Collaboration (Aad, G. et al); Amoros, G.; Cabrera Urban, S.; Castillo Gimenez, V.; Costa, M.J.; Escobar, C.; Ferrer, A.; Fuster, J.; Garcia, C.; Gonzalez de la Hoz, S.; Hernandez Jimenez, Y.; Higon-Rodriguez, E.; Irles Quiles, A.; Kaci, M.; Lacasta, C.; Lacuesta, V.R.; Marti-Garcia, S.; Miñano, M.; Mitsou, V.A.; Moles-Valls, R.; Moreno Llacer, M.; Oliver Garcia, E.; Perez Garcia-Estañ, M.T.; Ros, E.; Salt, J.; Solans, C.A.; Sanchez, J.; Torro Pastor, E.; Valero, A.; Valladolid Gallego, E.; Valls Ferrer, J.A.; Villaplana Perez, M.; Vos, M.; Wildauer, A. |
|
|
Title |
Readiness of the ATLAS Tile Calorimeter for LHC collisions |
Type |
Journal Article |
|
Year |
2010 |
Publication |
European Physical Journal C |
Abbreviated Journal |
Eur. Phys. J. C |
|
|
Volume |
70 |
Issue |
4 |
Pages |
1193-1236 |
|
|
Keywords |
|
|
|
Abstract |
The Tile hadronic calorimeter of the ATLAS detector has undergone extensive testing in the experimental hall since its installation in late 2005. The readout, control and calibration systems have been fully operational since 2007 and the detector has successfully collected data from the LHC single beams in 2008 and first collisions in 2009. This paper gives an overview of the Tile Calorimeter performance as measured using random triggers, calibration data, data from cosmic ray muons and single beam data. The detector operation status, noise characteristics and performance of the calibration systems are presented, as well as the validation of the timing and energy calibration carried out with minimum ionising cosmic ray muons data. The calibration systems' precision is well below the design value of 1%. The determination of the global energy scale was performed with an uncertainty of 4%. |
|
|
Address |
[Aad, G.; Ahles, F.; Aktas, A.; Anders, C. F.; Beckingham, M.; Bernhard, R.; Bianchi, R. M.; Bitenc, U.; Bruneliere, R.; Caron, S.; Christov, A.; Dietrich, J.; Dingfelder, J.; Flechl, M.; Hartert, J.; Herten, G.; Horner, S.; Jakobs, K.; Janus, M.; Kuehn, S.; Lai, S.; Landgraf, U.; Lohwasser, K.; Ludwig, I.; Lumb, D.; Mahboubi, K.; Mazur, M.; Meirose, B.; Mohr, W.; Nilsen, H.; Parzefall, U.; Bueso, X. Portell; Rammensee, M.; Rurikova, Z.; Schmidt, E.; Schumacher, M.; Stoerig, K.; Sundermann, J. E.; Thoma, S.; Venturi, M.; Vivarelli, I.; von Radziewski, H.; Warsinsky, M.; Weiser, C.; Werner, M.; Wiik, L. A. M.; Xie, S.; Zimmermann, S.] Univ Freiburg, Fak Math & Phys, D-79104 Freiburg, Germany, Email: atlas.secretariat@cern.ch |
|
|
Corporate Author |
|
Thesis |
|
|
|
Publisher |
Springer |
Place of Publication |
|
Editor |
|
|
|
Language |
English |
Summary Language |
|
Original Title |
|
|
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
|
Series Volume |
|
Series Issue |
|
Edition |
|
|
|
ISSN |
1434-6044 |
ISBN |
|
Medium |
|
|
|
Area |
|
Expedition |
|
Conference |
|
|
|
Notes |
ISI:000285208000023 |
Approved |
no |
|
|
Is ISI |
yes |
International Collaboration |
yes |
|
|
Call Number |
IFIC @ pastor @ |
Serial |
249 |
|
Permanent link to this record |
|
|
|
|
Author |
ATLAS Collaboration (Aad, G. et al); Amoros, G.; Bernabeu Verdu, J.; Cabrera Urban, S.; Castillo Gimenez, V.; Costa, M.J.; Escobar, C.; Ferrer, A.; Fuster, J.; Garcia, C.; Gonzalez de la Hoz, S.; Hernandez Jimenez, Y.; Higon-Rodriguez, E.; Irles Quiles, A.; Kaci, M.; Lacasta, C.; Lacuesta, V.R.; Marti-Garcia, S.; Miñano, M.; Mitsou, V.A.; Moles-Valls, R.; Moreno Llacer, M.; Oliver Garcia, E.; Perez Garcia-Estañ, M.T.; Ros, E.; Salt, J.; Solans, C.A.; Sanchez, J.; Torro Pastor, E.; Valladolid Gallego, E.; Valls Ferrer, J.A.; Villaplana Perez, M.; Vos, M.; Wildauer, A. |
|
|
Title |
The ATLAS Inner Detector commissioning and calibration |
Type |
Journal Article |
|
Year |
2010 |
Publication |
European Physical Journal C |
Abbreviated Journal |
Eur. Phys. J. C |
|
|
Volume |
70 |
Issue |
3 |
Pages |
787-821 |
|
|
Keywords |
|
|
|
Abstract |
The ATLAS Inner Detector is a composite tracking system consisting of silicon pixels, silicon strips and straw tubes in a 2 T magnetic field. Its installation was completed in August 2008 and the detector took part in data-taking with single LHC beams and cosmic rays. The initial detector operation, hardware commissioning and in-situ calibrations are described. Tracking performance has been measured with 7.6 million cosmic-ray events, collected using a tracking trigger and reconstructed with modular pattern-recognition and fitting software. The intrinsic hit efficiency and tracking trigger efficiencies are close to 100%. Lorentz angle measurements for both electrons and holes, specific energy-loss calibration and transition radiation turn-on measurements have been performed. Different alignment techniques have been used to reconstruct the detector geometry. After the initial alignment, a transverse impact parameter resolution of 22.1 +/- 0.9 μm and a relative momentum resolution sigma (p) /p=(4.83 +/- 0.16)x10(-4) GeV(-1)xp (T) have been measured for high momentum tracks. |
|
|
Address |
[Alam, M. S.; Ernst, J.; Mahmood, A.; Rojo, V.] SUNY Albany, Albany, NY 12222 USA, Email: atlas.secretariat@cern.ch |
|
|
Corporate Author |
|
Thesis |
|
|
|
Publisher |
Springer |
Place of Publication |
|
Editor |
|
|
|
Language |
English |
Summary Language |
|
Original Title |
|
|
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
|
Series Volume |
|
Series Issue |
|
Edition |
|
|
|
ISSN |
1434-6044 |
ISBN |
|
Medium |
|
|
|
Area |
|
Expedition |
|
Conference |
|
|
|
Notes |
ISI:000285200000013 |
Approved |
no |
|
|
Is ISI |
yes |
International Collaboration |
yes |
|
|
Call Number |
IFIC @ pastor @ |
Serial |
250 |
|
Permanent link to this record |
|
|
|
|
Author |
ATLAS Collaboration (Aad, G. et al); Amoros, G.; Cabrera Urban, S.; Castillo Gimenez, V.; Costa, M.J.; Escobar, C.; Ferrer, A.; Fuster, J.; Garcia, C.; Gonzalez de la Hoz, S.; Hernandez Jimenez, Y.; Higon-Rodriguez, E.; Irles Quiles, A.; Kaci, M.; Lacasta, C.; Lacuesta, V.R.; Marti-Garcia, S.; Miñano, M.; Mitsou, V.A.; Moles-Valls, R.; Moreno Llacer, M.; Oliver Garcia, E.; Perez Garcia-Estañ, M.T.; Ros, E.; Salt, J.; Solans, C.A.; Sanchez, J.; Torro Pastor, E.; Valladolid Gallego, E.; Valls Ferrer, J.A.; Villaplana Perez, M.; Vos, M.; Wildauer, A. |
|
|
Title |
Measurement of inclusive jet and dijet cross sections in proton-proton collisions at 7 TeV centre-of-mass energy with the ATLAS detector |
Type |
Journal Article |
|
Year |
2011 |
Publication |
European Physical Journal C |
Abbreviated Journal |
Eur. Phys. J. C |
|
|
Volume |
71 |
Issue |
2 |
Pages |
1512 - 59pp |
|
|
Keywords |
|
|
|
Abstract |
Jet cross sections have been measured for the first time in proton-proton collisions at a centre-of-mass energy of 7 TeV using the ATLAS detector. The measurement uses an integrated luminosity of 17 nb(-1) recorded at the Large Hadron Collider. The anti-k(t) algorithm is used to identify jets, with two jet resolution parameters, R = 0.4 and 0.6. The dominant uncertainty comes from the jet energy scale, which is determined to within 7% for central jets above 60 GeV transverse momentum. Inclusive single-jet differential cross sections are presented as functions of jet transverse momentum and rapidity. Dijet cross sections are presented as functions of dijet mass and the angular variable chi. The results are compared to expectations based on next-to-leading-order QCD, which agree with the data, providing a validation of the theory in a new kinematic regime. |
|
|
Address |
[Aad, G.; Ahles, F.; Aktas, A.; Beckingham, M.; Bernius, C.; Bianchi, R. M.; Bitenc, U.; Bruneliere, R.; Caron, S.; Carpentieri, C.; Chromek-Burckhart, D.; Dahlhoff, A.; Dietrich, J.; Eckert, S.; Fehling-Kaschek, M.; Flechl, M.; Glatzer, J.; Hartert, J.; Heldmann, M.; Herten, G.; Horner, S.; Jakobs, K.; Joos, D.; Ketterer, C.; Kollefrath, M.; Kononov, A. I.; Kuehn, S.; Lai, S.; Landgraf, U.; Lohwasser, K.; Ludwig, I.; Ludwig, J.; Lumb, D.; Maassen, M.; Mahboubi, K.; Meinhardt, J.; Messmer, I.; Mohr, W.; Nilsen, H.; Parzefall, U.; Pfeifer, B.; Bueso, X. Portell; Rammensee, M.; Runge, K.; Rurikova, Z.; Schmidt, E.; Schroff, D.; Schumacher, M.; Stoerig, K.; Sundermann, J. E.; Temming, K. K.; Thoma, S.; Tobias, J.; Venturi, M.; Vivarelli, I.; von Radziewski, H.; Warsinsky, M.; Webel, M.; Weiser, C.; Werner, M.; Wiik, L. A. M.; Winkelmann, S.; Xiea, Y.; Zimmermann, S.] Ist Nazl Fis Nucl, Lab Nazl Frascati, IT-00044 Frascati, Italy, Email: atlas.secretariat@cern.ch |
|
|
Corporate Author |
|
Thesis |
|
|
|
Publisher |
Springer |
Place of Publication |
|
Editor |
|
|
|
Language |
English |
Summary Language |
|
Original Title |
|
|
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
|
Series Volume |
|
Series Issue |
|
Edition |
|
|
|
ISSN |
1434-6044 |
ISBN |
|
Medium |
|
|
|
Area |
|
Expedition |
|
Conference |
|
|
|
Notes |
ISI:000286937900001 |
Approved |
no |
|
|
Is ISI |
yes |
International Collaboration |
yes |
|
|
Call Number |
IFIC @ pastor @ |
Serial |
575 |
|
Permanent link to this record |