Advances in Grid Computing for the Fabric for Frontier Experiments Project at Fermilab

Herner, K.; F., Alba Hernandez, A.; Bhat, Shreyas; Box, D.; Boyd, J.; Benedetto, V. Di; Ding, P. F.; Dykstra, David; Fattoruso, M.; Garzoglio, Gabriele; Kirby, M.; Kreymer, A.; Levshina, Tanya; Mengel, M.; Mhashilkar, Parag; Podstavkov, V. M.; Retzke, K.; Sharma, N.G.; Teheran, Jeny

doi:10.1088/1742-6596/898/5/052026

Cited by 4 publications

(6 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While POMS development was going on, a monitoring project called Landscape [3] was being developed. As Landscape grew, a duplication of effort developed was identified between Landscape and the monitoring features of POMS.…”

Section: Landscapementioning

confidence: 99%

Production Operations Management System (POMS) for Fermilab Experiments

et al. 2020

View full text Add to dashboard Cite

The Production Operations Management System (POMS) software allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs, and currently manages the majority of production computing of experiments at Fermilab. POMS provides a web service interface that enables automated job submission on distributed resources according to customers’ requests, as well as subsequent monitoring of those submissions as well as recovery of failed submissions, debugging and record keeping. POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub (for job submission), SAM (for data management), and Landscape (for monitoring), and in combination with them handles the creation of intermediate datasets of files for multistage campaigns. POMS visualizes these campaigns with an interactive GUI interface. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign. This paper will discuss the current usage, history, and some technical details of POMS, as well as planned future extensions, particularly interfacing with Rucio as well as SAM for file movement.

show abstract

Section: Landscapementioning

confidence: 99%

Production Operations Management System (POMS) for Fermilab Experiments

et al. 2020

View full text Add to dashboard Cite

show abstract

“…Given the large amount of raw data collected by the experiment, an automated process, known as "data production" [44], which involves data transfer, reconstruction and calibration, is used, as demonstrated in Figure 3.19. Technologies such as dCache and sequential access via metadata (SAM) [45] allow for robust storage and cataloguing of data. The CPU-intensive process of data reconstruction involves the processing of raw data to form physics-level data objects (e.g.…”

Section: Data Reconstructionmentioning

confidence: 99%

Alignment of the straw tracking detectors for the Fermilab Muon $g-2$ experiment and systematic studies for a muon electric dipole moment measurement

Lukicov¹

2020

Preprint

View full text Add to dashboard Cite

The Fermilab Muon g −2 experiment is currently preparing for its fourth datataking period (Run-4). The experiment-wide effort on the analysis of Run-1 data is nearing completion, with the announcement of the first result expected in the coming months. The final goal of the experiment is to determine the muon magnetic anomaly, a µ = g−2 2 , to a precision of 140 ppb. This level of precision will provide indirect evidence of new physics, if the central value agrees with the previously-measured value of a µ . Essential in reducing the systematic uncertainty on a µ , through measurements of the muon beam profile, are the in-vacuum straw tracking detectors. A crucial prerequisite in obtaining accurate distributions of the beam profile is the internal alignment of the tracking detectors, which is described in this thesis. As a result of this position calibration, the tracking efficiency has increased by 3%, while the track quality increased by 4%. This thesis also discusses an additional measurement that will be made using the tracking detectors: a search for an electric dipole moment (EDM) of the muon, through the direct detection of an oscillation in the average vertical angle of the e + from the µ + decay. An observation of a muon EDM would be evidence of new physics and would provide a new source of CP violation in the charged lepton sector. Essential in measuring the EDM, as well as a µ , are accurate and precise estimations of potential non-zero radial and longitudinal magnetic fields, which were estimated using the Run-1 data. In addition, a preliminary analysis using the Run-1 data was undertaken to estimate the available precision for the a µ measurement using the tracking detectors.First and foremost, I would like to express my deepest gratitude to my supervisor, Mark Lancaster, who, through his outstanding leadership, made my PhD journey a truly remarkable experience. Mark, I greatly value all the advice, support, and encouragement that you have given me over the yearsthank you! A special recognition should be given to Rebecca Chislett, Joe Price, and James Mott. I am truly grateful for the help that you have provided in tackling many of the arising challenges in this thesis, and for investing your time in me. Your ability to solve difficult tasks with ease and a friendly approach serves as an inspiration to me.Nicholas Kinnaird and Saskia Charity, I appreciate your time in answering many of my questions on tracking and data analysis, especially when you were busy finishing your own theses. You both have set a tremendous example for me to follow. I would like to thank the members of the g−2 tracker group: Brendan Casey, Tammy Walton, Alessandra Luca, and others, for creating a fantastic environment to collaborate and share ideas. Past and present members of the UCL g − 2 team have also provided ample support and inspiration to

show abstract

“…3. Given a subversion tag for the version of obstac to be used and an assortment of configuration parameters that define not only obstac's tactics but simulation input and survey definition, the obssim collection of scripts generate input files needed for suites of simulations to be submitted to the Open Science Grid (Herner et al, 2016), submit them, monitor their progress, collect the results, and produce summary statistics. These scripts manage the storage and bookkeeping of simulation specifications, metadata, results, and summary statistics.…”

Section: Levels Of Simulation Toolsmentioning

confidence: 99%

Dark Energy Survey’s Observation Strategy, Tactics, and Exposure Scheduler

Neilsen

Annis

Diehl

et al. 2019

View full text Add to dashboard Cite

The Dark Energy Survey is a "stage III" dark energy experiment, performing an optical imaging survey to measure cosmological equation of state parameters using four independent methods. The scope and complexity of the survey, originally scheduled for 525 nights of observing spread over five years and combining a 5000 degree wide survey with a 10 field weekly time-domain survey, introduced complex strategic and tactical scheduling problems that needed to be addressed. We begin with an overview of the process used to develop DES strategy and tactics, from the inception of the project, to task forces that studied and developed strategy changes over the course of the survey, to the nightly pre-observing meeting in which immediate tactical issues were addressed. We then summarize the strategic choices made for each sub-survey, including metrics, scheduling considerations, choice of time domain fields and their sequences of exposures, and wide survey footprint and pointing layout choices. We go on to describe the detailed process that determined which specific exposures were taken at which specific times. We give a chronology of the strategic and tactical peculiarities of each year of observing, including the proposal and execution of a sixth year. We give an overview of obstac, the implementation of the DES scheduler used to simulate and evaluate strategic and tactical options, and automate exposure scheduling; and describe developments in obstac for use after DES. Appendices describe further details of data quality evaluation, τ, and t eff ; airmass calculation; and modeling of the seeing and sky brightness. The significant corpus of DES data indicates that the simple scaling relations for seeing as a function of wavelength and airmass derived from the Kolmogorov turbulence model work adequately for exposure planning purposes: deviations from these relations are modest in comparison with short time-scale seeing variations. 1 arXiv:1912.06254v1 [astro-ph.IM] 12 Dec 2019 2 • The survey data would be collected using a new imaging camera, DECam, on the Victor Blanco 4.0 meter telescope at the Cerro Tololo Inter-American observatory (CTIO) in Chile.• The survey would be completed using 525 nights of observing spread over five years.• The 525 nights would include a mix of dark time (time when the moon is below the horizon) and gray or bright time (time when it is above it).Motivation for these decisions is outside the scope of this document. Interested readers should consult Lahav et al. (2019). The choice of instrument set a variety of constraints on all choices that followed. The location of the telescope at a latitude of −30°set the limits on which declinations are accessible at what airmasses, over what period of time; the field of view, readout and slew times, sensor sensitivity, and aperture of the telescope set the parameters for the trade-off between area, depth, and mean number of exposures per unit area of sky. The equatorial mount of the Blanco telescope and the lack of rotator on the DECam establish a constant ...

show abstract

Advances in Grid Computing for the Fabric for Frontier Experiments Project at Fermilab

Cited by 4 publications

References 6 publications

Production Operations Management System (POMS) for Fermilab Experiments

Production Operations Management System (POMS) for Fermilab Experiments

Alignment of the straw tracking detectors for the Fermilab Muon $g-2$ experiment and systematic studies for a muon electric dipole moment measurement

Dark Energy Survey’s Observation Strategy, Tactics, and Exposure Scheduler

Contact Info

Product

Resources

About