Converging HPC, Big Data and Cloud Technologies for Precision Agriculture Data Analytics on Supercomputers

Georgiou, Yiannis; Zhou, Naweiluo; Zhong, Li; Hoppe, Dennis; Pospieszny, Marcin; Παπαδοπούλου, Νικέλα; Nikas, Konstantinos; Nikolos, Orestis Lagkas; Kranas, Pavlos; Καραγιώργου, Σοφία; Pascolo, Eric; Mercier, Michael; Velho, Pedro Isaacsson

doi:10.1007/978-3-030-59851-8_25

Cited by 7 publications

(5 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Combining these digital technologies allows greater volumes of already-collected data to be used in ways that could not have been foreseen only a few years ago but that have a great impact on the environment. This is exactly what is happening in the agricultural sector, for example, especially in the context of precision agriculture and livestock farming applications [23]. Secondly, ethical and social preoccupations have to respect the malleability of digital technologies [24,25].…”

Section: Framework and Hypothesismentioning

confidence: 99%

Corporate Digital Responsibility: A Board of Directors May Encourage the Environmentally Responsible Use of Digital Technology and Data: Empirical Evidence from Italian Publicly Listed Companies

Napoli¹

2023

Sustainability

View full text Add to dashboard Cite

This paper presents a framework for our hypotheses that the independence of a board of directors and the use of digital technology might influence the way a corporation performs environmentally. For empirical verification of our thesis, we take a sample of 53 publicly listed Italian companies and look at data on their board composition, greenhouse gas emissions, and expenditures for the use of digital technologies of Enterprise Resource Planning (ERP) over a period of five years. What emerges from the test partially supports our predictions. In particular, we find that a higher level of board independence is associated with better environmental performance. There is no direct, statistically significant association between the use of digital technologies and environmental performance, so a greater use of digital technologies is not, in itself, sufficient to improve the environmental performance of a firm. However, our empirical analyses find that environmental performance is positively influenced by the use of digital technologies in firms that include a proportionately high number of independent directors on their boards. This research improves our understanding of antecedents of Corporate Digital Responsibility (CDR), showing how the share of independent directors on a board has a positive impact on CDR, understood here as the set of practices and behaviours that help an organisation use data and digital technologies in ways that are environmentally responsible.

show abstract

Section: Framework and Hypothesismentioning

confidence: 99%

Corporate Digital Responsibility: A Board of Directors May Encourage the Environmentally Responsible Use of Digital Technology and Data: Empirical Evidence from Italian Publicly Listed Companies

Napoli¹

2023

Sustainability

View full text Add to dashboard Cite

show abstract

“…However, TCEF was important for assessing the time required for large programs used by MPCs. The TCEF for the MTN was evaluated according to the final simplification using Equation (5), where p = total nodes:…”

Section: Time-cost-effective Factormentioning

confidence: 99%

“…Agricultural water management (AWM) was able to integrate multidisciplinary models that used MPCs [4]. Workflows for agricultural and livestock-farming applications have been designed through hybrid data analytics [5]. Enormous computational power is required to implement deep-learning networks for the price forecasting of agricultural products, which has a significant impact on the profitability of agricultural products [6].…”

Section: Introductionmentioning

confidence: 99%

Static Evaluation of a Midimew Connected Torus Network for Next Generation Supercomputers

2023

View full text Add to dashboard Cite

Many artificially intelligent systems solve complex health- and agriculture-related problems that require great computational power. Such systems are used for tracking medical records, genome sequence analysis, image-based plant disease detection, food supply chain traceability, and photosynthesis simulation. Massively parallel computers (MPCs) are among those used to solve these computation-intensive problems. MPCs comprise a million nodes; connecting such a large number of nodes is a daunting task. Therefore, hierarchical interconnection networks (HINs) have been introduced to solve this problem. A midimew-connected torus network (MTN) is a HIN that has basic modules (BM) as torus networks that are connected hierarchically by midimew links. This paper presents the performance of MTNs in terms of static topological parameters and cost-effectiveness, as measured through simulations. An MTN was compared with other networks, including mesh, torus, TESH, TTN, MMN, and TFBN. The results showed that our MTN had a low diameter with a high bisection width and arc connectivity. In addition, our MTN had a high cost–performance trade-off factor (CPTF), a high cost-effective factor (CEF), low packing density, and moderate message-traffic density with marginally higher costs, as compared to other networks, due to wire complexity. However, our MTN provided better bandwidth with higher static fault tolerance. Therefore, MTNs are suggested for further evaluation of the effective implementation of MPCs.

show abstract

“…This approach represents a direct integration of Cloud and HPC environments and is in contrast to our black box approach to deploying jobs on an external system. Georgiou et al [12] focused on hybrid data analytics workflows in the context of precision agriculture and livestock farming applications and implemented a prototype architecture which integrates with Kubernetes with a HPC partition of baremetal nodes managed by Slurm or Torque. Recently the DOE's Oak Ridge Leadership Computing Facilities (OLCF) extended the Pegasus workflow management system with Workflow Submit Node as a service (WSaaS).…”

Section: Related Workmentioning

confidence: 99%

A Kubernetes ‘Bridge’ operator between cloud and external resources.

Lublinsky¹,

Jennings

Spišaková

2022

Preprint

View full text Add to dashboard Cite

Many scientific workflows require dedicated compute resources, including HPC clusters with optimized software, quantum resources, and dedicated hardware cluster systems like Ray, for example. At the same time, many scientific workflows today are built on Kubernetes leveraging growing support for workflow and support tools. To address the growing demand to support workflows on both cloud and dedicated compute resources we present the Bridge Operator, a software extension for container orchestration in Kubernetes which facilitates the submission and monitoring of long running processes on external systems which have their own cluster resources manager (SLURM, LSF, quantum services and Ray). The Bridge Operator consists of a custom Kubernetes controller that employs a Kubernetes Custom Resource Definition to manage applications. We present controller logic to manage the cloud container orchestration and external resource workload manager interface, a resource definition to submit HTTP/HTTPS requests to the external resource, and a controller pod communicating with the external resource manager to submit and manage job execution. The implementation allows us to mirror the external resource in Kubernetes pods, which allows the operator to use these pods as proxies to control the external system. The implementation is agnostic to the choice of resource manager but assumes the system exposes a HTTP/HTTPS API for its control/management. The Bridge Operator automates the role of a human operator running jobs on a black box external resource as part of a complex hybrid workflow on the Cloud.

show abstract

Converging HPC, Big Data and Cloud Technologies for Precision Agriculture Data Analytics on Supercomputers

Cited by 7 publications

References 9 publications

Corporate Digital Responsibility: A Board of Directors May Encourage the Environmentally Responsible Use of Digital Technology and Data: Empirical Evidence from Italian Publicly Listed Companies

Corporate Digital Responsibility: A Board of Directors May Encourage the Environmentally Responsible Use of Digital Technology and Data: Empirical Evidence from Italian Publicly Listed Companies

Static Evaluation of a Midimew Connected Torus Network for Next Generation Supercomputers

A Kubernetes ‘Bridge’ operator between cloud and external resources.

Contact Info

Product

Resources

About