Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing 2021
DOI: 10.18653/v1/2021.sustainlp-1.2
|View full text |Cite
|
Sign up to set email alerts
|

Abstract: Modern Natural Language Processing (NLP) makes intensive use of deep learning methods because of the accuracy they offer for a variety of applications. Due to the significant environmental impact of deep learning, costbenefit analysis including carbon footprint as well as accuracy measures has been suggested to better document the use of NLP methods for research or deployment. In this paper, we review the tools that are available to measure energy use and CO 2 emissions of NLP methods. We describe the scope of… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1

Citation Types

0
16
0

Year Published

2022
2022
2023
2023

Publication Types

Select...
5
1
1

Relationship

0
7

Authors

Journals

citations
Cited by 20 publications
(16 citation statements)
references
References 27 publications
0
16
0
Order By: Relevance
“…Our tool builds upon this work by making carbon tracking on cloud instances possible, enabling a larger portion of ML model training work to profit from fine-grained carbon estimation. However, recent work has found that their results vary significantly and are not fully representative of the true emissions incurred by training [3]. Perhaps most similar to our work, EnergyVis [41] is an interactive tool for visualizing and comparing energy consumption of ML models as a function of hardware and physical location (U.S. state), given metadata about a model's energy use per epoch.…”
Section: Related Workmentioning
confidence: 59%
See 2 more Smart Citations
“…Our tool builds upon this work by making carbon tracking on cloud instances possible, enabling a larger portion of ML model training work to profit from fine-grained carbon estimation. However, recent work has found that their results vary significantly and are not fully representative of the true emissions incurred by training [3]. Perhaps most similar to our work, EnergyVis [41] is an interactive tool for visualizing and comparing energy consumption of ML models as a function of hardware and physical location (U.S. state), given metadata about a model's energy use per epoch.…”
Section: Related Workmentioning
confidence: 59%
“…For a given datacenter, this can be turned into a factor which can be multiplied against the electricity consumption of computing equipment to get an estimate of the total consumption. Some companies have highlighted particularly low PUEs, such as Google claiming a PUE of 1.10 across its fleet of data centers for the 12 months ending in Q1 2021, 3 compared to an average global PUE of 1.59 [2].…”
Section: The Scope Of Our Tool: Gpu Computation Of a Single Cloud Ins...mentioning
confidence: 99%
See 1 more Smart Citation
“…Nuclear power, hydro, and solar power generation sources yield least amount of carbon intensity while the oil, coal, and natural gas result in high-end of carbon intensity. Over the past years, some studies have carried out analysis on the carbon footprint of LLMs [17]- [21]. For instance, Bannour et al [21] performed carbon footprint analysis relative to LLMs using six different tools.…”
Section: A Sustainability For Training Llms Like Chatgptmentioning
confidence: 99%
“…Over the past years, some studies have carried out analysis on the carbon footprint of LLMs [17]- [21]. For instance, Bannour et al [21] performed carbon footprint analysis relative to LLMs using six different tools. One of the tool is publicly available that computes the carbon footprint of LLMs [22].…”
Section: A Sustainability For Training Llms Like Chatgptmentioning
confidence: 99%