Big Data News Hubb
Advertisement
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
Big Data News Hubb
No Result
View All Result
Home Big Data

The Move Toward Green Machine Learning

admin by admin
November 6, 2022
in Big Data


A new study suggests tactics for machine learning engineers to cut their carbon emissions. Led by David Patterson, researchers at Google and UC Berkeley found that AI developers can shrink a model’s carbon footprint a thousand-fold by streamlining architecture, upgrading hardware, and using efficient data centers. 

The authors examined the total energy used and carbon emitted by five NLP models: GPT-3, GShard, Meena, Switch Transformer, and T5. They reported separate figures for training and inference. Generally, they found that inference consumes more energy than training:

  • The authors point to several model-design strategies that trim energy use. Transfer learning, for instance, eliminates the need to train new models from scratch. Shrinking networks through techniques such as pruning and distillation can increase energy efficiency by a factor of 3 to 7. 
  • Hardware makes a difference, too. Chips designed specifically for machine learning are both faster and more efficient than GPUs. For instance, a Google TPU v2 ran a transformer 4.3 times faster and used 1.3 times less energy than an Nvidia P100. 
  • Cloud computing centers with servers optimized for machine learning are twice as efficient as traditional enterprise data centers. Data centers using renewable energy sources are greener, and centers built near their energy source bring further savings, as transmitting energy over long distances is relatively expensive and inefficient. 

The authors joined the Allen Institute and others in calling for greener AI. To this end, MLCommons, the organization behind the MLPerf benchmark, recently introduced new tools to measure a model’s energy consumption alongside traditional performance metrics.

Training and deploying a large model can emit five times more carbon dioxide than a single car over the course of its lifetime. As AI becomes more widespread, energy efficiency becomes ever more important. There are bigger levers for reducing carbon emissions, such as transitioning the world away from coal power. Still, as a leading-edge industry, AI has an important role in building a the green future.

Sign up for the free insideBIGDATA newsletter.

Join us on Twitter: https://twitter.com/InsideBigData1

Join us on LinkedIn: https://www.linkedin.com/company/insidebigdata/

Join us on Facebook: https://www.facebook.com/insideBIGDATANOW





Source link

Previous Post

Your guide to AWS Analytics at re:Invent 2022

Next Post

Do Data Companies Need Chief Ethics Officers?

Next Post

Do Data Companies Need Chief Ethics Officers?

Recommended

insideBIGDATA Latest News – 10/23/2023

October 24, 2023

The Power of Credit Union Consultants and Data-Driven Decision-Making

August 4, 2023

The Relationship Between NFT Gaming and Blockchain

July 13, 2023

Don't miss it

Big Data

Announcing General Availability of Model Registry

November 30, 2023
Big Data

Sophos Anticipates AI-Based Attack Techniques and Prepares Detections

November 30, 2023
Big Data

Automating Governance of PHI Data in Healthcare

November 30, 2023
News

How Eightfold AI implemented metadata security in a multi-tenant data analytics environment with Amazon Redshift

November 30, 2023
News

Altman’s Back As Questions Swirl Around Project Q-Star

November 30, 2023
Big Data

Cloudera’s QATS Certification for Dell PowerScale Unleashes a New Era of Data Management

November 29, 2023
big-data-footer-white

© Big Data News Hubb All rights reserved.

Use of these names, logos, and brands does not imply endorsement unless specified. By using this site, you agree to the Privacy Policy and Terms & Conditions.

Navigate Site

  • Home
  • Big Data
  • News
  • Contact us

Newsletter Sign Up

No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us

© 2022 Big Data News Hubb All rights reserved.