AI models are too costly

Do we want to be part of the problem, or part of the solution?

8 Likes

Of course I want to be part of solution. But, it is easier said than done. I quite ignorant about AI and about managing CO2.

Sign up at https://scientistrebellion.org/ … You will find many colleagues to discuss this topic and - perhaps - find a way to act…

We had a lot of nice actions in NL this year, see: Past Actions and Events – Scientist Rebellion Netherlands

And it’s fun!

5 Likes

I hope publishing a link to https://clintel.org and to Critique of the AR6 WG1 Summary for Policymakers (SPM) will not be considered inappropriate here.

I must say I am not a climate scientist, but I am at least physicist and chemist enough to understand how complicated the matter is.

1 Like

I was perplexed to find professor emeritus of geophysics Guus Berkhout, winner of several industry awards, at the head of a climate-skeptic organization. Whatever our impact on the climate, that on biodiversity is undeniable.

1 Like

The UN Secretary General António Guterres said:

“We are miles from the goals of the Paris Agreement – and minutes to midnight for the 1.5-degree limit,” Guterres went on. “But it is not too late.”

There are many small things we can do: For example if we need a new laptop, buy one
that can be easily extended and repaired like the Framework 13: Framework | Framework Marketplace | Framework Laptops

Or join a climate fresk, which is a card game for 6-30 people where you learn all about the reasons and consequences of climate change, see: https://climatefresk.org/

In Delft, NL we are trying to organize a climate fresk for all of our students.

4 Likes

Well, first I’d say “climate-skeptic” (in German they even say “Klimaleugner”, climate denialist) is too much of a shortcut for a somebody skeptical about the aptitude of the current climate models for the medium- to long-term climate forecast.

Second, there are a lot of things, simple and obvious to a layman (Sun movement about the flat Earth e.g. :stuck_out_tongue_winking_eye:), but less so to an expert.

Then, even if our (i.e. humanity) impact on the climate and on the biodiversity is undeniable, there are many open questions. How reliable are the predictions? What kind of impact is still acceptable? What can be done to alleviate it? What is the (environmental, economical, political) price? For example huge areas used for biofuel crops are probably detrimental for biodiversity. The wind wheels, destroying birds and insects en masse, either.

Now to the emeritus point. I am/was taking part in several projects “to save the climate”, mostly on governmental grants, but one from a large governmentally controlled industrial company. Some of them IMO could have a chance for a technically and economically sound use. For some I do not see how the energetic effciency can grow above a fraction of a per cent (there exist alternative well established processes yielding better than at least 10%), however my boss - who is not a physicist - believes there are chances. But with one of the last projects, as he presented it to the group, he started with “please don’t ask me any questions about efficiency!” This is a multi-million project, of which we have but a small part, and the problems must be equally obvious to all other partners, which are mostly competent scientists and engineers.

But what would you do if you are not only want to keep your job, but also responsible for the jobs of a dozen of colleagues, some of them on short-term contracts?! Also, that kind of projects are not only ones in our department, there is also sound (environmentally relevant) science and engineering, so even from the point of “saving the planet” you may want to keep it running. So, take the money and participate.

Being an emeritus professor may be the only realistic chance to be heard (because renowned) while not jeopardizing anybody’s jobs (being emeritus) if you are against the political mainstream.

1 Like

I do hope this potentially explosive thread will be closed soon without removing any posts.

Still, I’d like to note that the organization, advertised by @ufechner7 , is by their own proclamation engaged in activities which are most probably illegal, like stopping a train.

Well, we are involved in Civil disobedience - Wikipedia , yes.

Without civil disobedience we would still have “Racial segregation” in the US…

5 Likes

I’m not entirely against AI, even the costly generative models, if they can find some academic purposes (approach these news with healthy skepticism, it tends to be overhyped through the news cycle). But I wonder how much demand there would be for generative AI if we culturally and legally determine that the generated content and any significantly derivative work cannot be credited to, owned by, or sold by any particular human or organization. Personally I think if it’s obviously wrong for students to generate and edit essays to save time on schoolwork, it’s just as wrong for AI “artists” to occupy the market with products made cheap by never compensating the creators of the training data.

It’s well-substantiated that it still does, it just must be legally indirect.

As someone with training in heat transfer but not in climatology and a general interest in the world around me, I find the global warming topic intriguing. If we take Edgar Andrew’s hypothesis that the God of the Bible has better predictive power than the other models explaining (as opposed to describing it) the beginning and maintenance of the world around us, as I do, then it may be time that we look at what He has to say about this subject. This can be found in Gen 6:5-7, Duet 28:12, and many more.

From what I understand the most significant green house gas is H2O. This is probably somewhere around 95% of the total greenhouse gas effect. However the more water in the atmosphere the more clouds there are which is great to enhance the greenhouse effect, and also great to reflect sunlight. So it seems that these effects dominate the absorption of radiation from the sun and the emission of radiation from the earth to space and tend to cancel each other out. And it is interesting to remember that radiation follows the 4th power to help keep the earth’s temperature stable.

Merry Christmas to all!

This is all very interesting, but what about the topic of the starter post? AI models are too expensive to be practical, yet everyone seems to be eager to jump on the band wagon and cry hurrah. Just in my field (computational mechanics) there are suddenly hundreds of papers. Never mind that the proposed solutions are often ridiculously expensive and do not solve anything. Just mention AI or ML somewhere in the paper, and you will get published. That is a problem, isn’t it?

2 Likes

From the inference point of view, I think Julia’s KernelAbstractions.jl is one of the best things to help this issue. There is a ton of AI chip startups building new AI accelerators. That package can make things easier to integrate new, more efficient, hardware

I think it’s cool it already supports AMD, since NVIDIAs 4000 series are too intense in power usage.

1 Like

Classic issue of journals prioritizing popular topics over less exciting results. Still, it’s worth mentioning that the paper is comparing classes of AI, finding that classification is cheap and that multitask and generative AI is expensive. It is not comparing it to other computationally heavy tasks, like physical simulations or a video game server. That would be important information for forming ethical lines for energy use; an academic project could weigh training 1 multitask model versus multiple single-task models versus untrained algorithms.

I personally am already ready to draw the line with image generation, given how much more expensive inference is and how it tends to be used: selfies and skipping art classes.

How costly is it to query a locally run model? Say, for the sake of example, if I want to build a service that does local chi-chat with a ChatGPT like model, run locally, is it the kind of thing that could host, 1e3, 1e4, 1e5 concurrent convos on mid range consumer grade 2023 hardware?

To answer your original question: Using AI is like taking a plane,
bad for the environment and sometimes unavoidable.

So try to apply similar rules:

  • do it only if it really solves a practical problem of mankind
    that cannot be solved otherwise
  • as a reviewer, always ask the people who write papers using AI
    if they considered the environmental footprint and why they
    think it is justified

What we (in the western world) need is degrowth, less and smaller
cars, less, smaller and and longer living computers etc…
More health and happiness, less usage of resources…

6 Likes

I disagree with this premise, and I strongly disagree with the actions of the organization you provided a link to. I think it’s best to keep this topic at the energy consumption of so-called “AI” and not veer into the political realm.

1 Like

Well, ethics is important in the field of engineering. How do you want to decide the statement of the topic, what is “too costly”? That is an ethical question as long as Universities are concerned.

Luckily in NL attending an ethics course is mandatory for engineering students. See for example: Engineering Ethics - Introduction

3 Likes

IMHO we are deeply in need of rigorous energy / carbon intensity metrics for computational algorithms in general.

Modelling papers should be required to specify computational power required for the analysis. This would be especially important in fields like genomics where the energy use of algorithms is a large fraction of total departmental energy use.

It would also clearly be good for Julia. Ecologists where I work reach for the cluster to run their R scripts when the same code in Julia runs in seconds on a laptop.

9 Likes

You probably mean scenarios, not forecasts. These are two very different things. We can not forecast anything beyond few seasons.