Fwiw a LLM uses as much power as 10 regular Google searches… So it’s almost nothing in the grand scope of things. It might even save some for the people who don’t know how to utilize search engines properly.
We also need more data centers, not fewer. And they use almost no water compared to other utilities.
I’m not sure that’s even a valid comparison? I’d love to know where you got that data point.
LLMs run until they decide to output an end-of-text token. So the amount of power used will vary massively depending on the prompt.
Search results on the other hand run nearly instantaneously, and can cache huge amounts of data between requests, unlike LLMs where they need to run every request individually.
I’d estimate responding to a typical ChatGPT query uses at least 100x the power of a single Google search, based on my knowledge of databases and running LLMs at home.
Fwiw a LLM uses as much power as 10 regular Google searches… So it’s almost nothing in the grand scope of things. It might even save some for the people who don’t know how to utilize search engines properly.
We also need more data centers, not fewer. And they use almost no water compared to other utilities.
I’m not sure that’s even a valid comparison? I’d love to know where you got that data point.
LLMs run until they decide to output an end-of-text token. So the amount of power used will vary massively depending on the prompt.
Search results on the other hand run nearly instantaneously, and can cache huge amounts of data between requests, unlike LLMs where they need to run every request individually.
I’d estimate responding to a typical ChatGPT query uses at least 100x the power of a single Google search, based on my knowledge of databases and running LLMs at home.