This blog post was thought-provoking: https://www.orcasciences.com/articles/the-future-is-made-of-energy It centers around "dematerialization": Materials with better performance tend to require more energy to make but allow us to use less raw material to make superior products, creating a trend where products become less "matter-intensive" and more energy-intensive. "In the 1960s Coke came in glass bottles. Fragile melted sand. Today Coke comes in aluminum cans – a material that takes tremendously more energy to produce, but ends up being cleaner and cheaper and 40x lighter than glass holding the same amount of liquid. The same transformation has happened in almost every corner of our material lives." Looking at the most important modern materials we use (e.g. steel) from this perspective, and trying to extrapolate from there takes you interesting places.
- 2 replies
- 2 recasts
- 4 reactions
This video nicely illustrates why prepping relevant context for LLMs - rather than indiscriminately dumping a ton of text into the context - is important for LLM-based applications, even beyond optimizing cost and response times. This is because performance degrades more with increasing input length than a lot of devs might expect. This is still true for models that are touted to support a 1 million or even 10 million context window, with great results on needle-in-the-haystack benchmarks. https://youtu.be/TUjQuC4ugak
- 1 reply
- 1 recast
- 6 reactions
Coal is way more problematic from a deaths / TWh perspective that most people would expect. Our World in Data has a great breakdown if this here: https://ourworldindata.org/safest-sources-of-energy “these estimates for fossil fuels are likely to be very conservative. They are based on power plants in Europe, which have good pollution controls and are based on older models of the health impacts of air pollution. As I discuss in more detail at the end of this article, global death rates from fossil fuels based on the most recent research on air pollution are likely to be even higher.” https://farcaster.xyz/kaufman/0x2368a378
- 0 replies
- 0 recasts
- 4 reactions