Links for 2024-12-25
AI:
1. What are the strongest arguments for very short timelines? https://www.lesswrong.com/posts/oC4wv4nTrs2yrP5hz/what-are-the-strongest-arguments-for-very-short-timelines
2. Why do pre-o3 LLMs struggle with generalization tasks like ARC Prize? It's not what you might think. https://anokas.substack.com/p/llms-struggle-with-perception-not-reasoning-arcagi
3. Deliberation in Latent Space via Differentiable Cache Augmentation https://arxiv.org/abs/2412.17747
4. Meta presents Improving Factuality with Explicit Working Memory https://arxiv.org/abs/2412.18069
5. DRT-o1: Optimized Deep Reasoning Translation via Long Chain-of-Thought https://arxiv.org/abs/2412.17498
6. Training Large Language Models to Reason in a Continuous Latent Space https://arxiv.org/abs/2412.06769
7. LLM-driven genetic programming has turned out to be way more powerful than anybody expected. https://params.com/@jeremy-berman/arc-agi
8. Formal Mathematical Reasoning: A New Frontier in AI https://arxiv.org/abs/2412.16075
9. Automating the Search for Artificial Life with Foundation Models https://pub.sakana.ai/asal/
10. Recurrent Drafter for Fast Speculative Decoding in Large Language Models https://arxiv.org/abs/2403.09919
11. "Maximum diffusion reinforcement learning", Berrueta et al 2023 https://arxiv.org/abs/2309.15293
12. Generative AI for Economic Research: LLMs Learn to Collaborate and Reason https://genaiforecon.substack.com/p/llms-learn-to-collaborate-and-reason
13. QVQ: Inference-time scaling for visual multimodal tasks. https://qwenlm.github.io/blog/qvq-72b-preview/
14. OpenAI's Sébastien Bubeck says that an AI model will "for sure" win a gold medal at the International Mathematical Olympiad next year https://www.youtube.com/live/H3TnTxVKIOQ?si=aYTMYTAmOEcJZFG1&t=667
15. Sam Altman: AI in April 2023 was primitive compared to what we have now and in another 18 months the gap between now and then will be even bigger and the rate of adoption and integration into society is unprecedented. https://youtu.be/DfOt_cqXCFI?si=HLqlSCtvMAieNbYB&t=434
Compute:
1. While Meta and Amazon are building multi-gigawatt data centers, Microsoft are spending billions on fiber to connect all their data centers into one high-bandwidth mega-cluster https://www.youtube.com/watch?v=QVcSBHhcFbg
2. “Colossus was fully operational in 122 days and started running workloads just 19 days after the first servers were delivered. Soon, xAI will double to 200K NVIDIA Hopper GPUs with NVIDIA Spectrum-X Ethernet networking.” https://x.ai/blog/series-c
3. Scott Aaronson explains how computation using closed timelike curves would be able to solve even NP-complete problems easily https://www.youtube.com/watch?v=A6iDHLMRvwg
Cosmology:
1. A revolution in cosmology? Supernovae evidence for foundational change to cosmological models? Dark energy 'doesn't exist' so can't be pushing 'lumpy' universe apart, physicists say. It seems the key innovation is to make time pass at varying speeds in different parts of the galaxy? https://phys.org/news/2024-12-dark-energy-doesnt-lumpy-universe.html
2. From time to timescape - Einstein's unfinished revolution https://arxiv.org/abs/0912.4563
3. Conformally Friedmann-Lemaitre-Robertson-Walker cosmologies https://arxiv.org/abs/1502.02758
Technology:
1. A light-driven hybrid nanoreactor that merges natural efficiency with cutting-edge synthetic precision to produce hydrogen https://news.liverpool.ac.uk/2024/12/17/significant-advancement-made-in-engineering-biology-and-clean-energy/
2. A solid-state DNA origami register that facilitates faster execution of molecular algorithms. https://pubs.acs.org/doi/full/10.1021/acscentsci.4c01557
Miscellaneous:
1. The next massive volcanic eruption is coming. It will cause chaos the world is not prepared for https://edition.cnn.com/2024/12/24/climate/massive-volcano-eruption-climate/index.html
2. Vegans need to eat just enough Meat https://www.lesswrong.com/posts/H27mzmW6G5ywyrJBn/vegans-need-to-eat-just-enough-meat-emperically-evaluate-the
AI:
1. What are the strongest arguments for very short timelines? https://www.lesswrong.com/posts/oC4wv4nTrs2yrP5hz/what-are-the-strongest-arguments-for-very-short-timelines
2. Why do pre-o3 LLMs struggle with generalization tasks like ARC Prize? It's not what you might think. https://anokas.substack.com/p/llms-struggle-with-perception-not-reasoning-arcagi
3. Deliberation in Latent Space via Differentiable Cache Augmentation https://arxiv.org/abs/2412.17747
4. Meta presents Improving Factuality with Explicit Working Memory https://arxiv.org/abs/2412.18069
5. DRT-o1: Optimized Deep Reasoning Translation via Long Chain-of-Thought https://arxiv.org/abs/2412.17498
6. Training Large Language Models to Reason in a Continuous Latent Space https://arxiv.org/abs/2412.06769
7. LLM-driven genetic programming has turned out to be way more powerful than anybody expected. https://params.com/@jeremy-berman/arc-agi
8. Formal Mathematical Reasoning: A New Frontier in AI https://arxiv.org/abs/2412.16075
9. Automating the Search for Artificial Life with Foundation Models https://pub.sakana.ai/asal/
10. Recurrent Drafter for Fast Speculative Decoding in Large Language Models https://arxiv.org/abs/2403.09919
11. "Maximum diffusion reinforcement learning", Berrueta et al 2023 https://arxiv.org/abs/2309.15293
12. Generative AI for Economic Research: LLMs Learn to Collaborate and Reason https://genaiforecon.substack.com/p/llms-learn-to-collaborate-and-reason
13. QVQ: Inference-time scaling for visual multimodal tasks. https://qwenlm.github.io/blog/qvq-72b-preview/
14. OpenAI's Sébastien Bubeck says that an AI model will "for sure" win a gold medal at the International Mathematical Olympiad next year https://www.youtube.com/live/H3TnTxVKIOQ?si=aYTMYTAmOEcJZFG1&t=667
15. Sam Altman: AI in April 2023 was primitive compared to what we have now and in another 18 months the gap between now and then will be even bigger and the rate of adoption and integration into society is unprecedented. https://youtu.be/DfOt_cqXCFI?si=HLqlSCtvMAieNbYB&t=434
Compute:
1. While Meta and Amazon are building multi-gigawatt data centers, Microsoft are spending billions on fiber to connect all their data centers into one high-bandwidth mega-cluster https://www.youtube.com/watch?v=QVcSBHhcFbg
2. “Colossus was fully operational in 122 days and started running workloads just 19 days after the first servers were delivered. Soon, xAI will double to 200K NVIDIA Hopper GPUs with NVIDIA Spectrum-X Ethernet networking.” https://x.ai/blog/series-c
3. Scott Aaronson explains how computation using closed timelike curves would be able to solve even NP-complete problems easily https://www.youtube.com/watch?v=A6iDHLMRvwg
Cosmology:
1. A revolution in cosmology? Supernovae evidence for foundational change to cosmological models? Dark energy 'doesn't exist' so can't be pushing 'lumpy' universe apart, physicists say. It seems the key innovation is to make time pass at varying speeds in different parts of the galaxy? https://phys.org/news/2024-12-dark-energy-doesnt-lumpy-universe.html
2. From time to timescape - Einstein's unfinished revolution https://arxiv.org/abs/0912.4563
3. Conformally Friedmann-Lemaitre-Robertson-Walker cosmologies https://arxiv.org/abs/1502.02758
Technology:
1. A light-driven hybrid nanoreactor that merges natural efficiency with cutting-edge synthetic precision to produce hydrogen https://news.liverpool.ac.uk/2024/12/17/significant-advancement-made-in-engineering-biology-and-clean-energy/
2. A solid-state DNA origami register that facilitates faster execution of molecular algorithms. https://pubs.acs.org/doi/full/10.1021/acscentsci.4c01557
Miscellaneous:
1. The next massive volcanic eruption is coming. It will cause chaos the world is not prepared for https://edition.cnn.com/2024/12/24/climate/massive-volcano-eruption-climate/index.html
2. Vegans need to eat just enough Meat https://www.lesswrong.com/posts/H27mzmW6G5ywyrJBn/vegans-need-to-eat-just-enough-meat-emperically-evaluate-the