Edit ‘good_ideas’: Synced 1785395423135 by sync

Edit ‘good_ideas’: Synced 1785395423135 (by sync at 30 Jul 26 07:26 UTC)

Hyphae affected: good_ideas

diff --git a/good_ideas.myco b/good_ideas.myco
index 442024d..e2d5d81 100644
--- a/good_ideas.myco
+++ b/good_ideas.myco
@@ -1,126 +1,129 @@
-* Overengineered LLM-based autocomplete to spite "it's just autocomplete" people.
-* Expanded [[vengeance]] policy.
-* {
-Similarly, contrastive RL for computer algebra (specifically, proving that expressions equal other expressions via making substitutions repeatedly). Try and contrastively learn a "how close is this expression to this other one" function (I think with an action input?). Bootstrap to progressively harder problems.
-* What does Gyges mean by "anyone who wants it: you should be able to train contrastive models way faster if you use lsh to determine pairs to contrast"? This might contain alpha.
-* Maybe this should be a "theorem prover" and not an "expression rewriter". I think they're fairly similar anyway.
-* Check sticky note for slightly more detailed sketch.
-* https://osmarks.net/bitalg
-}
-* {
-Startup ideas:
-* Automated reminders to make spontaneous gestures to maintain friendships.
-* {
-Torment nexus (torture simulacra of your enemies for $4.99/month).
-* Self-driving car integration: torture anyone who endangers (basic edition) or inconveniences (pro version) you.
-}
-* Sell CLIP search to companies selling products like furniture and decoration which are somewhat decorative and hard to search for right now.
-* {
-To satisfy the desire of people on the internet to punch people they don't like, mine data to find people's characteristics and simulate fights between them, without the hassle of physically meeting up.
-* What if you could also fight abstract concepts? Most notably, corporations.
-}
-* [[Automated Persuasion Network]]s for Enterprise.
-* W&B but good (visualize run logs from JSONL files).
-* Good vector database (shard correctly (see notes)).
-* Use a LLM agent framework and a man-portable electronic warfare rig to hack nearby speaker systems to provide background music.
-* Financial responsibility via antimemetics.
-* LLM legal DoS.
-* Anki but for people who are stupid and can't use Anki.
-* Automatically apply to waitlists with maximally convincing usecases.
-* Dating app but which scrapes the web to unilaterally find people for you (maybe better incentive alignment).
-* Automated divination (like Threat Updates but more so).
-* Automated scapegoats as diversion, tomfoolery and social manipulation tool.
-* Infinite AI-generated political news feeds calibrated for engagement.
-}
-* {
-Next-action-predictor editors/UI.
-* Possibly just for prefetching/preloading.
-}
-* {
-Do WiFi sensing but good (with more data (https://b.osmarks.net/o/a0bddc9b742b4efbba18600ae6d51d98)).
-* {
-Weak evidence from internal testing suggests that models can't easily "ICL" locations. We may need really long contexts or big finetunes or some smarter meta-learning algorithm.
-* (multi-TX single-RX data with ESP32-C3 receiver, slightly nonuniform times; would need to run more tests)
-}
-}
-* {
-Comparisons rather than scalar ratings for things (https://b.osmarks.net/o/60b26f1735134d628164217be52ca2d3).
-* {
-It shouldn't be that hard to aggregate all the things I describe positively or negatively on my website and build a thing to allow me to rate pairs.
-* Code written but annoying to rate. Might outsource to Autogollark.
-}
-* Notably, movies (scrape).
-}
-* Constrained "LLM agent" (how I dislike this terminology) which chooses things to buy for you (https://thezvi.substack.com/p/choices-are-bad etc).
-* {
-Some people dislike modern furniture because older pieces had lots of hand-carved detail, whereas mass-produced pieces tend to use simpler minimalist geometry. But AI art tools and (more importantly) CNC machines mean it should be fairly cheap (if logistically hard) to carve custom decoration into furniture. Someone will probably pay for this.
-* {
-https://worksinprogress.co/issue/the-beauty-of-concrete/
-* Apparently the reason for the reduction, at least for buildings, is not supply-side, so technological advancements would not help with that much.
-* But many people still like and can't easily get (I think) ornamental furniture, so.
-}
-}
-* AutoGaryMarcus.
-* Automate those one-way/recorded video interviews using an LLM, TTS and deepfake system.
-* Hex-grid particle simulator (similar to the Powder Toy) with GPU acceleration or HashLife algorithm.
-* Fix https://arxiv.org/abs/2411.00566 with less deranged ML.
-* {
-Diffusion model for Minecraft worlds.
-* Scrape the internet for worlds, extract "interesting" regions.
-* How to deal with the large volume of data in a world? 16³ is big. Probably more compressible than 2D though. Apply HDiT (?).
-}
-* Autonomous, rogue [[Autogollark]].
-* Make a high-performance physically plausible space combat simulator and do RL to spite Devon Eriksen.
-* Simulate self-consistent time travel in games by having absurdly superhuman AI player enforce consistency using "random" degrees of freedom.
-* Nonstandard/intense experiences probably increase memory formation/recollection later. As such, coding bootcamps but they are actual bootcamps. This has the additional advantage of maybe getting more hard work out of people.
-* {
-Psychological studies using LLMs (https://arxiv.org/abs/2209.06899 addresses this) seem underexploited. Could factor-analyze political beliefs and such.
-* https://arxiv.org/abs/2410.20268
-* TODO find the paper which actually did factor-analyze political beliefs (while doing something else)
-}
-* Hexbugs with inductive charging, onboard microcontroller.
-* "you can go hunting for wallets that are big, cold for a long time, and likely made with hardware that now has known vulns in its rng"
-* {
-https://arxiv.org/abs/2405.16158 improves (model-free?) RL through using techniques applied to SSL to make scaling work better. Does it work on MCTS-based things?
-* The model architectures in the Go MCTS papers look like they used arbitrary round numbers, actually. Did //anyone// do scaling laws sweeps?
-}
-* 6D Tic-Tac-Toe With Multiversal Time Travel (5DCWMTT does not actually have five dimensions!).
-* {
-National Rail frontend but actually useable and complete.
-* Plot Pareto frontier of journey time/cost for two endpoints.
-* Estimate delay likelihood based on historical data regressions and (on the day) signalling state.
-}
-* Sisyphus clicker game.
-* Esolang which compiles to video codecs (https://wrv.github.io/h26forge.pdf).
-* {
-Semantic search for:
-* offloading pop culture references
-* terrain (satellite maps)
-}
-* Automate Lego with pick-and-place machine.
-* Improve AI-based search with methods other than making boring contrastive embedding models very slightly better.
-* {
-Graph-based vector indices do beam search on a graph constructed so that beam search on dot product or PQ dot product "mostly" returns the closest (highest-dot-product) result. Do one of several RL/etc pathfinding schemes instead (like https://arxiv.org/abs/2502.18663)? We only have a budget of 100μs per read node, though, so this is a bit tricky.
-* We can also pack the graphs better (with some cost at retrieval time due to multi-page accesses and more compute): sorting and delta compression of node indices, offload metadata again, maybe general-purpose compressors, maybe QAT/IAA codecs, quantize the graph vectors a bit.
-* 100μs/node is assuming SSD random latency, and with that assumption these algorithms still aren't useful if we can throw more time at it because we can do more reads. But with really clever pathfinding, HDDs could also work. Maybe? Two orders of magnitude slower, though.
-* https://arxiv.org/pdf/2501.10479 https://arxiv.org/pdf/2504.19874
-* Also see the Jina spherical compression thing.
-}
-* SAEs/dictionary learning algorithms for residual quantization. Possibly this doesn't make sense somehow.
-* {Minecraft/Factorio crossover modpack via Clusterio-like thing.
-* Imagine GT:NH/Pyanodon.
-}
-* {With modern sensor technology, why can I not buy a toaster even smarter than the Sunbeam Radiant Control Toaster?
-* Some toasters exist with "smart" screens and such but they're still open-loop.
-* https://www.breville.com/en-au/landing/eyeq-toasters but only in Australia?! Also, it still only has legacy toaster actuators. There should be multiple heating elements for precise control. Steerable microwaves (but apparently toast shouldn't be made that way as you want the outside to be crunchier than the inside)? IR and DMDs (probably not, this would overheat immediately)? Just a small grid of heaters (power electronics, but not that bad)?
-}
-* Procedural sky background generator (//lots// of galaxies, as from survey telescopes)
-* "Credit Card Portfolio Dungeon" (as in churning).
-* Cookie Clicker, but with victories rather than cookies.
-* "idea: autonomous, agentic emails that hunt you down and destroy you" (https://x.com/0x49fa98/status/1993690386531860574)
-* Neural net graph prettiness heuristic rather than force-based.
-* CA embedding models (like maths thing, transition rule proximity).
-* Compare book new and used prices to estimate how frequently people discard particular books (I guess other factors).
-* Automate something like https://norvidstudies.substack.com/p/juxtapose: generate semantically distinct but similar-looking things (using Nooscope index?).
-* Cryptographic Rock-Paper-Scissors is good, but can a version be developed which doesn't require either party to actually reveal their throw? Secure multiparty computation. Requires more parties and/or more options or it is nonsensical.
+* Overengineered LLM-based autocomplete to spite "it's just autocomplete" people.
+* Expanded [[vengeance]] policy.
+* {
+Similarly, contrastive RL for computer algebra (specifically, proving that expressions equal other expressions via making substitutions repeatedly). Try and contrastively learn a "how close is this expression to this other one" function (I think with an action input?). Bootstrap to progressively harder problems.
+* What does Gyges mean by "anyone who wants it: you should be able to train contrastive models way faster if you use lsh to determine pairs to contrast"? This might contain alpha.
+* Maybe this should be a "theorem prover" and not an "expression rewriter". I think they're fairly similar anyway.
+* Check sticky note for slightly more detailed sketch.
+* https://osmarks.net/bitalg
+}
+* {
+Startup ideas:
+* Automated reminders to make spontaneous gestures to maintain friendships.
+* {
+Torment nexus (torture simulacra of your enemies for $4.99/month).
+* Self-driving car integration: torture anyone who endangers (basic edition) or inconveniences (pro version) you.
+}
+* Sell CLIP search to companies selling products like furniture and decoration which are somewhat decorative and hard to search for right now.
+* {
+To satisfy the desire of people on the internet to punch people they don't like, mine data to find people's characteristics and simulate fights between them, without the hassle of physically meeting up.
+* What if you could also fight abstract concepts? Most notably, corporations.
+}
+* [[Automated Persuasion Network]]s for Enterprise.
+* W&B but good (visualize run logs from JSONL files).
+* Good vector database (shard correctly (see notes)).
+* Use a LLM agent framework and a man-portable electronic warfare rig to hack nearby speaker systems to provide background music.
+* Financial responsibility via antimemetics.
+* LLM legal DoS.
+* Anki but for people who are stupid and can't use Anki.
+* Automatically apply to waitlists with maximally convincing usecases.
+* Dating app but which scrapes the web to unilaterally find people for you (maybe better incentive alignment).
+* Automated divination (like Threat Updates but more so).
+* Automated scapegoats as diversion, tomfoolery and social manipulation tool.
+* Infinite AI-generated political news feeds calibrated for engagement.
+}
+* {
+Next-action-predictor editors/UI.
+* Possibly just for prefetching/preloading.
+}
+* {
+Do WiFi sensing but good (with more data (https://b.osmarks.net/o/a0bddc9b742b4efbba18600ae6d51d98)).
+* {
+Weak evidence from internal testing suggests that models can't easily "ICL" locations. We may need really long contexts or big finetunes or some smarter meta-learning algorithm.
+* (multi-TX single-RX data with ESP32-C3 receiver, slightly nonuniform times; would need to run more tests)
+}
+}
+* {
+Comparisons rather than scalar ratings for things (https://b.osmarks.net/o/60b26f1735134d628164217be52ca2d3).
+* {
+It shouldn't be that hard to aggregate all the things I describe positively or negatively on my website and build a thing to allow me to rate pairs.
+* Code written but annoying to rate. Might outsource to Autogollark.
+}
+}
+* Constrained "LLM agent" (how I dislike this terminology) which chooses things to buy for you (https://thezvi.substack.com/p/choices-are-bad etc).
+* {
+Some people dislike modern furniture because older pieces had lots of hand-carved detail, whereas mass-produced pieces tend to use simpler minimalist geometry. But AI art tools and (more importantly) CNC machines mean it should be fairly cheap (if logistically hard) to carve custom decoration into furniture. Someone will probably pay for this.
+* {
+https://worksinprogress.co/issue/the-beauty-of-concrete/
+* Apparently the reason for the reduction, at least for buildings, is not supply-side, so technological advancements would not help with that much.
+* But many people still like and can't easily get (I think) ornamental furniture, so.
+}
+}
+* AutoGaryMarcus.
+* Automate those one-way/recorded video interviews using an LLM, TTS and deepfake system.
+* Hex-grid particle simulator (similar to the Powder Toy) with GPU acceleration or HashLife algorithm.
+* Fix https://arxiv.org/abs/2411.00566 with less deranged ML.
+* {
+Diffusion model for Minecraft worlds.
+* Scrape the internet for worlds, extract "interesting" regions.
+* How to deal with the large volume of data in a world? 16³ is big. Probably more compressible than 2D though. Apply HDiT (?).
+}
+* Autonomous, rogue [[Autogollark]].
+* Make a high-performance physically plausible space combat simulator and do RL to spite Devon Eriksen.
+* Simulate self-consistent time travel in games by having absurdly superhuman AI player enforce consistency using "random" degrees of freedom.
+* Nonstandard/intense experiences probably increase memory formation/recollection later. As such, coding bootcamps but they are actual bootcamps. This has the additional advantage of maybe getting more hard work out of people.
+* {
+Psychological studies using LLMs (https://arxiv.org/abs/2209.06899 addresses this) seem underexploited. Could factor-analyze political beliefs and such.
+* https://arxiv.org/abs/2410.20268
+* TODO find the paper which actually did factor-analyze political beliefs (while doing something else)
+}
+* Hexbugs with inductive charging, onboard microcontroller.
+* "you can go hunting for wallets that are big, cold for a long time, and likely made with hardware that now has known vulns in its rng"
+* {
+https://arxiv.org/abs/2405.16158 improves (model-free?) RL through using techniques applied to SSL to make scaling work better. Does it work on MCTS-based things?
+* The model architectures in the Go MCTS papers look like they used arbitrary round numbers, actually. Did //anyone// do scaling laws sweeps?
+}
+* 6D Tic-Tac-Toe With Multiversal Time Travel (5DCWMTT does not actually have five dimensions!).
+* {
+National Rail frontend but actually useable and complete.
+* Plot Pareto frontier of journey time/cost for two endpoints.
+* Estimate delay likelihood based on historical data regressions and (on the day) signalling state.
+}
+* Sisyphus clicker game.
+* Esolang which compiles to video codecs (https://wrv.github.io/h26forge.pdf).
+* {
+Semantic search for:
+* offloading pop culture references
+* terrain (satellite maps)
+}
+* Automate Lego with pick-and-place machine.
+* Improve AI-based search with methods other than making boring contrastive embedding models very slightly better.
+* {
+Graph-based vector indices do beam search on a graph constructed so that beam search on dot product or PQ dot product "mostly" returns the closest (highest-dot-product) result. Do one of several RL/etc pathfinding schemes instead (like https://arxiv.org/abs/2502.18663)? We only have a budget of 100μs per read node, though, so this is a bit tricky.
+* We can also pack the graphs better (with some cost at retrieval time due to multi-page accesses and more compute): sorting and delta compression of node indices, offload metadata again, maybe general-purpose compressors, maybe QAT/IAA codecs, quantize the graph vectors a bit.
+* 100μs/node is assuming SSD random latency, and with that assumption these algorithms still aren't useful if we can throw more time at it because we can do more reads. But with really clever pathfinding, HDDs could also work. Maybe? Two orders of magnitude slower, though.
+* https://arxiv.org/pdf/2501.10479
+* Also see the Jina spherical compression thing.
+}
+* {
+SAEs/dictionary learning algorithms for residual quantization.
+* Possibly this doesn't make sense somehow.
+}
+* {
+Minecraft/Factorio crossover modpack via Clusterio-like thing.
+* Imagine GT:NH/Pyanodon.
+}
+* {
+With modern sensor technology, why can I not buy a toaster even smarter than the Sunbeam Radiant Control Toaster?
+* Some toasters exist with "smart" screens and such but they're still open-loop.
+* https://www.breville.com/en-au/landing/eyeq-toasters but only in Australia?! Also, it still only has legacy toaster actuators. There should be multiple heating elements for precise control. Steerable microwaves (but apparently toast shouldn't be made that way as you want the outside to be crunchier than the inside)? IR and DMDs (probably not, this would overheat immediately)? Just a small grid of heaters (power electronics, but not that bad)?
+}
+* Procedural sky background generator (//lots// of galaxies, as from survey telescopes)
+* "Credit Card Portfolio Dungeon" (as in churning).
+* Cookie Clicker, but with victories rather than cookies.
+* "idea: autonomous, agentic emails that hunt you down and destroy you" (https://x.com/0x49fa98/status/1993690386531860574)
+* Neural net graph prettiness heuristic rather than force-based.
+* CA embedding models (like maths thing, transition rule proximity).
+* Automate something like https://norvidstudies.substack.com/p/juxtapose: generate semantically distinct but similar-looking things (using Nooscope index?).
+* Cryptographic Rock-Paper-Scissors is good, but can a version be developed which doesn't require either party to actually reveal their throw? Secure multiparty computation. Requires more parties and/or more options or it is nonsensical.
* Modernized, better [[https://www.sciencemuseumgroup.org.uk/learning/resources/launchball-game|Launchball]].