G™Good Ideas

  • Actually run https://github.com/osmarks/meme-search-engine/blob/master/src/reddit_dump.rs at full scale.

    • Pending.

  • Meme sparse autoencoding (I think a CLIP SAE already exists though).

    • Done. Mine is better.

  • Overengineered LLM-based autocomplete to spite "it's just autocomplete" people.

  • Expanded vengeance policy.

  • Combine new CRL (https://arxiv.org/abs/2408.05804) with offline pretraining. Might be redundant in some sense.

  • Similarly, contrastive RL for computer algebra (specifically, proving that expressions equal other expressions via making substitutions repeatedly). Try and contrastively learn a "how close is this expression to this other one" function (I think with an action input?). Bootstrap to progressively harder problems.

    • What does Gyges mean by "anyone who wants it: you should be able to train contrastive models way faster if you use lsh to determine pairs to contrast"? This might contain alpha.

    • Maybe this should be a "theorem prover" and not an "expression rewriter". I think they're fairly similar anyway.

  • Startup ideas:

    • Automated reminders to make spontaneous gestures to maintain friendships.

    • Torment nexus (torture simulacra of your enemies for $4.99/month).

    • Sell CLIP search to companies selling products like furniture and decoration which are somewhat decorative and hard to search for right now.

    • To satisfy the desire of people on the internet to punch people they don't like, mine data to find people's characteristics and simulate fights between them, without the hassle of physically meeting up.

      • What if you could also fight abstract concepts? Most notably, corporations.

    • Automated Persuasion Networks for Enterprise.

    • W&B but good (visualize run logs from JSONL files).

    • Good vector database (shard correctly (see notes)).

    • Use a LLM agent framework and a man-portable electronic warfare rig to hack nearby speaker systems to provide background music.

    • Financial responsibility via antimemetics.

    • LLM legal DoS.

    • Anki but for people who are stupid and can't use Anki.

    • Automatically apply to waitlists with maximally convincing usecases.

    • Dating app but which scrapes the web to unilaterally find people for you (maybe better incentive alignment).

    • Automated divination (like Threat Updates but more so).

  • Next-action-predictor editors/UI.

    • Possibly just for prefetching/preloading.

  • Do WiFi sensing but good (with more data (https://b.osmarks.net/o/a0bddc9b742b4efbba18600ae6d51d98)).

  • Comparisons rather than scalar ratings for things (https://b.osmarks.net/o/60b26f1735134d628164217be52ca2d3).

    • It shouldn't be that hard to aggregate all the things I describe positively or negatively on my website and build a thing to allow me to rate pairs.

  • Constrained "LLM agent" (how I dislike this terminology) which chooses things to buy for you (https://thezvi.substack.com/p/choices-are-bad etc).