Has anyone applied tree of thought prompting to r1 yet? (programming.dev)

submitted 5 days ago by artificialfish@programming.dev to c/localllama@sh.itjust.works

9 comments fedilink hide all child comments

Generate 5 thoughts, prune 3, branch, repeat. I think that’s what o1 pro and o3 do

you are viewing a single comment's thread
view the rest of the comments

[-] artificialfish@programming.dev 2 points 4 days ago

Actually now that I think about it, LLM's are decoder only these days. But decoders and encoders are architecturally very similar. You could probably cut off the "head" of the decoder, make a few fully connected layers, and fine tune them to provide a score.

this post was submitted on 30 Jan 2025

11 points (100.0% liked)

LocalLLaMA

2514 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works