after making this post a while ago, i tried out these three techniques for providing tool-result data to the LLM

• append to assistant message
• send as user response
• send model-specific tool-response type

Findings

turns out - the assistant-message appending works great for larger LLMs, but not so well for smol ones.

meanwhile the user-side method works better than expected!

i didnt spend too much time with the model-specific tool role stuff, since i want my tooling to remain model-agnostic.

i will probably switch to the user-side method now for gopilot, leaving behind the assistant-only approach

Tool call formatting improvements

Turns out - my initial tool calling formatting was SUPER token-inefficient - who knew...

So I went from this formatting

okay lemme look that up online
{"tool_name": "web_search", "args": {"query": "how to make milk rice"}}
just put milk and rice in a bowl and mix em

to this, MUCH simpler format

okay lemme look that up online
Tool: web_search("how to make milk rice")
Result: just put milk and rice in a bowl and mix em

which is like - just.... WAY better!!!!

• tokens reduced from 43 down to 24 (cost savings)
• way easier to read
• relies on models code-writing ability
• allows for specific assignment like in json: Tool: web_search(query="my query here")

i hope this is useful to someone out there.

if so, maybe share where you are applying it and tell us about your experience! <3

made dis one for the therapy group chat im in -

therapist posted som ai generated pic with conni goin "somthinsomthin go to csd" while holdin som raonbow flag (i dun think she noticed it was generatd n jus took it from somwhere)

n now im specificalli shootin against postin those kindsa unsourced pics - as in - unaltered generatd pics - by jus makin a real thing n also sourcin all the pics i stole to make dis.

here conni grl source: https://licensing.wdr-mediagroup.com/marke/conni/

here lena grl source: https://pixabay.com/illustrations/girl-cross-legged-pjs-person-child-963133/

n i went eh - why not also put it here so here u go..

bam!!!! thads my story for today--- been a while since i posted...

gotta get back to makin actulli good posts - n not jus feel bad posts. recent ones were preddi sad i feel.-.-. :( i dun wan that. i wan u all to be all comf here- ~ ~ ~

been a while since i posted last time ~

i had to update thad name at som point... couldn stand peeps callin me "smarty" .... i dun wana be a peep who goes "oh - im soooo smart!!! look at me ~ im sooooo special - yea thads right!!! look at me!!!!" yea no... dun like those peeps.. n dun wana be one of em-

anyway - maria it is now ig...

i wish u a lovely day ~ <3

secondary image link

based on a tru story ~ ~ ~ ~ ~ + - ° *

dis is not (!!!!) a ^nintendo-product^, dis is from diffrnt compani. its jus "licensed" by it...

yes - i kno - - -

• capitalism bad
• sharing is caring
• love is love

... yesyis i get it, n i agree.

but can we mayb - jus this once - try n pretend everythin is oki.,., i kno its hard, thads why im writin dis, cuz i feel kinda bad for postin dis - but !!!! i jus wanted to share dis magicl experience i had just now.,.,.

post made with krita and open camera <3

is reaction post to dis one which made me... vrri uncomf.

its hard to remain positive in these times. we dun need to share mor negativity. if anythin, positivity is whad we need most <3

aimin for the stars isn a bad thing. its encouraging to kno - thad seemingli magic things rlli cn happn in our not-so-magic world.

• if u havnt found ur special someone - u still cn.
• if u havnt found a reasonabl job til now - u still cn.
• if u havnt found a gud hobby - u still cn.

no amount of "failure" (which is rlli jus a learnin opportunity) makes u less likely to suceed.
jus lik how rolling a 1 four times 🎲 in a row doesn influence the next role, infact, the chances havnt changed at all.

dun get demotivated by peeps sharin evil words. they dun kno u. they hav no idea who u r besides the smol amount of data they cn see on-screen.

imagine u readin ur own post by another user who u dun kno.
if it sounds evil, or in bad faith - mayb consider rewriting it.

grls sure r a thng.... honestli - i look so lil at grls - i dun kno whads in right now - as in clothin..,.,.

alsu!!! i decreased the resolution from 600*800 to 400*500, whatcha think?

dis is a lil thingy i found at my schools social worker while i was passin by - vrri sweet.

imma totalli be onnthe regenbogen chat today, now thad i kno it exists >v< (its moderated btw ~ ~ ~ thads why the limitee open times ~)

* the design of the flyer wasnt made by me. im jus sharin whad i found somwhere

EDIT: fixxd regeobogen to regenbogen

made with the krita-..

yanas sad song

EDIT: added tags

* the text was taken largeli from the original yonas sad song. thad part was not created by me ~

it like - hurts. like it usually jus hurts wheb crying. bt kinda constantly..,..

it hurts n feels awful n makes me look down a lot so peeps dun see it,...,...,,,...

i cnt.,.,, i cnt do dis,,.

UPDATEUPDATE :o

by sad i dun mean im sad (im jus down is all) bt i mean im sad cuz of evil throat!!,.,.,. yis, the throat is the evil! n im sads becuz if it bein so evil n hurtin su bad.

WARNING! i edited dis screenshot. in realiti it said "we're not screwed" n "AI will not cause massive unemployment" bt... its waaaayyy too funi to lik - not post dis---- he looks suu happi bout it >//v//<

context: dis matthew berman man is a big ai bro

in case anyone cares, here vid link

yes, i am promptin u to prompt me so i cn respond in the commnts

so like... put a commnt or somthn...

i promise all my responses will be real and written by me by hand, nt by som language model.

lil post i wanted to make for som time -

dun take dis toooo seriously, bt its nice when i see a repost with credit ~ <3

(or evn bettr: a fully original post! :o it doesn hav to be great, its fun if its som ms paint stuff <3 )

if u hav nevr uploaded a thing, i wud highli encourage u to upload a thing u made to the 196. lemmi see ur cool stuffs :o

EDIT: added tags