llm tools - where to begin? (lemmy.world)

submitted 1 month ago by deckerrj05@lemmy.world to c/llm@lemmy.world

11 comments fedilink hide all child comments

I'm running ollama with llama3.2:1b smollm, all-minilm, moondream, and more. I am able to integrate it with coder/code-server, vscode, vscodium, page assist, cli, and also created a discord ai user.

I'm an infrastructure and automation guy, not a developer so much. Although my field is technically devops.

Now, I hear that some llms have "tools." How do I use them? How do I find a list of tools for a model?

I don't think I can simply prompt "Hi llama3.2, list your tools." Is this part of prompt engineering?

What, do you take a model and retrain it or something?

Anybody able to point me in the right direction?

you are viewing a single comment's thread
view the rest of the comments

[-] chicken@lemmy.dbzer0.com 1 points 1 month ago* (last edited 1 month ago)

No I meant like, for prompting tool supporting models to be aware of the functions you are making available to it. I've tried arbitrary prompts to tell it to do this and it sort of works but yeah the models I've tried don't seem very good at that, was mainly wondering if using a specific format in the prompt would improve performance

[-] drunnells@lemmy.world 2 points 3 weeks ago

I think what you are looking for is MCP - Model Context Protocol. It's an effort to standardize what you are talking about.

this post was submitted on 19 Apr 2025

7 points (100.0% liked)

Large Language Models

217 readers

1 users here now

A place to discuss large language models.

Rules

Please tag [not libre software] and [never on-device] services as such (those not green in the License column here).
Be useful to others

Resources

github.com/ollama/ollama
github.com/open-webui/open-webui
github.com/Aider-AI/aider
wikipedia.org/wiki/List_of_large_language_models

founded 2 years ago

MODERATORS

autonomoususer@lemmy.world