4

Title is self-explanatory. The benefits of this would be tremendous, if correctly trained and perfected, it would be the greatest tool to democratize knowledge about Marxism.

There are already several open-source large language models on the internet out there, but I think the biggest bottlenecks is the knowledge on deploying such models and computing power to run such a thing.

Thread to discuss about this subject

you are viewing a single comment's thread
view the rest of the comments
[-] Neodosa@lemmygrad.ml 1 points 1 year ago

First off, as someone who has programmed GPT stuff since way before ChatGPT, we don't even need to train our own model. That is overly expensive and unnecessary for our purpose. What is much smarter to do in this case is to take all of the Marxist works and let a chatbot access the contents of the works using semantic search. The way we do this is to convert the works into small chunks which we then convert into embedding vectors. When the user sends a message to the chatbot, the message and the context of the message will be converted into an embedding vector. We then run a dot-product between the message of the user and the chunks of the texts in order to find the most relevant chunks to the question which the user has asked. Then a pre-trained model can make use of the information fetched in order to answer the user's question.

Of course, training one's own model can be good if we want it to be even more accurate and familiar with the material, however a good starting point would be to use semantic search.

this post was submitted on 25 May 2023
4 points (100.0% liked)

Communism

27 readers
1 users here now

Discussion Community for fellow Marxist-Leninists and other Marxists.

Rules for /c/communism

Rules that visitors must follow to participate. May be used as reasons to report or ban.

  1. No non-marxists

This subreddit is here to facilitate discussion between marxists.

There are other communities aimed at helping along new communists. This community isn't here to convert naysayers to marxism.

If you are a member of the police, armed forces, or any other part of the repressive state apparatus of capitalist nations, you will be banned.

  1. No oppressive language

Do not attempt to justify your use of oppressive language.

Doing this will almost assuredly result in a ban. Accept the criticism in a principled manner, edit your post or comment accordingly, and move on, learning from your mistake.

We believe that speech, like everything else, has a class character, and that some speech can be oppressive. This is why speech that is patriarchal, white supremacist, cissupremacist, homophobic, ableist, or otherwise oppressive is banned.

TERF is not a slur.

  1. No low quality or off-topic posts

Posts that are low-effort or otherwise irrelevant will be removed.

This is not a place to engage in meta-drama or discuss random reactionaries on lemmy or anywhere else.

This includes memes and circlejerking.

This includes most images, such as random books or memorabilia you found.

We ask that amerikan posters refrain from posting about US bourgeois politics. The rest of the world really doesn’t care that much.

  1. No basic questions about marxism

Posts asking entry-level questions will be removed.

Questions like “What is Maoism?” or “Why do Stalinists believe what they do?” will be removed, as they are not the focus on this forum.

  1. No sectarianism

Marxists of all tendencies are welcome here.

Refrain from sectarianism, defined here as unprincipled criticism. Posts trash-talking a certain tendency or marxist figure will be removed. Circlejerking, throwing insults around, and other pettiness is unacceptable.

If criticisms must be made, make them in a principled manner, applying Marxist analysis.

The goal of this subreddit is the accretion of theory and knowledge and the promotion of quality discussion and criticism.

Check out ProleWiki for a communist wikipedia.

Communism study guide

bottombanner

founded 5 years ago
MODERATORS