help

[Idkchud]

I'm not saying these kinds of actually keyed people don't exist. But a lot of these overly anti-commie types are just ultracucked neo-cons who just use those countries as a scapegoat while hosting or supporting drag queen storyhours on the same budget. The "democrats are the real racists" type.

>being an ultracucked neocon who use countries as scapegoats while hosting and supporting drag queen storytimes on the same budget

 

[Keyed zaryan]

Don't you need a giga good pc to run actually usefull local LLMs?

You’re the guy who made a thread where you talked about your dumpster tier laptop, right? Don’t even bother trying to run a local llm if so.

 

[Hillel Hartmann]

You’re the guy who made a thread where you talked about your dumpster tier laptop, right? Don’t even bother trying to run a local llm if so.

I've got more than 1 computer

 

[Idkchud]

You’re the guy who made a thread where you talked about your dumpster tier laptop, right? Don’t even bother trying to run a local llm if so.

noob I can run Deepseek decently on 4gbs of ram on my 2011 desktop anythings possible, also anything higher then 1.5 lost because I said so

 

[Hillel Hartmann]

I'll run deepseek 14b now let's see if it lies to me

 

[Idkchud]

Don't you need a giga good pc to run actually usefull local LLMs?

 

[Hillel Hartmann]

HAHAH WHAT THE FUCK
obsessed with 'p award

 

[Idkchud]

HAHAH WHAT THE FUCK
obsessed with 'p award

yeah I don't know why llama said that

 

[Hillel Hartmann]

I'll run deepseek 14b now let's see if it lies to me

Downloads itself up to 8.7/9.0GB and goes back to 8.2GB in a loop
The chinese are onto me

 

[Hillel Hartmann]

Since the 14b refused to download itself I've tried the 7b one:

 

[Idkchud]

@Hilei Hartmann @Keyed zaryan behold the speed of 2011 4gbs of ram deepseek 1.5b

 

[Hillel Hartmann]

Since the 14b refused to download itself I've tried the 7b one:
View attachment 57883

Gemma3 12b, much better although still stupid as fuck (Gemma3 loves to YAP and YAP and YAP, I had to cut the experiment short):

 

[Idkchud]

Gemma3 12b, much better although still stupid as fuck (Gemma3 loves to YAP and YAP and YAP, I had to cut the experiment short):
View attachment 57885

1B models won or something cause higher B means more RAM consumption

 

[Hillel Hartmann]

1B models won or something cause higher B means more RAM consumption

Ram is cheap o algo. I might buy myself 128gb just to flex on people.

 

[Idkchud]

Ram is cheap o algo. I might buy myself 128gb just to flex on people.

noob just turn it into a server, unless maybe your archiving a shit ton of tabs and opening them all at once 6 gbs of ram winned

 

[Hillel Hartmann]

noob just turn it into a server, unless maybe your archiving a shit ton of tabs and opening them all at once 6 gbs of ram winned

You don't need more than 2gb of ram for web browsing

 

[Idkchud]

does higher B mean more allowed text in entries o algo?

 

[Idkchud]

You don't need more than 2gb of ram for web browsing

3 gbs is the minimum for proper computing in the modern age

 

[Hillel Hartmann]

does higher B mean more allowed text in entries o algo?

You mean input text? This on on 270M gemma3:

 

[Idkchud]

You mean input text? This on on 270M gemma3:
View attachment 57887

no like when I sending messages to the LLM, the maximum text you can send without it going "text to high o algo".