Localllm - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Deepu K Sasidharan

Oct 6

Forget Claude Code. All you need is Qwen3.8-Flash-Next running locally for agentic coding

#ai #qwen38flashnext #localllm #qwen38

15 min read

techaiwire

Oct 5

RemoveMacAI strips Apple Intelligence models from macOS 27

#apple #opensource #localllm

4 min read

Alex Fank

Oct 5

Estimating tokens/s for Mixture-of-Experts models: active parameters, plus a routing term

#llm #localllm #machinelearning #performance

5 min read

Reno Lu

Oct 2

Qwen3.8-27B on one RTX 3090, and the setting its README says chat clients should leave at default

#vllm #localllm #speculativedecoding #quantization

4 min read

Oct 4

Run Qwen3.8-Flash-Next Locally with EXL3 and TabbyAPI on 40+ GB of RAM

#ai #localllm #llm #tutorial

10 min read

Sep 29

Still carrying the diagnosis

#localllm #debugging #buildinpublic #opensource

8 min read

DevLog

Sep 28

Claude CLI 401 Unauthorized Refresh Token Issue

#clitools #localllm #troubleshooting

3 min read

DevLog

Sep 27

Discord bot not responding but still running: how to catch it

#automation #localllm #macos

3 min read

DevLog

Sep 23

Claude Code MCP setup and usage rules

#clitools #macos #localllm

3 min read

DevLog

Sep 23

Clone your own voice with a 17-second recording

#contentops #localllm #macos

2 min read

DevLog

Sep 21

Prompt engineering: How to fix instructions that AI ignores

#promptengineering #ai #localllm

3 min read

Dmitry Amelchenko

Oct 3

Inside My llama.cpp Setup: Tuning Qwen 3.8 27B for 512K Context

#ai #llm #localllm #llamacpp

7 min read

Vishnu Hari Dadhich

Sep 14

What Happens When You Ask an LLM a Question

#ai #localllm #llmbasics #gpu

8 min read

Vishnu Hari Dadhich

Sep 14

Run vLLM on Kubernetes with Minikube, WSL2 and NVIDIA GPU

#ai #localllm #vllm #kubernetes

13 min read

Sep 30

Testing the 9x Smaller Local LLM Claim on a GPU-less VPS

#localllm #quantization #selfhosting #gguf

6 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.