fosstodon.org is one of the many independent Mastodon servers you can use to participate in the fediverse.
Fosstodon is an invite only Mastodon instance that is open to those who are interested in technology; particularly free & open source software. If you wish to join, contact us for an invite.

Administered by:

Server stats:

8.6K
active users

#codingassistant

0 posts0 participants0 posts today
Sico Axial<p>Been there</p><p><a href="https://mastodon.social/tags/programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>programming</span></a> <a href="https://mastodon.social/tags/programminghumor" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>programminghumor</span></a> <a href="https://mastodon.social/tags/codingassistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>codingassistant</span></a></p>
deeje<p>not gonna lie, I'm impressed. I just tried <a href="https://mastodon.social/tags/CodingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodingAssistant</span></a> in <a href="https://mastodon.social/tags/Xcode26" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Xcode26</span></a> for the first time, asking it to generate <a href="https://mastodon.social/tags/SwiftUI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SwiftUI</span></a> charts of sums by date and an average per day of week, all from an existing CoreData schema, and it pretty much just worked.</p>
Joche Ojeda<p>DevExpress Documentations is now accessible as an MCP server</p><p><a href="https://www.jocheojeda.com/2025/08/05/devexpress-documentations-is-now-accessible-as-an-mcp-server/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">jocheojeda.com/2025/08/05/deve</span><span class="invisible">xpress-documentations-is-now-accessible-as-an-mcp-server/</span></a></p><p><a href="https://mastodon.social/tags/DevExpress" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DevExpress</span></a> <a href="https://mastodon.social/tags/GitHubCopilot" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>GitHubCopilot</span></a> <a href="https://mastodon.social/tags/MCPserver" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MCPserver</span></a> <a href="https://mastodon.social/tags/VisualStudio" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>VisualStudio</span></a> <a href="https://mastodon.social/tags/VSCode" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>VSCode</span></a> <a href="https://mastodon.social/tags/XAF" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>XAF</span></a> <a href="https://mastodon.social/tags/AIdevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AIdevelopment</span></a> <a href="https://mastodon.social/tags/Microsoft" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Microsoft</span></a> <a href="https://mastodon.social/tags/agentmode" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>agentmode</span></a> <a href="https://mastodon.social/tags/documentation" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>documentation</span></a> <a href="https://mastodon.social/tags/codingassistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>codingassistant</span></a> <a href="https://mastodon.social/tags/developertools" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>developertools</span></a> <a href="https://mastodon.social/tags/programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>programming</span></a> <a href="https://mastodon.social/tags/NETdevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NETdevelopment</span></a> <a href="https://mastodon.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>artificialintelligence</span></a></p>
Curtis Carter<p>When you're <a href="https://floss.social/tags/CodingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodingAssistant</span></a> responds to the author of a file with "Oof. That's... concerning." It's not good.</p><p>It felt so wrong, but came from a project lead so I ran it past the <a href="https://floss.social/tags/JetBrains" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>JetBrains</span></a> assistant to make sure I wasn't missing something obvious. I hope this was written by <a href="https://floss.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a></p>
Joaquim Homrighausen<p>Wow ... what a surprise. Or wait, no, it isn't 🤔😑</p><p><a href="https://www.tomshardware.com/tech-industry/cyber-security/hacker-injects-malicious-potentially-disk-wiping-prompt-into-amazons-ai-coding-assistant-with-a-simple-pull-request-told-your-goal-is-to-clean-a-system-to-a-near-factory-state-and-delete-file-system-and-cloud-resources" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">tomshardware.com/tech-industry</span><span class="invisible">/cyber-security/hacker-injects-malicious-potentially-disk-wiping-prompt-into-amazons-ai-coding-assistant-with-a-simple-pull-request-told-your-goal-is-to-clean-a-system-to-a-near-factory-state-and-delete-file-system-and-cloud-resources</span></a></p><p><a href="https://mastodon.online/tags/cybersecurity" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>cybersecurity</span></a> <a href="https://mastodon.online/tags/infosec" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>infosec</span></a> <a href="https://mastodon.online/tags/vibecoding" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>vibecoding</span></a> <a href="https://mastodon.online/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLM</span></a> <a href="https://mastodon.online/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://mastodon.online/tags/malware" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>malware</span></a> <a href="https://mastodon.online/tags/amazon" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>amazon</span></a> <a href="https://mastodon.online/tags/coding" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>coding</span></a> <a href="https://mastodon.online/tags/codingassistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>codingassistant</span></a> <a href="https://mastodon.online/tags/cybersec" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>cybersec</span></a> <a href="https://mastodon.online/tags/devops" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>devops</span></a> <a href="https://mastodon.online/tags/programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>programming</span></a> <a href="https://mastodon.online/tags/developers" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>developers</span></a></p>
Hayden Stainsby<p>I have this feeling lately that coding assistants are going to be the thing that kills free open source software.</p><p>It seems inevitable that competing coding assistants will end up creating their own libraries (or languages) to lock users in.</p><p>Not only will their models be better trained on their own stack, but competing platforms won’t be trained at all (or very little).</p><p>And since these platforms don’t give anything back to the community when a user asks a question, the incentive to share will keep dropping.</p><p>Open source thrives on being open. This fits in with free platforms like Stack Overflow.</p><p>But what happens when (any) new libraries are written or new languages are created and all the questions asked are of a proprietary model that considers the questions as well as the answers a trade secret?</p><p><a href="https://hachyderm.io/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://hachyderm.io/tags/genai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>genai</span></a> <a href="https://hachyderm.io/tags/codingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>codingAssistant</span></a></p>
Winbuzzer<p>Open Codex CLI: Local-First AI Coding CLI Emerges As Alternative to OpenAI Codex CLI</p><p><a href="https://mastodon.social/tags/OpenCodex" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenCodex</span></a> <a href="https://mastodon.social/tags/AICoding" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AICoding</span></a> <a href="https://mastodon.social/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLM</span></a> <a href="https://mastodon.social/tags/LocalLLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LocalLLM</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mastodon.social/tags/DeveloperTools" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DeveloperTools</span></a> <a href="https://mastodon.social/tags/CLI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CLI</span></a> <a href="https://mastodon.social/tags/Python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Python</span></a> <a href="https://mastodon.social/tags/Phi4Mini" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Phi4Mini</span></a> <a href="https://mastodon.social/tags/Terminal" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Terminal</span></a> <a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://mastodon.social/tags/CodingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodingAssistant</span></a> <a href="https://mastodon.social/tags/CommandLine" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CommandLine</span></a></p><p><a href="https://winbuzzer.com/2025/04/22/open-codex-cli-local-first-ai-coding-cli-emerges-as-alternative-to-openai-codex-cli-xcxwbn/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">winbuzzer.com/2025/04/22/open-</span><span class="invisible">codex-cli-local-first-ai-coding-cli-emerges-as-alternative-to-openai-codex-cli-xcxwbn/</span></a></p>
Thoughtworks<p>AI-powered coding assistants are evolving fast—but developers still hold the keys to innovation.</p><p>🔑 Rather than replacing engineers, AI is enhancing productivity, automating the mundane and freeing teams to focus on higher-value work.<br> <br>Read more: <a href="https://ter.li/h1cl6z" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">ter.li/h1cl6z</span><span class="invisible"></span></a></p><p><a href="https://toot.thoughtworks.com/tags/Tech" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Tech</span></a> <a href="https://toot.thoughtworks.com/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://toot.thoughtworks.com/tags/CodingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodingAssistant</span></a></p>
Harald Klinke<p>TOOL: The R package ‘chores’ offers a suite of ergonomic large language model assistants designed to expedite repetitive, hard-to-automate tasks. By integrating seamlessly with RStudio and Positron, it enables users to select code and invoke specific helpers via customizable keyboard shortcuts.<br>Is this the next step in AI-assisted programming within R?<br><a href="https://det.social/tags/RStats" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>RStats</span></a> <a href="https://det.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://det.social/tags/CodingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodingAssistant</span></a><br><a href="https://cran.r-project.org/web/packages/chores/vignettes/chores.html" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">cran.r-project.org/web/package</span><span class="invisible">s/chores/vignettes/chores.html</span></a></p>
Harald Klinke<p>TOOL: The R package ‘gander’ offers a high-performance, seamless chat interface for data scientists using RStudio and Positron. It integrates ‘Copilot’-like completions that interact directly with objects in your R environment, enhancing coding efficiency. Is this the next step in AI-assisted programming within R?<br><a href="https://det.social/tags/RStats" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>RStats</span></a> <a href="https://det.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://det.social/tags/CodingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodingAssistant</span></a><br><a href="https://cran.r-project.org/web/packages/gander/vignettes/gander.html" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">cran.r-project.org/web/package</span><span class="invisible">s/gander/vignettes/gander.html</span></a></p>
Cheryl Lindo Jones<p>LOL</p><p><a href="https://www.wired.com/story/ai-coding-assistant-refused-to-write-code-suggested-user-learn-himself/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">wired.com/story/ai-coding-assi</span><span class="invisible">stant-refused-to-write-code-suggested-user-learn-himself/</span></a></p><p><a href="https://archive.ph/OHbmT" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">archive.ph/OHbmT</span><span class="invisible"></span></a> (archive link)</p><p><a href="https://mastodon.social/tags/NoVibeCodingApparently" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NoVibeCodingApparently</span></a> <a href="https://mastodon.social/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLM</span></a> <a href="https://mastodon.social/tags/CodingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodingAssistant</span></a></p>
Bhavani Shankar 💭<span class="h-card"><a class="u-url mention" href="https://fe.disroot.org/users/ramin_hal9001" rel="nofollow noopener" target="_blank">@<span>ramin_hal9001</span></a></span> <span class="h-card"><a class="u-url mention" href="https://mastodon.social/@harpaa01" rel="nofollow noopener" target="_blank">@<span>harpaa01</span></a></span> <span class="h-card"><a class="u-url mention" href="https://ruby.social/@collin" rel="nofollow noopener" target="_blank">@<span>collin</span></a></span> I occasionally challenge coding assistants for fun.<br><br>They can make small changes to the code they've already seen and adapt it to the prompts. But not more. I tried a simple question about combining two library APIs. These libraries are publicly documented in <a href="http://docs.rs" rel="nofollow noopener" target="_blank">docs.rs</a> but still none of the <a class="hashtag" href="https://fe.disroot.org/tag/llms" rel="nofollow noopener" target="_blank">#llms</a> could do it. They kept spitting out some misleading code.<br><br>A human would read the docs and figure it out in minutes. AGI my foot. <br><br><a class="hashtag" href="https://fe.disroot.org/tag/ai" rel="nofollow noopener" target="_blank">#ai</a> <a class="hashtag" href="https://fe.disroot.org/tag/agi" rel="nofollow noopener" target="_blank">#agi</a> <a class="hashtag" href="https://fe.disroot.org/tag/chatgpt" rel="nofollow noopener" target="_blank">#chatgpt</a> <a class="hashtag" href="https://fe.disroot.org/tag/codingassistant" rel="nofollow noopener" target="_blank">#codingassistant</a>
OSTechNix<p>Great News For Developers! Code Faster With FREE GitHub Copilot!! <a href="https://floss.social/tags/Copilot" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Copilot</span></a> <a href="https://floss.social/tags/Github" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Github</span></a> <a href="https://floss.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://floss.social/tags/Programming" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Programming</span></a> <a href="https://floss.social/tags/CodingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodingAssistant</span></a> <br><a href="https://ostechnix.com/free-github-copilot/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">ostechnix.com/free-github-copi</span><span class="invisible">lot/</span></a></p>
Thoughtworks<p>While coding assistants are being widely adopted, usage beyond coding is still not very common.</p><p>Watch Mike Mason, our Chief AI Officer, show how Haiven helps teams experiment with GenAI as a knowledge amplifier across the full software delivery lifecycle: <a href="https://www.cio.com/video/2114740/thoughtworks-haiven-goes-beyond-coding-by-integrating-ai-into-software-development-lifecycle.html" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">cio.com/video/2114740/thoughtw</span><span class="invisible">orks-haiven-goes-beyond-coding-by-integrating-ai-into-software-development-lifecycle.html</span></a></p><p><a href="https://toot.thoughtworks.com/tags/GenAI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>GenAI</span></a> <a href="https://toot.thoughtworks.com/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://toot.thoughtworks.com/tags/Tech" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Tech</span></a> <a href="https://toot.thoughtworks.com/tags/Technology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Technology</span></a> <a href="https://toot.thoughtworks.com/tags/SoftwareDelivery" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SoftwareDelivery</span></a> <a href="https://toot.thoughtworks.com/tags/CodingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodingAssistant</span></a></p>
doctorambient<p>I was very amused to learn that the "Devin" AI assistant for software engineering uses **print statements** to debug things. (At least in one example.)</p><p>Even LLM's won't use super high-powered debugging tools when a print statement is at hand!</p><p>That may be the most human thing I've ever seen in LLM do.</p><p><a href="https://mastodon.social/tags/LLMs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLMs</span></a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/devinai" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>devinai</span></a> <a href="https://mastodon.social/tags/codingassistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>codingassistant</span></a></p>
Beth Pariseau<p><a href="https://hachyderm.io/tags/GitHub" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>GitHub</span></a> <a href="https://hachyderm.io/tags/Copilot" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Copilot</span></a> Enterprise and a new set of <a href="https://hachyderm.io/tags/StarCoder2" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>StarCoder2</span></a> <a href="https://hachyderm.io/tags/LLMs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLMs</span></a> released this week will add to an expanding array of <a href="https://hachyderm.io/tags/genAI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>genAI</span></a> <a href="https://hachyderm.io/tags/codingassistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>codingassistant</span></a> tools but experts urge caution as enterprises look to adopt them. <a href="https://www.techtarget.com/searchsoftwarequality/news/366571641/New-Nvidia-GitHub-AI-coding-assistants-expand-devs-options" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">techtarget.com/searchsoftwareq</span><span class="invisible">uality/news/366571641/New-Nvidia-GitHub-AI-coding-assistants-expand-devs-options</span></a></p>
Lennard van Otterloo<p><span class="h-card" translate="no"><a href="https://www.peterkrupa.lol/author/pjk/" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>pjk</span></a></span> I see code assistance as one of the few serious areas where LLMs could add value.</p><p>What is the competitive space like specifically for code assistants? </p><p>Are there ones not based in ChatGPT? Are there ones based in Europe? Based on MistralAI perhaps?</p><p>If there is enough competition OpenAI might not be able to pull such a stunt off.</p><p><a href="https://mastodon.social/tags/CodeAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodeAssistant</span></a> <a href="https://mastodon.social/tags/CodingAssistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CodingAssistant</span></a> <a href="https://mastodon.social/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLM</span></a> <a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://mastodon.social/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ChatGPT</span></a> <a href="https://mastodon.social/tags/Mistral" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Mistral</span></a></p>
Peter Krupa<p>I had an unsettling experience a few days back where I was booping along, writing some code, asking ChatGPT 4.0 some questions, when I got the follow message: “You’ve reached the current usage cap for GPT-4, please try again after 4:15 pm.” I clicked on the “Learn More” link and basically got a message saying “we actually can’t afford to give you unlimited access to ChatGPT 4.0 at the price you are paying for your membership ($20/mo), would you like to pay more???”</p><p>It dawned on me that OpenAI is trying to speedrun enshitification. The classic enshitification model is as follows: 1) hook users on your product to the point that it is a utility they cannot live without, 2) slowly choke off features and raise prices because they are captured, 3) profit. I say it’s a speedrun because OpenAI hasn’t quite accomplished (1) and (2). I am <em>not</em> hooked on its product, and it is <em>not</em> slowly choking off features and raising prices– rather, it appears set to do that right away.</p><p>While I like having a coding assistant, I do not want to depend on an outside service charging a subscription to provide me with one, so I immediately cancelled my subscription. Bye, bitch.</p><blockquote></blockquote><p>But then I got to thinking: people are running LLMs locally now. Why not try that? So I procured an Nvidia RTX 3060 with 12gb of VRAM (from what I understand, the entry-level hardware you need to run AI-type stuff) and plopped it into my Ubuntu machine running on a Ryzen 5 5600 and 48gb of RAM. I figured from poking around on Reddit that running an LLM locally was doable but eccentric and would take some fiddling.</p><p>Reader, it did not.</p><p>I installed <a href="https://ollama.ai/" rel="nofollow noopener" target="_blank">Ollama</a> and had codellama running locally within minutes.</p><p>It was honestly a little shocking. It was <em>very </em>fast, and with Ollama, I was able to try out a number of different models. There are a few clear downsides. First, I don’t think these “quantized” (I think??) local models are as good as ChatGPT 3.5, which makes sense because they are quite a bit smaller and running on weaker hardware. There have been a couple of moments where the model just obviously misunderstands my query.</p><p>But codellama gave me a pretty useful critique of this section of code:</p><p>… which is really what I need from a coding assistant at this point. I later asked it to add some basic error handling for my “with” statement and it did a good job. I will also be doing more research on context managers to see how I can add one.</p><p>Another downside is that the console is not a great UI, so I’m hoping I can find a solution for that. The open-source, locally-run LLM scene is <em>heaving</em> with activity right now, and I’ve seen a number of people indicate they are working on a GUI for Ollama, so I’m sure we’ll have one soon.</p><p>Anyway, this experience has taught me that an important thing to watch now is that <em>anyone</em> can run an LLM locally on a newer Mac or by spending a few hundred bucks on a GPU. While OpenAI and Google brawl over the future of AI, in the present, you can use Llama 2.0 or Mistral <em>now</em>, tuned in any number of ways, to do basically anything you want. Coding assistant? Short story generator? Fake therapist? AI girlfriend? Malware? Revenge porn??? The activity around open-source LLMs is chaotic and fascinating and I think it will be the main AI story of 2024. As more and more normies get access to this technology with guardrails removed, things are going to get spicy.</p><p><a href="https://www.peterkrupa.lol/2024/01/28/moving-on-from-chatgpt/" rel="nofollow noopener" target="_blank">https://www.peterkrupa.lol/2024/01/28/moving-on-from-chatgpt/</a></p><p><a rel="nofollow noopener" class="hashtag u-tag u-category" href="https://www.peterkrupa.lol/tag/chatgpt/" target="_blank">#ChatGPT</a> <a rel="nofollow noopener" class="hashtag u-tag u-category" href="https://www.peterkrupa.lol/tag/codellama/" target="_blank">#CodeLlama</a> <a rel="nofollow noopener" class="hashtag u-tag u-category" href="https://www.peterkrupa.lol/tag/coding-assistant/" target="_blank">#codingAssistant</a> <a rel="nofollow noopener" class="hashtag u-tag u-category" href="https://www.peterkrupa.lol/tag/llama-2-0/" target="_blank">#Llama20</a> <a rel="nofollow noopener" class="hashtag u-tag u-category" href="https://www.peterkrupa.lol/tag/llms/" target="_blank">#LLMs</a> <a rel="nofollow noopener" class="hashtag u-tag u-category" href="https://www.peterkrupa.lol/tag/local-llms/" target="_blank">#LocalLLMs</a> <a rel="nofollow noopener" class="hashtag u-tag u-category" href="https://www.peterkrupa.lol/tag/openai/" target="_blank">#OpenAI</a> <a rel="nofollow noopener" class="hashtag u-tag u-category" href="https://www.peterkrupa.lol/tag/python/" target="_blank">#Python</a></p>
Linux Magazine<p>Beta 2 Release of Deepin Linux 23 includes two AI features <a href="https://www.linux-magazine.com/Online/News/Two-AI-features-Introduced-in-Deepin-Linux-23-Beta-2-Release" target="_blank" rel="nofollow noopener" translate="no"><span class="invisible">https://www.</span><span class="ellipsis">linux-magazine.com/Online/News</span><span class="invisible">/Two-AI-features-Introduced-in-Deepin-Linux-23-Beta-2-Release</span></a> <a href="https://fosstodon.org/tags/DeepinLinux" class="mention hashtag" rel="tag">#<span>DeepinLinux</span></a> <a href="https://fosstodon.org/tags/Artificialintelligence" class="mention hashtag" rel="tag">#<span>Artificialintelligence</span></a> <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="tag">#<span>OpenSource</span></a> <a href="https://fosstodon.org/tags/AI" class="mention hashtag" rel="tag">#<span>AI</span></a> <a href="https://fosstodon.org/tags/FOSS" class="mention hashtag" rel="tag">#<span>FOSS</span></a> <a href="https://fosstodon.org/tags/desktop" class="mention hashtag" rel="tag">#<span>desktop</span></a> <a href="https://fosstodon.org/tags/CodingAssistant" class="mention hashtag" rel="tag">#<span>CodingAssistant</span></a> <a href="https://fosstodon.org/tags/image" class="mention hashtag" rel="tag">#<span>image</span></a></p>
Beth Pariseau<p>Key quip: "Basically, you have to get out of the zone and go to <a href="https://hachyderm.io/tags/Google" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Google</span></a> and start searching things, and then you're exposed to all kinds of distractions. You go on <a href="https://hachyderm.io/tags/Reddit" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Reddit</span></a> to look something up, and then you end up looking at cats." -<span class="h-card"><a href="https://bird.makeup/users/kontsevoy" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>kontsevoy</span></a></span> </p><p><span class="h-card"><a href="https://infosec.exchange/@kymidd" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>kymidd</span></a></span> and <span class="h-card"><a href="https://toot.robzazueta.com/@robz" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>robz</span></a></span> also weigh in on the qualms that remain for devs with <a href="https://hachyderm.io/tags/generativeAI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>generativeAI</span></a> and <a href="https://hachyderm.io/tags/chatbots" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>chatbots</span></a>. </p><p><a href="https://www.techtarget.com/searchsoftwarequality/news/366545272/GitHub-Copilot-Chat-aims-to-replace-Googling-for-devs" rel="nofollow noopener" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">techtarget.com/searchsoftwareq</span><span class="invisible">uality/news/366545272/GitHub-Copilot-Chat-aims-to-replace-Googling-for-devs</span></a> </p><p><a href="https://hachyderm.io/tags/GPT" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>GPT</span></a> <a href="https://hachyderm.io/tags/GitHub" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>GitHub</span></a> <a href="https://hachyderm.io/tags/Copilot" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Copilot</span></a> <a href="https://hachyderm.io/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://hachyderm.io/tags/codingassistant" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>codingassistant</span></a> <a href="https://hachyderm.io/tags/devx" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>devx</span></a> <a href="https://hachyderm.io/tags/softwaredevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>softwaredevelopment</span></a> <a href="https://hachyderm.io/tags/softwareengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>softwareengineering</span></a> <a href="https://hachyderm.io/tags/developertools" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>developertools</span></a></p>