Nothing ironic about that. Thanks to OpenClaw and open weights AI models I started self hosting and figuring stuff out that would have made me frustrated and quit years ago. I have home assistant running on bare metal on a mini PC, a NAS with custom bios, migrated everything away from windows, Kavita for ebooks, jellyfin for music and video, nightscout to ingest my wife’s insulin pump data, and some fun custom sidecars that tie together some nifty automations like automatically diarizing and transcribing voice notes of meetings from my phone without having to pay a subscription fee - latest projects have been a local sync point for logseq, kitchenowl, and nextcloud - super productivity android app and caldav and the to-do lists in home assistant. I never would have had the time to figure all this out with my full time job and parenting but I can cut the cord to all my subscription services and I look at things a new way now. I solve my own problems now when before I would just look for a way to buy a solution. I bought bunk beds for the kids but the bottom bunk didn’t come with slats and I couldn’t find the right size so I went to home Depot and built my own with instructions from my ops agent. I had a fun idea to make an e-ink display sign for my office door that shows what town I’m currently in and what my current MS outlook calendar block is and when it’s over. I never played with Arduino before and now I’m hooked. It gets me over that first execution hump. Sure I break stuff and have to figure out how to put it back together again but that’s part of the fun. I finally found a way to learn stuff that works for me, you know, comes naturally. It’s like I’ve been waiting my whole life for this ever since growing up seeing people using computers via natural language in Star Trek. It extends to my work. The data I need is gated behind ticketing systems of business intelligence professionals who don’t have the time or inclination to give me what I need so hey looks like copilot basic is great and m-code, guess I don’t need BI analysts after all. Sucks for them.

Right and the predecessor to ChatGPT was trained on links from reddit posts pretty wild. I remember having fun making it come up with nonsense prose on my GPU

K2 wasn’t the first.

China had CPM-1 in 2020 that was a 2.6B model.

GPT-Neo (Mar 2021) EleutherAI replicates early GPT

PanGu-α (Apr 2021) Huawei’s 200B model

WuDao 2.0 (May 2021) BAAI’s massive 1.75T sparse MoE model

GPT-J (Jun 2021) EleutherAI release 6B

Meta released OPT in 2022, BLOOM was in 2022, GLM 130B by Tsinghua/Zhipu was in 2022 etc

K2 horizon is very recent, nowhere near the first. Different labs have different computational innovations worth studying. DeepSeek is crazy efficient and doing very novel things. Mistral in France is making very compact local friendly models that are fun and easy to fine tune and merge on consumer hardware.