Andrej Karpathy unveils nanochat, a full-stack training and inference implementation of an LLM in a single, dependency-minimal codebase (Andrej Karpathy/@karpathy)

Andrej Karpathy / @karpathy:
Andrej Karpathy unveils nanochat, a full-stack training and inference implementation of an LLM in a single, dependency-minimal codebase  —  Excited to release new repo: nanochat! (it's among the most unhinged I've written). Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single, [image]



from Techmeme https://ift.tt/WfOVDIN

Comments

Post a Comment

Popular posts from this blog

Guilherme Rambo, who has published scoops about unreleased Apple products by examining beta software, says Apple locked his dev account with no stated reason (Buster Hein/Cult of Mac)

Image
Buster Hein / Cult of Mac : Guilherme Rambo, who has published scoops about unreleased Apple products by examining beta software, says Apple locked his dev account with no stated reason   —  Guilherme Rambo, one of the top Apple secret-spillers, says Apple locked him out of his developer account, preventing … from Techmeme https://ift.tt/37pX6fR
Read more

Barcelona nights

Image
I’ve yet to walk the entire floor at Mobile World Congress in Barcelona this year (that’s the goal for this afternoon), but my sense is the majority of the robots present fit into one of two categories: robot vacuums or greeter robots. With Pepper out of commission, maybe there’s a wide-open market there. Who knows? The two Xiaomi robots — CyberOne and CyberDog — may well have been the most prominent of the show, and neither were especially inspiring. It was fun finally seeing the Cyber One in person after writing about it seven months ago. The humanoid robot’s stilted locomotion screamed “research prototype” in the first demo, and I’m plenty wary about phone makers getting “serious” about robotics. There was no demo in the booth this year, rendering it more of an expensive mechanical mannequin. Xiaomi’s humanoid CyberOne robot at MWC 2023. Image Credits: Brian Heater CyberDog was moving, at least. The system was significantly smaller than I’d anticipated, standing at only 1.3 fe...
Read more

Zombie startups

Image
Welcome to Startups Weekly, a fresh human-first take on this week’s startup news and trends. To get this in your inbox, subscribe here. People leave jobs for all kinds of reasons, but when it’s a CFO departing a richly valued company as the company itself conducts layoffs, the exodus can be a sign of a larger issue. This was one of the takeaways I had when chatting with Continuum CEO and co-founder Nolan Church about a recent spree of CFO resignations, including but not limited to OpenSea, Noom and Brex. The founder reiterated that we don’t know the exact reasons that people are leaving, but he also noted that it’s a red flag from a recruitment perspective. He also introduced me to the idea of zombie companies, which I appreciated as it is officially spooky season and we love a festive framework. Zombie companies are basically companies that raised a ton of money over the boom cycle but aren’t producing nearly enough revenue to justify the valuation. The late-stage market is full o...
Read more