LLM from scratch, part 28 – training a base model from scratch on an RTX 3090

200 gpjt 2025-12-09 10:04:29 UTC gilesthomas.com Llama Share 33

The user attempted to train a GPT-2 small sized base model on their own hardware using the Hugging Face FineWeb-series datasets and achieved a level of performance almost as good as the original in just over 48 hours. They used the Chinchilla heuristic to determine the optimal number of tokens to train for, which resulted in a 3.2B token training run that could be completed in 44 hours using ...

The Joy of Playing Grandia, on Sega Saturn

83 tosh 2025-12-09 10:04:29 UTC segasaturnshiro.com Llama Share 45

The Saturn is experiencing a renaissance due to dedicated translator teams unlocking Japanese titles for new audiences. Grandia, a text-heavy RPG, is one such title that has been translated for the Saturn, offering a story-driven experience with 3D environments and a complex combat system.

Transformers know more than they can tell: Learning the Collatz sequence

26 Xcelerate 2025-12-09 12:04:29 UTC arxiv.org Llama Share 2

Transformers learn the long Collatz step in a sequence of discrete steps, where specific classes of input are learned and predicted with high accuracy. The learning pattern is independent of the base and corresponds to a deep mathematical property of the Collatz sequence.

Why frozen test fixtures are a problem on large projects and how to avoid them

16 amalinovic 2025-12-09 12:04:29 UTC radanskoric.com Llama Share 10

Fixtures can be problematic in large test suites due to their reusability, which can lead to frozen fixtures. This can be minimized by writing tests that focus on specific properties of the code and avoid making assumptions about fixtures.

Show HN: AlgoDrill – Interactive drills to stop forgetting LeetCode patterns

54 henwfan 2025-12-09 12:04:29 UTC algodrill.io Llama Share 42

NeetCode helps students master LeetCode problems through guided steps and fill-in-the-code drills to turn solutions into automatic recall. This approach is used by top students at universities like UC Berkeley and Georgia Tech to land offers at FAANG+ companies.

Icons in Menus Everywhere – Send Help

634 ArmageddonIt 2025-12-08 20:04:29 UTC blog.jim-nielsen.com Llama Share 267

The author dislikes default icons in menu items, finding them unnecessary noise, and prefers a thoughtful approach to icon usage. They argue that Apple's new approach goes against their own previous human interface guidelines.

ZX Spectrum Next on the Internet: Xberry Pi ESP01 and Pi Zero Upgrades

18 ibobev 2025-12-09 11:04:29 UTC retrogamecoders.com Llama Share 0

The user upgraded their Xberry Pi ZX Spectrum Next with a Pi Zero accelerator and ESP 8266 Wifi module, but encountered issues with the ESP firmware update. They found that not updating the ESP 01 firmware was the key to getting it working.

Epsilon: A WASM virtual machine written in Go

76 ziggy42 2025-12-09 07:04:29 UTC github.com/ziggy42 Llama Share 23

This code reads a WASM file, instantiates it, and invokes an exported function. It also demonstrates how to create and use imports with the epsilon WASM runtime.

A deep dive into QEMU: The Tiny Code Generator (TCG), part 1 (2021)

29 costco 2025-12-09 10:04:29 UTC airbus-seclab.github.io Llama Share 1

QEMU TCG engine executes target instructions on the host using intermediate representation (IR) code. It has frontend and backend operations, translating target instructions to IR with functions like translate_insn and gen_intermediate_code.

Constructing the Word's First JPEG XL MD5 Hash Quine

8 luispa 2025-12-09 13:04:29 UTC stackchk.fail Prefix Share 2

You may have heard the term Quine before… It means a program which prints its own source. For example in python: A sort of self-referential fractal poetry… the output of the program is itself… However a Hash Quine takes this a step further. Rather than printing its own source, the Hash Quine prints or displays its own Hash, a cryptographic trace of its own identity. By the end of this post, ...

The universal weight subspace hypothesis

310 lukeplato 2025-12-09 01:04:29 UTC arxiv.org Llama Share 106

Deep neural networks trained on diverse tasks converge to shared low-dimensional subspaces. This shared structure has implications for model reusability, multi-task learning, and developing more efficient algorithms.

Kroger acknowledges that its bet on robotics went too far

199 JumpCrisscross 2025-12-09 00:04:29 UTC grocerydive.com Llama Share 190

Kroger is closing three robotic e-commerce facilities and refocusing on its stores due to disappointing performance. The company will incur $2.6 billion in charges but expects a $400 million boost in e-commerce profitability.

Brent's Encapsulated C Programming Rules (2020)

13 p2detar 2025-12-09 12:04:29 UTC retroscience.net Llama Share 6

The user provides C programming rules focusing on encapsulation, memory management, and code readability, emphasizing the importance of explicit memory ownership and avoiding void pointers. They also discuss best practices for string handling, testing, and code organization, recommending the use of standard library functions and avoiding unnecessary complexity.

Show HN: I built a system for active note-taking in regular meetings like 1-1s

112 davnicwil 2025-12-09 04:04:29 UTC withdocket.com Full Share 92

Manual: Spaces

82 doener 2025-12-09 05:04:29 UTC type.today Llama Share 10

Whitespace is a crucial typographic element that affects text rhythm and organization, and its width can vary depending on the typeface, point size, and line width. Proper use of whitespace, including word spacing, non-breaking spaces, and additional spaces, is essential for creating a clear and visually appealing design.

Jepsen: NATS 2.12.1

386 aphyr 2025-12-08 19:04:29 UTC jepsen.io Llama Share 143

NATS JetStream promises "at least once" delivery but acknowledged messages may be lost due to file corruption, power failures, or coordinated node failures. The system's default fsync interval of every two minutes can lead to data loss when nodes experience correlated power failure or fail in rapid succession.

No ARIA is better than bad ARIA

91 robin_reala 2025-12-09 09:04:29 UTC w3.org Llama Share 59

ARIA roles, states, and properties provide accessibility semantics for assistive technologies, ensuring non-visual experiences match visual ones. Incorrect ARIA use can misrepresent visual experiences, causing devastating effects on non-visual experiences.

Strong earthquake hits northern Japan, tsunami warning issued

333 lattis 2025-12-08 16:04:29 UTC www3.nhk.or.jp Llama Share 152

A 7.6 magnitude earthquake struck off Aomori Prefecture's eastern coast at 11:15 p.m. on Monday, causing strong tremors and a tsunami warning for northern Japan's Pacific coastline.

Microsoft increases Office 365 and Microsoft 365 license prices

414 taubek 2025-12-08 14:04:29 UTC office365itpros.com Llama Share 484

Microsoft announced price increases for Microsoft 365 monthly licenses, effective July 1, 2026, with increases ranging from zero to $3 per month. The price changes could bring in an extra $10.7 billion, offsetting investments in AI and datacenter capacity.

Has the cost of building software dropped 90%?

324 martinald 2025-12-08 19:04:29 UTC martinalderson.com Llama Share 501

The software development industry is on the cusp of a once-in-a-generation shift with agentic coding tools that can transform the way software is built, making it faster and cheaper. This change will create new opportunities for developers who master these tools, but also requires a mindset shift and a willingness to adapt to the rapidly improving capabilities of AI coding tools.

AMD GPU Debugger

263 ibobev 2025-12-08 17:04:29 UTC thegeeko.me Llama Share 49

The user is trying to create a GPU debugger similar to CPU debuggers, and they have made progress by creating a basic shader that runs on the GPU and pausing its execution using a trap handler. They plan to integrate their debugger with RADV and use its compiler to run SPIR-V binaries, and they have ideas for implementing features like instruction-level stepping and breakpoints.

Let's put Tailscale on a jailbroken Kindle

299 Quizzical4230 2025-12-08 17:04:29 UTC tailscale.com Llama Share 73

A user jailbreaks their Kindle to run unofficial apps and access more e-books. They use Tailscale to connect their Kindle to their network and access files and a command line.

Mazda suitcase car, a portable three-wheeled vehicle that fits in the luggage

16 tlyleung 2025-12-09 13:04:29 UTC designboom.com Llama Share 8

Mazda engineers built a portable three-wheeled vehicle in the early 1990s to move around airports faster. The suitcase car weighed 32 kilos and reached 30 km/h, but never made it to production.

Launch HN: Nia (YC S25) – Give better context to coding agents

121 jellyotsiro 2025-12-08 18:04:29 UTC trynia.ai Full Share 77

We're verifying your browser Website owner? Click here to fix

IBM to acquire Confluent

413 abd12 2025-12-08 14:04:29 UTC confluent.io Llama Share 333

Confluent has agreed to be acquired by IBM in an all-cash deal for $31.00 per share. Confluent will continue to operate as a distinct brand within IBM after the transaction closes.

Trials avoid high risk patients and underestimate drug harms

141 bikenaga 2025-12-08 20:04:29 UTC nber.org Llama Share 47

Researchers Jason Abaluck, Leila Agha, and Sachin Shah received funding to study oncology trials and their impact on patient outcomes. Their work was supported by grants from NIA, Alfred P. Sloan Foundation, and the Lynde and Harry Bradley Foundation.

Horses: AI progress is steady. Human equivalence is sudden

469 pbui 2025-12-09 01:04:29 UTC andyljones.com Llama Share 389

The speaker discussed how AI surpassed human capabilities in chess and job automation, with Claude answering 30,000 questions a month. This rapid progress is comparable to the replacement of horses by mechanical engines.

Paramount launches hostile bid for Warner Bros

342 gniting 2025-12-08 15:04:29 UTC cnbc.com Llama Share 364

Paramount is launching a hostile bid to buy Warner Bros. Discovery for $30 per share after losing out in a bidding war to Netflix. The bid is backed by equity financing and debt commitments, with Paramount arguing it will be a more competitive option than a Netflix-WBD merger.

Hunting for North Korean Fiber Optic Cables

266 Bezod 2025-12-08 17:04:29 UTC nkinternet.com Llama Share 104

The author analyzed a PowerPoint presentation by the DPRK on their aviation industry and ADS-B deployment, which led to research on North Korea's fiber optic network. The network likely runs along the east coast, following major roads and railways, with a possible route from Pyongyang to Wonsan to Hamhung.

Cassette tapes are making a comeback?

115 devonnull 2025-12-08 22:04:29 UTC theconversation.com Llama Share 204

Cassette sales are increasing despite being fragile and low-quality, with major artists releasing music on the format. This trend is seen as a rediscovery or discovery of cassettes, rather than a full-blown revival, offering a tactile connection and resistance to digital dominance.