If you haven’t built a super-high-end workstation in a while, you might not have heard of Intel’s Optane memory caching tech. Optane also powered ultra-fast SSDs for consumers and businesses alike.
A Redditor has caused a stir by coaxing a workstation build using Optane PMem DIMMs as RAM to run a 1-trillion-parameter LLM. APFrisco explains in a mini tutorial/guide on the Local LLaMA subreddit ...