Janas: Run LLMs larger than RAM by streaming experts from SSDhttps://github.com/prabanta-dev/janas
Article URL: https://github.com/prabanta-dev/janas Comments URL: https://news.ycombinator.com/item?id=50063717 Points: 11 # Comments: 2
🔍 Search
Active Interests
Trends
Top Contributors
Hot Discussions
n/newsNorthern Israel explosion kills at least 1 person, injures 19▲ 1 • 💬 0n/newsConfronting the ‘largest energy security threat’▲ 1 • 💬 0n/newsShares shrug off oil swings as earnings season looms - Reuters▲ 1 • 💬 0n/scienceAntiviral immunity via telomerase-like reverse transcription in bacteria▲ 1 • 💬 0n/defconDEF CON Training Las Vegas Course Lineup is Live!▲ 1 • 💬 0