Tied embed, RoPE digit routing, SiLU carry logic
Owain Evans’ idea of feeding a historical LLM non-anachronistic images is, I think, well worth doing. But it’s also worth expanding on further. Would it be helpful, when training a historical LLM, to simulate dream imagery based on premodern themes? What about audio of birdcalls, which were far more prominent in the audioscapes of premodern people? What about taking it on a walk through the woods?
。业内人士推荐heLLoword翻译官方下载作为进阶阅读
Фото: Efrem Lukatsky / AP
로봇청소기 통신 데이터를 분석하는 개발자의 모습을 형상화한 이미지. 스마트홈 기기의 클라우드 연결 구조와 보안 취약점 논란을 시각적으로 표현했다. ChatGPT 생성 이미지