喺屋企 update 自己個 LLM toolset
先用 uv 搞咗個好少少嘅 venv environment: https://github.com/hnfong/dotfiles/tree/master/adhoc_venv
然後試咗 llm (Simon Willison 嗰個) 同埋佢嘅 github 同 exa integration (github 嘅好處係多好多 model 用兼且我唔使直接 call openai...)
然後再搞好咗個 mlx_lm 同 mlx_vlm
-------------
另外就好興緻勃勃咁喺我啲 prompts 度整咗個 java compile and run evaluation 系統。
屌,一半嘅 models 竟然連 sample input 都過唔撚到⋯ https://github.com/hnfong/public-crap/blob/main/prompts/code/001-programkmb.prompt.eval
真係有冇咁撚虧呀大佬。
No comments:
Post a Comment