Are LLMs floating FP16?

[bbartling]

Can I run a project like this locally some hardware like this I think meant for computer vision on the edge for FP16 Yolo models?

• https://www.seeedstudio.com/reComputer-J1020-v2-w-o-power-adapter-p-5608.html
• https://www.seeedstudio.com/reComputer-J3011-w-o-power-adapter-p-5630.html

Its just for experimentation and learning purposes. This most expensive model has 16 gig of memory, what is best recommended just for experimentation purposes? The cheap side would be nice especially it just being for experimentation purposes : )

• https://www.seeedstudio.com/reComputer-J4012-w-o-power-adapter-p-5628.html?queryID=639ef60cde4a38ccc9ff2f82070d4854&objectID=5628&indexName=bazaar_retailer_products