Hello
I'm Testing LLM on singleboard computer. I expect a lot from the vulcan compatibility, there is many channel where we search for a good plateforme.
I'm working on self-hosted LLM sharing results on some discord channels.
This far the TPU doesn't help much but there is some upgrades I'm working on that may take profit of those dedicated chips.
Still it helps with whisper to get some transcripts.