inside of a report, Groq claims its LPUs are scalable and will be connected jointly applying optical interconnect across 264 chips. it may more be scaled applying switches, but it's going to add to latency. According to https://www.sincerefans.com/blog/groq-funding-and-products