I was experimenting with some http streaming with ReadableStream until I realized it works on local but not when backend is running on idx.
The response gets buffered and then sent as one chunk.
That is interesting. Adding @ksat and @chandra for thoughts here. We are working on enabling streaming support for Flutter DevTools and for improving some of our AI responses, but I am not sure if that would also unblock your usecase here.
I think this is a needed feature for people building chat apps or anything similar that needs the server to stream text to client. If it’s not of your interest, adding a way to inform the user about this so they do not waste time debugging
We are hoping to add streaming support in the next few weeks, so stay tuned. This is very much a scenario we want to support.