Open Assistant Inference Backend Development (Hands-On Coding)

February 24, 2023 · One min read

Project co-founder

Join me as I build streaming inference into the Hugging Face text generation server, going through cuda, python, rust, grpc, websockets, server-sent events, and more...

https://open-assistant.io