Google AI at edge and lightweight ML runtime

I believe that the Google AI at Edge framework is highly impressive. I am curious about how it will position itself in the future against other players in model execution, such as Onnx and Huggingface. This appears to be a competitive landscape where we can expect significant developments in the coming months.

The real competition will be about the runtime that will offer the best flexibility and ability to run custom transformers. Tensorflow lite and Mediapipe are there since a while, I wonder how much they will be revamped and evolved in the near future.

Leave a comment