Google AI Edge Gallery - On-Device ML/GenAI Showcase App

[AI Summary]: Google AI Edge Gallery is an experimental Android app that showcases on-device generative AI capabilities, allowing users to run cutting-edge ML models entirely locally without internet connection. The app features model switching from Hugging Face, image Q&A, audio transcription, prompt exploration, multi-turn chat, and performance benchmarking (TTFT, decode speed, latency). Built on Google AI Edge APIs, LiteRT runtime, and LLM Inference API, it supports bringing your own LiteRT models and provides real-time performance insights. Available on Google Play and as APK for Android 12+, this open-source project demonstrates practical applications of on-device AI while preserving privacy and eliminating cloud dependencies.

  • Developer: Google AI Edge
  • License: Apache 2.0
  • Platform: Android (iOS coming soon)
  • Stars: 13.8k on GitHub