1
Widget AI — Fast, mobile-first conversational assistant powered by Groq LPUs
Built Widget AI to solve two major pain points common in conversational AI web apps: high response latency and broken mobile viewports during virtual keyboard interactions.
What it does:
• Delivers sub-second inference using
openai/gpt-oss-20b deployed on Groq LPUs.
• Features a clean landing view that smoothly transitions into an active chat upon typing.
• Resolves viewport-shifting bugs on mobile devices with dynamic visualViewport height listeners.
• Includes built-in dark/light modes, customizable typewriter animation speed, and session history management.
Tech Stack:
• Backend: Python, Flask
• Inference: Groq Cloud API
• Frontend: Vanilla HTML5, CSS3, JavaScript, Marked.js
• Hosting: Render, DuckDNS
Live Demo: https://widget-ai.duckdns.org
Would love to hear your feedback on the layout responsiveness and inference speed!
Add a comment
0/2000