Elon Musk’s Grok AI can now ‘see’ through your phone camera and explain everything in real time – here’s how to use it
Artificial Intelligence has become an everyday part of our domestic and professional lives, where almost every platform is continuously advancing its AI-aided features to make them more interesting and handy.Elon Musk’s AI chatbot Grok, from his company xAI, is once again in the limelight for its new features that open a novel way to interact with the surroundings by simply engaging with the tool using voice.
Imagine chatting with an AI that doesn’t just hear you, it sees what you’re seeing and explains it on the spot, all without typing a word.
Grok voice mode explains everything in the surroundings using a phone camera (photo: Grok.com)
Grok’s new voice and vision feature
Elon Musk’s xAI has just dropped a brand-new update for its Grok chatbot. The tool no longer requires typing to give instructions – in fact, Grok’s Voice mode lets users talk naturally, making chats simple and lively. Musk announced it himself on X, sharing a demo video on his social media profile.In the clip, someone interacts with Grok, switches on the phone camera, and points it around. Grok instantly describes the scene with spot-on details in real time. Musk wrote in the caption of his post, “Use video mode (turn on camera) and Grok voice will explain everything you’re looking at.” Just activate the camera and voice, and it breaks down whatever’s in view – super handy for spotting things on the go.
Grok’s new feature is a game-changer!
This feature skips endless typing for voice questions. Users just have to point their camera at unfamiliar spots, objects, or scenes and get quick answers, with no manual googling needed. It can be highly useful for travellers decoding signs or people needing instant context. xAI has also boosted video generation to 10 seconds from 5, with sharper visuals and audio. Musk highlighted how this upgrade improves clarity for users.
Previous shortcomings of Grok’s features and surrounding scepticism
Grok has been buzzing for mixing text, images, and voice, and users in some countries slammed it for making explicit deepfakes without consent. After probes, X added content filters to block misuse and boost safety.