At the recent Made By Google live event, Google unveiled a groundbreaking update to its renowned mobile personal assistant, Google Assistant, in the form of a new version called “Assistant with Bard.” This enhanced Assistant harnesses the power of generative AI technologies, fusing the capabilities of Google Assistant and Bard for mobile devices. This formidable fusion opens up a wider spectrum of functionalities, extending beyond the usual repertoire of simple tasks such as checking the weather, setting alarms, or sending text messages, which users have come to expect.
One of the most exciting aspects of this development is its ability to delve into a user’s Google apps, such as Gmail and Google Drive, to deliver personalized responses on a voluntary basis. In essence, you can now ask Google Assistant intricate questions like “update me on important emails I might have missed this week,” and it will promptly retrieve the relevant emails to keep you informed.
This feature marks an evolution from Bard’s previous update in mid-September, where it gained the capability to integrate with Google’s suite of apps and services, including Gmail, Docs, Drive, Maps, YouTube, and even Flights and hotel bookings through “Bard extensions.” If you’ve previously granted Bard access to your Gmail, Drive, and Docs, you won’t need to do so again when utilizing this feature within the Assistant app. However, for those who have yet to explore the extensions, granting Bard permission is a prerequisite for receiving personalized responses.
Beyond the realm of email management, Google envisions the expanded capabilities being put to use for various personal tasks. Whether it’s planning a trip, compiling a grocery list, or crafting a captivating social media caption, Assistant with Bard aims to simplify these tasks. Google plans to gauge user interactions and feedback through this experiment before rolling out the functionality widely to Android and iOS users.
What’s particularly exciting is that Bard is now available on mobile devices, allowing users to engage with it in multiple ways. It can utilize your device’s microphone to listen, employ voice output for communication, utilize your camera for visual interactions, and even execute actions to assist you in your day-to-day activities. As Sissie Hsiao, the Vice President of Google Bard and Assistant, points out, “And of course, it’s on the device that you have with you at all times, which is your phone.”
This expansion signifies a significant stride forward for Google’s digital assistant, which had hitherto been confined to more basic tasks. The convergence of Google Assistant and Bard promises a more intelligent and personalized experience for users, offering a glimpse into the future of AI-powered personal assistants.
For the past seven years, Google Assistant has been the trusted companion for millions, simplifying tasks through natural and conversational interactions. From setting alarms to checking the weather with a simple “Hey, Google,” it has revolutionized digital assistance. Now, with the integration of generative AI, Google Assistant is poised to become even more intelligent, personalized, and intuitive, transcending voice interactions.
With Google Assistant with Bard, users have three versatile modes of interaction. They can ask questions and engage in follow-up conversations using their voice, type queries for text-based interaction, or utilize the camera through Bard’s Google Lens integration. This last option empowers users to take or upload images to augment their queries, opening up creative and practical possibilities. Users have been employing this feature in various unique ways, such as seeking fashion advice by photographing their outfits or soliciting coding help by capturing app screenshots.
Sissie Hsiao, Vice President of Google Bard and Assistant, emphasizes the multimodal nature of Bard, highlighting its ability to see, hear, and speak. This multifaceted approach enhances the user experience, making it more accessible and versatile.
Furthermore, on Pixel devices and select Samsung phones, users can access a pop-up, floating window by long-pressing the power or home button. This overlay provides a conversational interface that complements the content on the screen. For example, users can summon Bard over an image of a hotel and inquire about its availability for booking over the upcoming weekend.
With the seamless integration of Bard into Google Assistant, the limitations of the web version are a thing of the past. This means that Bard can now go the extra mile by cross-referencing and double-checking answers, addressing concerns related to AI hallucinations. Modern AI systems sometimes construct incorrect responses based on erroneous information, but this capability, introduced in mid-September, helps ensure accuracy and reliability.
Google has exciting plans for Assistant with Bard, although it will initially debut in select markets, including non-English-speaking regions. While the specific markets and languages have yet to be finalized, Google is committed to a gradual expansion. Over the coming months, the enhanced Assistant will become available to a wider audience of iOS and Android users. Beyond that, Google is exploring the potential to extend this upgraded functionality to other platforms, promising a future of even more intelligent and accessible digital assistance.
