The experience of volunteering at a food pantry highlighted a common challenge: How can sighted volunteers best support people with visual impairments without presuming to understand their individual needs? This question led to the discovery of Be My AI, an innovative feature within the Be My Eyes app that uses artificial intelligence to offer instant visual assistance, reducing reliance on human volunteers and potential wait times.
Understanding Be My Eyes and Its AI Component
Be My Eyes is a volunteer-run video platform founded in 2015 by Hans Jørgen Wiberg. Recognizing the need for connection, Wiberg created a platform linking blind and low-vision individuals with sighted volunteers via live video calls to assist with everyday tasks. In 2023, the platform introduced Be My AI, its AI-powered virtual assistant, aimed at reducing the need for immediate human intervention.
Leveraging OpenAI’s GPT-4 with Vision
The core of Be My AI lies in its integration with OpenAI’s GPT-4 with vision. This allows the app to instantly “see” and describe images submitted by users. Simply snap a photo of something you need help with, and the AI provides a detailed, natural language description. What sets Be My AI apart is its conversational ability; it functions much like interacting with any advanced chatbot. Users can ask follow-up questions, and the AI maintains context to provide tailored responses.
If the AI can’t help, you can seamlessly switch to a live volunteer call, giving you flexible options anytime.
How to Utilize Be My AI for Greater Accessibility
Be My AI and the Be My Eyes app are accessible across desktop, iOS, and Android devices. Here’s a simple guide to using them:
- Download & Register: Obtain the Be My Eyes app and register your account using your email address, Google ID, or Apple ID.
- Select Your Language: During the setup process, choose your primary language to ensure accurate AI assistance.
- Access Be My AI: Once logged in, navigate to the Be My AI feature for instant visual support.
- Capture & Describe: When assistance is needed, take a photo within the Be My AI tab. The GPT-4 powered AI will analyze the image and generate a detailed description.
- Engage in Conversation: You can ask follow-up questions about the image, such as identifying objects or describing environments, through the chat interface.
- Seamless Transition to Live Help: If the AI cannot answer your question or more personalized assistance is required, you can easily connect with a sighted volunteer via video call.
This blend of AI and human support offers unparalleled flexibility – providing help exactly when and how it’s needed.
Should You Explore Be My Eyes?
While Be My Eyes is a valuable and free accessibility tool, it’s not without limitations. The AI might misinterpret blurry or intricate images, and, like any technology, it requires a smartphone and reliable internet access. However, it offers a flexible support system that empowers users to select the type of help best suited for the moment.
Addressing Data Ethics and Privacy
Concerns about data privacy are valid in any online platform. Be My Eyes prioritizes transparency, however. Images submitted to Be My AI are processed solely to generate responses and are not stored long term. The platform emphasizes its commitment to user privacy, offering robust screen reader support and providing users with full control over their engagement.
The heart of the Be My Eyes platform and its AI features is built on good intentions and wasn’t crafted recklessly.
Ultimately, Be My Eyes doesn’t aim to replace human connection but rather to enhance accessibility and create more inclusive everyday interactions. If you value independence but occasionally need an extra set of eyes – whether human or AI – Be My Eyes provides a thoughtful and adaptable solution.
