Mark Zuckerberg’s AI camera glasses now tell you about what you’re looking at (2024)
META has upgraded its smart glasses with the ability to describe what you're seeing using a built-in camera.
You can simply ask the AI inside the glasses about what you're looking at – and it'll reply using the speaker inside the specs.
2
The Ray-Ban Meta Smart Glasses were launched by tech billionaire Mark Zuckerberg last year, giving you the ability to record videos and ask an AI questions simply using the eyewear.
Now the AI can assess what's in front of you and provide helpful responses.
For instance, it could describe a cat breed, translate a foreign-language sign, or tell you information about a famous landmark.
Meta calls this "multimodal", which simply means the AI can assess more than one type of input – so not just your voice, but images of the world around you too.
"We started testing a multimodal AI update in December, so you can ask your glasses about what you’re seeing, and they’ll give you smart, helpful answers or suggestions," Meta explains.
"That means you can do more with your glasses because now they can see what you see.
"Say you’re traveling and trying to read a menu in French.
"Your smart glasses can use their built-in camera and Meta AI to translate the text for you, giving you the info you need without having to pull out your phone or stare at a screen."
Most read in News Tech
NICKED Moment topless England ace LAUGHS despite being tasered after 'slapping cop'
MUM'S HEARTBREAK George Gilbey's heartbroken mum reveals his last words to her before death
SWITCH UP This Morning line up in shock shake-up as A-lister replaces Alison Hammond
However, you can't ask just anything: for instance, it Meta won't be able to tell you about a person you've spotted in the street, for privacy reasons.
The feature is now rolling out to all Ray-Ban Meta smart glasses across the U.S. and Canada as a beta test.
Mark Zuckerberg shows off ‘AI glasses’ that give you info about what you see – and you can sign up for ‘early access’ today
Just make sure you've updated your glasses to the latest software, and then simply say "Hey Meta" and ask a question.
META VISION
That's not all: the Meta glasses now let you share your view while making a video call.
If you're video-calling via WhatsApp and Facebook Messenger and you're wearing the glasses, you can show the other callers what you're seeing.
2
Meta says: "At the grocery store and not sure which brand of kombucha to buy? Can’t tell if that pineapple is ripe?
"Now you can hop on a video call with your mom and get her advice based on what you see."
The video-calling feature is rolling out gradually according to Meta, so you might not see the update right away.
Meta has also added new frame options, which are now available in 15 countries, including the U.S., Canada, and Australia.
Who is Mark Zuckerberg, the founder of Facebook?
Here's what you need to know...
Mark Zuckerberg is the chairman, CEO and co-founder of social networking giant Facebook
Born in White Plains, New York in 1984, Zuckerberg already had a “reputation as a programming prodigy” when he started college
While at Harvard, Zuckerberg launched a site called Face Mash, on which students ranked the attractiveness of their classmates
Harvard shut the site down after its popularity crashed a network and Zuckerberg later apologised saying it was “completely improper”
The following term he began working on an early version of Facebook
The 33-year-old launched the social network from his dorm room on February 4, 2004 with the help of fellow students
The friends would end up embroiled in legal disputes as they challenged Zuckerberg for shares in the company
Zuckerberg also faced action from Cameron and Tyler Winklevoss, as well as Divya Narendra who claimed he had stolen their idea – the disagreement was later turned into the film, The Social Network
The tech prodigy dropped out of Harvard to focus on Facebook, but received an honorary degree in 2017
Speaking about the site to Wired magazine in 2010 he said: “The thing I really care about is the mission, making the world open”
By 2012 Facebook had one billion users. By June 2017 it had reached two billion users every month
In 2024, Facebook reaches 3.05 billion monthly users
Mark Zuckerberg's estimated net worth is $165 billion, which makes him the fourth-richest person in the world
Zuckerberg is married to fellow Harvard alumni Priscilla Chan, who he began dating in 2003
The couple have three daughters, as well as a Puli dog named Beast
When you ask Meta AI questions about what you're looking at, your glasses will send a photo to Meta's cloud to be processed with AI. After processing, Meta AI will deliver an audio response on your glasses, and you will be able to review your request, the image, and the response in Meta AI.
Just say, “Hey Meta,” and ask away! You can control the glasses using voice commands, and thanks to Meta AI, even get access to real-time information. We started testing a multimodal AI update in December, so you can ask your glasses about what you're seeing, and they'll give you smart, helpful answers or suggestions.
You could ask Meta AI for the English translations of a sign you're looking at in Italian, what's the name of the houseplant you're looking at, or to write a funny caption for the photo you just took of a dog chasing its own tail. Learn more about what you say with “Hey Meta, look and…”.
Eye Contact uses AI to subtly adjust your gaze in video so it appears you're looking directly into the camera — even when you're reading something off-camera. With Eye Contact in Descript, you can read off a script or teleprompter without worrying about memorizing it or endless mistake-and-retake loops.
The Frame by Brilliant Labs is touted as the world's first glasses with an integrated multimodal AI assistant. Brilliant Labs today is announcing the launch of Frame, what the company calls the world's first glasses with an integrated multimodal AI assistant.
The Facebook View app on iOS and Android makes it easy to import, edit, and share content captured on the smart glasses to apps on your phone: Facebook, Instagram, WhatsApp, Messenger, Twitter, TikTok, Snapchat, and more.
The Eye in Ai smart glasses were tested by a group of blind people and the results were very positive. Users report an improved ability to navigate and understand their environment, better access to information and education, and increased independence and self-sufficiency.
Frame glasses are a pair of smart glasses that look like regular glasses, but have a powerful neural engine CPU that can run multiple generative AI models at the same time. They also have a color micro OLED display that projects information directly on the lens, a camera, a microphone, and a battery.
What does Ray-Ban Meta do? With iconic style and the latest in wearable tech, you can capture and share your world with photos, a video call or a livestream, listen to your favorite playlist and make a call or text using voice commands—all from your smart glasses.
VirTry is a virtual fitting app that finds you "your favorite self" fast and simple! VirTry allows you to try on realistic glasses and sunglasses anytime & anywhere just in your hand. The items move along with your face movements. Turn your face to the left and right, up and down to see every angle with them on.
Meta account is required to use your Ray-Ban Meta smart glasses. If you already have a Meta account, you can enter your login details to continue using your device. If you don't have a Meta account, you can set one up using your email, Instagram account or Facebook account.
There's a new pair of smart spectacles in town — and this time, it's the $349 Frame glasses said to give you multimodal “AI superpowers.” The open-source eyewear comes from a startup called Brilliant Labs, which touts Frame as a way to get AI translations, web search, and visual analysis right in front of your eyes.
eSight is the most versatile and advanced all-in-one device for people with visual impairment. Designed to move seamlessly with the wearer through daily life, eSight offers best visual acuity whether sitting, reading, commuting to work, or exploring a new place.
AI by Zapier actions streamline this process by answering your questions using artificial intelligence. With this app, you can: Answer questions from web pages: AI by Zapier swiftly retrieves answers from any web page, including knowledge bases, documentation, and blogs.
Answer.ai is available 24/7 to answer any questions and difficulties you encounter in your study. We cover almost all subjects, whether solving math problems or helping you check grammar mistakes.
You can use "Hey Meta" to answer questions in-the-moment, get information, spark creativity and express yourself hands-free, while also taking photos and videos, calling, messaging, and controlling media and volume.
AR displays can be rendered on devices resembling eyeglasses. Versions include eyewear that employs cameras to intercept the real world view and re-display its augmented view through the eyepieces and devices in which the AR imagery is projected through or reflected off the surfaces of the eyewear lens pieces.
Address: Suite 592 642 Pfannerstill Island, South Keila, LA 74970-3076
Phone: +9617721773649
Job: Marketing Producer
Hobby: Skydiving, Flag Football, Knitting, Running, Lego building, Hunting, Juggling
Introduction: My name is Tuan Roob DDS, I am a friendly, good, energetic, faithful, fantastic, gentle, enchanting person who loves writing and wants to share my knowledge and understanding with you.
We notice you're using an ad blocker
Without advertising income, we can't keep making this site awesome for you.
