The idea
Glasses are an appealing place to put a computer. They sit close to the eyes and ears, they point where you are looking, and many people already wear them. A pair of smart glasses tries to add useful information to that position: directions, messages, translations, a camera, a microphone, or a heads-up display. The idea has been explored for many years in research labs and consumer products, and it keeps returning because the potential convenience is clear, even if the practical hurdles have been stubborn.
“Smart glasses” covers several different designs, so it helps to separate them.
- Camera and audio glasses. These look like ordinary eyewear, with a small camera, microphones and speakers near the ears but no display. They can take photos, play audio and take voice commands.
- Display glasses. These add a small image the wearer can see, either a few lines of text or a graphic placed in their view.
- Augmented reality glasses. These aim to place digital objects convincingly into the world around you, which requires tracking the surroundings and aligning graphics to them.
- Headsets with passthrough cameras. Bulkier devices show the real world through cameras and screens. These belong more with mixed reality than with everyday eyewear.
How a display on glasses works
Putting an image in front of an eye without blocking the view is hard. A common approach uses a tiny projector, often built into the frame near the temple, that sends light into a transparent piece of material in the lens, called a waveguide or combiner. The material directs the light toward the eye, so the wearer sees a faint image that seems to float in the distance, overlaid on the world.
This works, but not without compromises.
- Brightness. The image has to compete with sunlight. Outdoors it may wash out.
- Field of view. The visible area where graphics can appear is typically small compared with the full view, so what you see can be like a small window.
- Clarity and eye comfort. The display has to appear at a comfortable focusing distance, and a design that is sharp for one person’s eyes or one head shape can be less so for another’s. Prescription lenses add another layer of complexity.
- Image quality versus transparency. Making the lens clearer for the real world can make the digital image dimmer, and the reverse.
The engineering squeeze
Glasses are small and light, and people notice weight on the nose and ears within minutes. Every function competes for the same limited space.
Battery. A battery that lasts a day would make glasses heavy. Small batteries limit how bright a display can be, how long a camera can record and how much computing can happen on the frame. Designers often shift heavy processing to a phone or the cloud, which adds latency and uses wireless networking, or run light tasks locally using edge computing.
Heat. A processor and projector near the face generate heat that has to go somewhere that does not feel uncomfortable.
Sensing. For graphics to stay fixed in the world as you turn your head, the device needs cameras and motion sensors and good headset tracking, so that digital content lines up with real surfaces. More sensors mean more power and more weight.
Input. Typing is awkward. Options include voice commands built on speech recognition, touch areas on the arm of the frame, small handheld controllers or hand gestures. Each has drawbacks: speaking to your glasses in public may feel awkward or be unreliable in noise.
Style. Frames must look acceptable to wear all day. Early designs were sometimes seen as conspicuous, and fashion matters as much as specification.
Social questions
What makes face-worn computing different from a phone is that other people are affected by it.
Cameras and consent. A phone is visibly raised to take a picture. A camera in a pair of glasses may be less obvious, and bystanders may not know whether they are being recorded. Many designs add an indicator light for this reason, and some venues restrict such devices. Norms are still forming.
Identifying people. Combining a camera with facial recognition could in principle let a wearer identify strangers, which raises serious concerns about surveillance technology and anonymity in public places. Whether and how such features are offered is a matter of policy and law, and it differs between places.
Attention and etiquette. If someone appears to be looking at you while reading notifications, conversation can suffer. Some people find that uncomfortable, and in meetings or on the road it can be distracting.
Safety. Graphics in the field of view can distract from traffic, stairs or machinery. Many designs keep the display small or off-center for this reason, and rules about use while driving vary.
Data. Cameras and microphones can collect a lot of information about the wearer and the people around them. Questions arise about where recordings go, how long they are kept, and whether bystanders have any say.
Why the idea keeps returning
Several uses seem plausible. Hands-free instructions can help workers in repair or logistics settings. Live captions may help people who are deaf or hard of hearing follow conversations. Translation, navigation prompts and quick photo capture are other possibilities. Designers also see glasses as a possible successor to the phone for some tasks, although that is a prediction rather than an established outcome.
Equally, there are reasons for caution. Many people do not want to wear a computer on their face for long periods, and the combination of battery, size, price and social acceptance has been difficult to get right. Whether smart glasses become common, remain a niche tool for particular jobs or stay a lightweight audio-and-camera accessory is uncertain.
For more on how head-worn devices fit among other body-worn technology, see the survey of wearable devices. Some medical or vision-related uses of head-worn displays are being researched, but any such application should be assessed with an eye-care professional.