Spatial Computing

The deeper into the "Computer Age" we go, the less we notice the many, many ways computers are impacting our day to day lives.

It's been a long while now since the funny little ritual of addressing Alexa at home, or Siri on or phones, seemed a bit... odd. Now people think nothing of asking Alexa to set a few timers, or Siri to read your messages while they drive. They're perfectly comfortable dictating an email, or chatting with an AI personality to help them through a rough spot in life.

And there are so many more computers and computer aided devices that simply "are" a fact of day to day life we don't even consider stopping and deciding whether to go with it, or try to disable the "thing" that knows what you're doing, when, and where. It’s also true that for many applications, we don’t even have a choice.

Among the many forms of computer tech that have begun to change the way we approach problems is something called "spatial computing." This can be defined as the blending of the "digital and physical worlds by overlaying virtual and augmented reality into our physical environment. It uses technologies like computer vision and sensor fusion to understand and map a user's physical space, allowing for natural, 3D interactions with digital content using devices like augmented reality (AR) glasses and virtual reality (VR) headsets. Examples include using AR for remote training or design reviews, and using VR for fully immersive experiences." (Generated by AI following a search)

Like many innovations, a lot of spatial computing first came to our attention in the form of games. And interestingly, it had been predicted by Sci-Fi many years before it actually arrived.

An easy way for computer manufacturers to ease their product's way into our day-to-day lives was by presenting them as toys. Sure, they were great for spreadsheets and managing inventories, and people did use them at work. But that was more or less our view of the "Personal computer”: a tool for work, too expensive and time consuming for home. 

Except when they came loaded with Space Invaders, Pong, and Pac-Man. Soon adventure games were popular, and online gaming not only got a foothold, but became, and remains, a major part of young (and older!) people's lives.

Spatial computing entered the world, particularly of young people, with - games! Augmented reality and virtual reality allowed gamers to play in a 3-D world, and with hand gestures and voice commands, interact with characters that were generated for them via headset and goggles, and handheld controllers. Now when the Bad Guys came after you, it might be from the side or behind rather than on a simple 2 dimensional screen. Sounds could be emanating from above or below you. You could turn quickly and catch a glimpse of something behind you.

Do you remember those scenes from 2002's "Minority Report?" When Tom Cruise's Chief Anderton tossed virtual computer interfaces around a big space with a swipe of his hand, moving from application to application as he sorted information - following a lead, combining data, digging deeper into an idea? That's now not only possible, in its own way, but in some fields it's actually part of a normal work day.

As we're told on https://www.simplilearn.com/, spatial computing allows a surgeon to "practice(s) a complex procedure in a digital operating room. An architect and client walk through a full-scale virtual building before the first brick is laid. Spatial computing is moving from the experimental to the essential workspace, merging physical precision with digital flexibility."

That same website suggests that fields like healthcare, architecture and field services can train more easily and at a cost savings, design and test products more quickly, and provide safer operations day to day thanks to the advances in spatial computing. Just thinking along the lines of one of those arenas, how much simpler to have a "virtual" operating room where a student can see, hear, "feel" a case, as it might be IRL (in real life), along with hundreds of other students, all trying out their skills at no risk to a particular patient, and without sacrificing any of the "real" space, tools, medications that might be required for training.

Apple Vision Pro, one version of a spatial computer, suggests that users will enjoy entertainment (turning any space, however small or limited, into a massive 3-D screen for viewing movies; your workspace will be huge and comfortable, with not just a laptop and a monitor but a massive virtual screen where you can keep tabs on multiple projects and threads; relive your family history or have a conversation with your "mom"; "collaborate and communicate" with family or co-workers in what feels like the same space, projecting a "persona" that is a representation of you as if dressed for a meeting, but while in reality sitting in your den in your weekend attire. Take a class, practice music, learn a language or immerse yourself in a time or place. And this is what's possible right now.

I recall spending quite a bit of time playing with a sort of 3 dimensional room rendering project: you input dimensions, windows, doors, details, and it rendered a still version of the room as you described it, and then you could play with colors, furniture placement, renovations, so "see" how it might work. 

Today, you'd be able to do the same except actually walk through your project and get the "feel" of it all. 

As you contemplate what might actually be done, the possibilities are nothing short of amazing. Be a character in history as you observe life on a street in Paris during the revolution; find and fix an electrical problem; hike through a forest with only nature to guide you (and no risk); "ride along" with a person in the field, offering expert advice as they attempt to troubleshoot a car broken down on the road. 

You'll probably think of more than a few applications once you get started! And not too long from now, you’ll be able to go on your imagined virtual adventure.