Real Time May Not Be Enough When Augmented Reality Can Make It Even More Real!

[This is the full, unedited, version of our Feature Article published in the April 21, 2016 edition of Field Technologies Online. The Blog version includes portions that did not make the publication’s final cut.]

Augmented reality may just be the “next big thing” in field service.

It hasn’t really been all that long since the field services community was introduced to the concept of “real time”. Prior to the introduction of real-time data collection, analysis and dissemination, most Field Services Organizations (FSOs) typically relied on batch-collected and -processed data; generally obtained from multiple sources, over an extended period of time; with data often read and input by hand into numerous paper templates; and having to wait for the proper review and approval before the processed data could be distributed to relevant parties.

Fortunately, those days are long-gone!

The proliferation of the application of the Internet; the advent of machine-to-machine (m2m) communications and the Internet of Things (IoT); and the exponentially growing degree of connectivity between not only machines and machines, but between machines and people – and people and people – has resulted in a real-time environment that has propelled the global services community to its current technological positioning.

However, real time may no longer be good enough for the global community of FSOs and their respective field technicians! As traditional Key Performance Indicators (KPIs), such as Mean-Time Between-Failure (MTBF), have steadily shifted from measurements reported in numbers of days, weeks or months just a couple of decades ago, to practically “never” today for many products, this particular metric finds itself diminishing in importance, and is no longer being measured by a growing number of services organizations. And even when equipment is about to fail, the easy availability of predictive diagnostics, remote diagnostics and real-time communications have made this formerly important KPI nothing more than an afterthought for many FSOs.

This is where Augmented Reality, or AR, comes into play.

According to, “Augmented reality is the integration of digital information with the user’s environment in real time. Unlike virtual reality, which creates a totally artificial environment, augmented reality uses the existing environment and overlays new information on top of it.” Think of the “yellow first down line” that magically appears when you’re watching a football game; that’s AR, in that it doesn’t create a “new” virtual reality, but, rather, it enhances the perceptual reality that you, the viewer, is able to visualize while watching the next down take place. It’s not a new creation; it’s an enhanced reality that makes it easier to process what’s going on, and what needs to be done next.

This is exactly how AR is able to assist in a field services environment; that is, to provide the field technician (who may not ever have been called upon to service a piece of equipment with such a long MTBF) to actually perform the repair by “overlaying” an enhanced reality – in 3D motion – over and above what he or she would otherwise be able to visualize, in order to make a quick, clean and complete fix.

Think of it this way: When field technicians are called on for service, they may be facing either a piece of equipment that they have rarely seen in the past; a device that is inherently complex and difficult to disassemble and/or reassemble; or a system that is so business- or mission-critical, that a single delay or misstep could bring a factory’s total production line to a screaming halt – or any combination thereof!

The ability to “see” this Augmented Reality – in 3D motion – with accompanying instructive text, metrics and repair parameters overlaid and easily articulated will undoubtedly provide, at the very least, an extra measure of comfort to the technician, as well as access to a readily available tutorial for performing the repair as quickly, accurately and safely as possible. As such, another historically important KPI, first-time-fix-rate, may also go quickly into the twilight, same as MTBF! And all it takes is the appropriate pair of special glasses for the technician to “see” what needs to be seen!

However, talking about Augmented Reality – rather than actually seeing it in action – is like trying to tell a Southerner how cold the Northern Winters are – in words. It’s just not possible. That’s why AR is best understood by actually seeing a demonstration of it in action.

At a recent field services conference, I was asked to cite what I believe would be the “next big thing” in field service. I suggested “Augmented Reality”. Why? Because we really can’t do things any quicker than real time; and we can’t make repair tutorials any smaller, more compact and/or transportable than they already are. What we can do, however, is make it easier for the field technician to “see” what needs to be done, in real time, and with an “augmented” view of what reality alone cannot, and does not, necessarily provide.

AR has already made it easier to follow – and understand – football games. Isn’t time that it was also used to make it easier to perform field service activities? The answer is resoundingly “Yes”!