Virtual assistant

File:Android Assistant on the Google Pixel XL smartphone (29526761674).jpg

Google Assistant running on a Pixel XL smartphone

Apple TV remote control, with which users can ask Siri virtual assistant to find content to watch

Amazon Echo smart speaker running the Alexa virtual assistant

A virtual assistant or intelligent personal assistant is a software agent that can perform tasks or services for an individual. Sometimes the term "chatbot" is used to refer to virtual assistants generally or specifically those accessed by online chat (or in some cases online chat programs that are for entertainment and not useful purposes).

As of 2017, the capabilities and usage of virtual assistants are expanding rapidly, with new products entering the market and a strong emphasis on voice user interfaces. An online poll in May 2017 found the most widely used in the US were Apple's Siri (34%), Google Assistant (19%), Amazon Alexa (6%), and Microsoft Cortana (4%).^[1] Apple and Google have large installed bases of users on smartphones. Microsoft has a large installed base of Windows-based personal computers, smartphones and smart speakers. Alexa has a large install base for smart speakers.^[2]

History

The first tool enabled to perform digital speech recognition was the IBM Shoebox, presented to the general public during the 1962 Seattle World's Fair after its initial market launch in 1961. This early computer, developed almost 20 years before the introduction of the first IBM Personal Computer in 1981, was able to recognize 16 spoken words and the digits 0 to 9. The next milestone in the development of voice recognition technology was achieved in the 1970s at the Carnegie Mellon University in Pittsburgh, Pennsylvania with substantial support of the United States Department of Defense and its DARPA agency. Their tool "Harpy" mastered about 1000 words, the vocabulary of a three-year-old. About ten years later the same group of scientists developed a system that could analyze not only individual words but entire word sequences enabled by a Hidden Markov Model.^[3] Thus, the earliest virtual assistants, which applied speech recognition software were automated attendant and medical digital dictation software.^[4] In the 1990s digital speech recognition technology became a feature of the personal computer with Microsoft, IBM, Philips and Lernout & Hauspie fighting for customers. Much later the market launch of the first smartphone IBM Simon in 1994 laid the foundation for smart virtual assistants as we know them today.^[5] The first modern digital virtual assistant installed on a smartphone was Siri, which was introduced as a feature of the iPhone 4S on October 4, 2011.^[6] Apple Inc. developed Siri following the 2010 acquisition of Siri Inc., a spin-off of SRI International, which is a research institute financed by DARPA and the United States Department of Defense.^[3]

Method of interaction

Virtual assistants make work via:

Text (online chat), especially in an instant messaging app or other app
Voice, for example with Amazon Alexa on the Amazon Echo device, or Siri on an iPhone
By taking and/or uploading images, as in the case of Samsung Bixby on the Samsung Galaxy S8

Some virtual assistants are accessible via multiple methods, such as Google Assistant via chat on the Google Allo app and via voice on Google Home smart speakers.

Virtual assistants use natural language processing (NLP) to match user text or voice input to executable commands. Many continually learn using artificial intelligence techniques including machine learning.

To activate a virtual assistant using the voice, a wake word might be used. This is a word or groups of words such as "Alexa", "Hey Siri" or "OK Google".^[7]

Devices and objects where found

Virtual assistants may be integrated into many types of platforms or, like Amazon Alexa, across several of them:

Into devices like smart speakers such as Amazon Echo, Google Home and Apple HomePod
In instant messaging apps on both smartphones and via the Web, e.g. Facebook's M (virtual assistant) on both Facebook and Facebook Messenger apps or via the Web
Built into a mobile operating system (OS), as are Apple's Siri on iOS devices and BlackBerry Assistant on BlackBerry 10 devices, or into a desktop OS such as Cortana on Microsoft Windows OS
Built into a smartphone independent of the OS, as is Bixby on the Samsung Galaxy S8 and Note 8.^[8]
On other mobile apps such as Google Allo
Within instant messaging platforms, assistants from specific organizations, such as Aeromexico's Aerobot on Facebook Messenger or Wechat Secretary on WeChat
Within mobile apps from specific companies and other organizations, such as Dom from Domino's Pizza^[9]
On smartwatches
In appliances,^[10] cars,^[11] and Android Wear clothing.^[12]
Previous generations of virtual assistants often worked on websites, such as Alaska Airlines' Ask Jenn,^[13] or on interactive voice response (IVR) systems such as American Airlines' IVR by Nuance.^[14]
Orange Djingo^[15]

Services

Virtual assistants can provide a wide variety of services, and particularly those from Amazon Alexa and Google Assistant grow by the day. These include:^[16]

Provide information such as weather, facts from e.g. Wikipedia or IMDB, set an alarm, make to-do lists and shopping lists
Play music from streaming services such as Spotify and Pandora; play radio stations; read audiobooks
Play videos, TV shows or movies on televisions, streaming from e.g. Netflix
Conversational commerce, see below
Complement and/or replace customer service by humans.^[17] One report estimated that an automated online assistant produced a 30% decrease in the work-load for a human-provided call centre.^[18]

Conversational commerce

Template:Main Conversational commerce is e-commerce via various means of messaging, including via voice assistants^[19] but also live chat on e-commerce Web sites, live chat on messaging apps such as WeChat, Facebook Messenger and WhatsApp^[20] and chatbots on messaging apps or Web sites.

Third-party services

Amazon enables Alexa "Skills" and Google "Actions", essentially apps that run on the assistant platforms.

Virtual assistant privacy

Template:Main Virtual assistants have a variety of privacy concerns associated with them. Features such as "Hey Siri" pose a threat, as such features are always listening. ^[21] However, such features are important to make devices accessible for people who may otherwise have trouble. ^[22] Modes of privacy such as the virtual security button have been proposed to create a multilayer authentication for virtual assistants. ^[23]

Developer platforms

The platforms that power the most widely used virtual assistants are also used to power other solutions:

Amazon Lex was opened to developers in April 2017. It involves natural language understanding technology combined with automatic speech recognition and had been introduced in November 2016.^[24]
Google provides the Actions on Google and Dialogflow platforms for developers to create "Actions" for Google Assistant^[25]
Apple provides SiriKit for developers to create extensions for Siri
IBM's Watson, while sometimes spoken of as a virtual assistant is in fact an entire artificial intelligence platform and community powering some virtual assistants, chatbots. and many other types of solutions.^[26]^[27]

Previous generations

In previous generations of text chat-based virtual assistants, the assistant was often represented by an avatar of (a.k.a. 'interactive online character or automated character) — this was known as an embodied agent.

Full comparison of assistants

Intelligent personal assistant	Developer	Free software	Free and open-source hardware	HDMI out	External I/O	IOT	Chromecast integration	Smart phone app	Always on	Unit to unit voice channel
Alice	Yandex	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:Yes	Template:No	Template:Yes	Template:Yes	Template:N/a
Alme	Verint	No
AliGenie	Alibaba Group	Template:No	Template:No	Template:N/a	Template:N/a	Template:Yes	Template:No	Template:Yes	Template:Yes	Template:N/a
Assistant	Speaktoit	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:No	Template:No	Template:Yes	Template:No	Template:N/a
Alexa (a.k.a. Echo)	Amazon.com	Template:No	Template:No	Template:No	Template:No	Template:Yes	Template:No	Template:Yes	Template:Yes	?
Bixby	Samsung Electronics	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:No	Template:No	Template:Yes	Template:N/a	Template:N/a
BlackBerry Assistant	BlackBerry Limited	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:No	Template:No	Template:Yes	Template:No	Template:N/a
Braina	Brainasoft	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:No	Template:No	Template:Yes	Template:No	Template:N/a
Cadence	Cadence studio	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:N/a	Template:No	Template:Yes	Template:Yes	Template:N/a
Clova	Naver Corporation	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:Yes	Template:No	Template:Yes	Template:Yes	Template:N/a
Cortana	Microsoft	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:Yes	Template:No	Template:Yes	Template:Yes	Template:N/a
Duer	Baidu^[28]
Evi	Amazon.com True Knowledge	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:No	Template:No	Template:Yes	Template:No	Template:N/a
Google Assistant	Google	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:Yes	Template:Yes	Template:Yes	Template:Yes	Template:N/a
Google Now	Google	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:Yes	Template:Yes	Template:Yes	Template:Yes	Template:N/a
James	boost.ai	Template:No
M (discontinued January 2018)^[29]	Facebook
Lucida	Clarity Lab, University of Michigan Template:Third party inline	Template:Yes	Template:N/a	Template:N/a	Template:N/a	Template:No	Template:No	Template:Yes	Template:No	Template:N/a
Mycroft^[30]	Mycroft AI	Template:Yes	Template:Yes	Template:Yes	Template:Yes	Template:Yes	Template:Yes	Template:Yes	Template:Yes	Template:Yes
Nina	Nuance	Template:No
Saiy(a.k.a. utter!)	Saiy Ltd.	Template:Yes	Template:N/a	Template:N/a	Template:N/a	Template:N/a	Template:N/a	Template:Yes	Template:Yes	Template:N/a
Sherpa	Sherpa Europe SL	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:Yes	Template:No	Template:Yes	Template:Yes	Template:N/a
SILVIA	Cognitive Code	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:No	Template:No	Template:Yes	Template:No	Template:N/a
Siri	Apple Inc.	Template:No	Template:No	Template:N/a	Template:N/a	Template:Yes	Template:No	Template:Yes	Template:Yes	Template:N/a
Snips	Snips SAS	Template:Yes	Template:N/a	Template:N/a	Template:N/a	Template:Yes	Template:N/a	Template:N/a	Template:Yes	Template:N/a
Viv	Samsung Electronics	Template:No	Template:N/a	Template:N/a	Template:N/a	Template:Yes	Template:No	Template:Yes	Template:No	Template:N/a
Xiaowei	Tencent

Economic relevance

Digital experiences enabled by virtual assistants are considered to be among the major recent technological advances and most promising consumer trends. Experts claim that digital experiences will achieve a status-weight comparable to ‘real’ experiences, if not become more sought-after and prized.^[31] The trend is verified by a high number of frequent users and the substantial growth of worldwide user numbers of virtual digital assistants. In mid-2017, the number of frequent users of digital virtual assistants is estimated to be around 1bn worldwide.^[32] In addition, it can be observed that virtual digital assistant technology is no longer restricted to smartphone applications, but present across many industry sectors (incl. automotive, telecommunications, retail, healthcare and education).^[33] In response to the significant R&D expenses of firms across all sectors and an increasing implementation of mobile devices, the market for speech recognition technology is predicted to grow at a CAGR of 34.9% globally over the period of 2016 to 2024 and thereby surpass a global market size of USD 7.5 billion by 2024.^[33] According to an Ovum study, the "native digital assistant installed base" is projected to exceed the world's population by 2021, with 7.5 billion active voice AI–capable devices. ^[34] According to Ovum, by that time "Google Assistant will dominate the voice AI–capable device market with 23.3% market share, followed by Samsung's Bixby (14.5%), Apple's Siri (13.1%), Amazon's Alexa (3.9%), and Microsoft's Cortana (2.3%)."^[34]

Taking into consideration the regional distribution of market leaders, North American companies (e.g. Nuance Communications, IBM, eGain) are expected to dominate the industry over the next years, due to the significant impact of BYOD (Bring Your Own Device) and enterprise mobility business models. Furthermore, the increasing demand for smartphone-assisted platforms are expected to further boost the North American Intelligent Virtual Assistant (IVA) industry growth. Despite its smaller size in comparison to the North American market, the intelligent virtual assistant industry from the Asia-Pacific region, with its main players located in India and China is predicted to grow at an annual growth rate of 40% (above global average) over the 2016-2024 period.^[33]

Security

In May 2018, researchers from the University of California, Berkeley, published a paper that showed audio commands undetectable for the human ear could be directly embedded into music or spoken text, thereby manipulating virtual assistants into performing certain actions without the user taking note of it.^[35] The researchers made small changes to audio files, which cancelled out the sound patterns that speech recognition systems are meant to detect. These were replaced with sounds that would be interpreted differently by the system and command it to dial phone numbers, open websites or even transfer money.^[35] The possibility of this has been known since 2016,^[35] and affects devices from Apple, Amazon and Google.^[36]

References

1 }}

     | references-column-width 
     | references-column-count references-column-count-{{#if:1|30em}} }}
   | {{#if: 
     | references-column-width }} }}" style="{{#if: 30em
   | {{#iferror: {{#ifexpr: 30em > 1 }}
     | Template:Column-width
     | Template:Column-count }}
   | {{#if: 
     | Template:Column-width }} }} list-style-type: {{#switch: 
   | upper-alpha
   | upper-roman
   | lower-alpha
   | lower-greek
   | lower-roman = {{{group}}}
   | #default = decimal}};">

Template:Natural Language Processing Template:Intelligent personal assistant software

[1] Template:Cite web

[2] Template:Cite web

[spracherkennung1-3] 3.0 ^3.1 Template:Cite news

[4] Template:Cite web

[5] Template:Cite web

[6] Template:Cite web

[7] Template:Cite web

[8] Template:Cite web

[9] Template:Cite web

[10] Template:Cite web

[11] Template:Cite news

[12] Template:Cite web

[13] Template:Cite web

[14] Template:Cite video

[15] Template:Cite news

[16] Template:Cite web

[:0-17] Template:Cite book

[18] Template:Cite web

[19] Template:Cite web

[20] Template:Cite web

[21] Template:Cite book

[22] ttps://dl.acm.org/citation.cfm?id=2556288.2557085,%20http://dl.acm.org/citation.cfm?id=2611247.2557085

[23] Template:Cite arxiv

[24] Template:Cite web

[25] Template:Cite web

[26] Template:Cite web

[27] Template:Cite journal

[28] Template:Cite web

[29] Template:Cite news

[30] Template:Cite web

[31] Template:Cite web

[32] Template:Cite web

[wordpress1-33] 33.0 ^33.1 ^33.2 Template:Cite web

[:2-34] 34.0 ^34.1 Template:Cite web

[:1-35] 35.0 ^35.1 ^35.2 Template:Cite news

[36] Template:Cite news

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]

[14]

[15]

[16]

[17]

[18]

[19]

[20]

[21]

[22]

[23]

[24]

[25]

[26]

[27]

[28]

[29]

[30]

[31]

[32]

[33]

[34]

[35]

[36]