This Week's Sponsor:

Washing Machine X9

Spring Clean Your Mac Effortlessly

Posts tagged with "siri"

Smart Speakers and Speech Impairment→

Steven Aquino covers an important accessibility angle of smart speakers that I’ve never truly considered:

Since the HomePod started shipping last week, I’ve taken to Twitter on multiple occasions to (rightfully) rant about the inability of Siri—and its competitors—to parse non-fluent speech. By “non-fluent speech,” I’m mostly referring to stutterers because I am one, but it equally applies to others, such as deaf speakers.

This is a topic I’ve covered before. There has been much talk about Apple’s prospects in the smart speaker market; the consensus seems to be the company lags behind Amazon and Google because Alexa and Google Home are smarter than Siri. What is missing from these discussions and from reviews of these products is the accessibility of a HomePod or Echo or Sonos.

As I see it, this lack of consideration, whether intentional or not, overlooks a crucial part of a speaker product’s story. Smart speakers are a unique product, accessibility-wise, insofar as the voice-first interaction model presents an interesting set of conditions. You can accommodate for blindness and low vision with adjustable font sizes and screen readers. You can accommodate physical motor delays with switches. You can accommodate deafness and hard-of-hearing with closed captioning and using the camera’s flash for alerts.

But how do you accommodate for a speech impairment?

A human assistant would know how to deal with stuttering, dialects, or even just the need to repeat a part of a sentence you got wrong. None of the modern digital assistants currently goes beyond being a slightly humanized command line activated by voice, and I wonder who will get there first.

Permalink

Loup Ventures’ HomePod Siri Tests→

Loup Ventures, a US-based venture capital firm, ran a series of Siri tests on the HomePod to evaluate the assistant’s capabilities on Apple’s new speaker. After 782 queries, Siri understood 99% of questions but only answered 52% of them correctly – meaning, Siri on the HomePod failed to answer one out of two questions. I’d love to see a full data set of the questions asked by Loup Ventures, but, overall, it doesn’t surprise me that the Google Assistant running on the Google Home speaker was the most accurate in every category.

While Apple has clearly a lot of work ahead for Siri on the HomePod (this was the consensus of all the reviews, too), it also appears that Siri simply performs worse than other assistants because it doesn’t support certain domains. Here’s Gene Munster (whom you may remember for his Apple TV set predictions), writing on the Loup Ventures blog:

Adding domains will quickly improve Siri’s score. Some domains like navigation, calendar, email, and calling are simply not supported. These questions were met with, “I can’t ___ on HomePod.” Also, in any case that iPhone-based Siri would bring up Google search results, HomePod would reply, “I can’t get the answer to that on HomePod,” which forces you to use your phone or give up on the question altogether. Removing navigation, calling, email, and calendar-related queries from our question set yields a 67% correct response, a jump from overall of 52.3% correct. This means added support for these domains would bring HomePod performance above that of Alexa (64%) and Cortana (57%), though still shy of Google Home (81%). We know Siri has the ability to correctly answer a whole range of queries that HomePod cannot, evidenced by our note here. Apple’s limiting of HomePod’s domains should change over time, at which point we expect the speaker to be vastly more useful and integrated with your other Apple devices.

Adding new supported domains would make Siri’s intelligence comparable to Alexa (at least according to these tests), but Apple shouldn’t strive for a honorable second place. Siri should be just as intelligent (if not more) than the Google Assistant on every platform. I wonder, though, if this can be achieved in the short term given Siri’s fragmentation problems and limited third-party integrations.

Permalink

The Problem of Many Siris→

Bryan Irace writes about one of the biggest challenges Apple faces with Siri:

It’s no easy task for a voice assistant to win over new users in 2018, despite having improved quite a great deal in recent years. These assistants can be delightful and freeing when they work well, but when they don’t, they have a tendency to make users feel embarrassed and frustrated in a way that GUI software rarely does. If one of your first voice experiences doesn’t go the way you expected it to – especially in front of other people – who could blame you for reverting back to more comfortable methods of interaction? Already facing this fundamental challenge, Apple is not doing themselves any favors by layering on the additional cognitive overhead of a heavily fragmented Siri experience.

I think Irace is right on in this observation – Siri’s fragmentation is a real problem.

On the more optimistic side, it could be taken as good news that the fix appears fairly obvious: create a single Siri that’s consistent across all platforms. This seems like it would be a clear net positive, even though such a change could reduce Siri’s accuracy in some cases; for example, I’m guessing Siri on the Apple TV is currently tuned to expect TV and movie queries more than anything else, so it can more effectively produce the right kind of results – tweak that tuning, and Apple will have to work even harder at helping Siri understand context.

One thing that’s concerning about the apparent simplicity of this fix is that Apple hasn’t made it yet, meaning, perhaps, that the company thinks there’s nothing wrong with Siri’s current fragmentation. This conversation would be different entirely if Apple had begun showing an increased effort to unify Siri across its platforms, but recently, the opposite has been true instead. The latest major Apple product, HomePod, includes a stripped-down Siri that can’t even handle calendar requests. And SiriKit, which launched less than two years ago, was designed in a way that fundamentally increases fragmentation. Irace remarks:

If the Lyft app is installed on your iPhone, you can ask Phone Siri to order you a car. But you can’t ask Mac Siri to do the same, because she doesn’t know what Lyft is. Compare and contrast this with the SDKs for Alexa and the Google Assistant – they each run third-party software server-side, such that installing the Lyft Alexa “skill” once gives Alexa the ability to summon a ride regardless of if you’re talking to her on an Echo in your bedroom, a different Echo in your living room, or via the Alexa app on your phone.

The only recent occasion that comes to mind when Siri has moved in the right direction – gaining knowledge on one platform that previously existed only on another – was when iOS 10.2 brought the full wealth of Apple TV Siri’s movie and TV expertise to iOS. This only happened, though, because iOS 10.2 introduced the TV app.

Until Siri can answer the same requests regardless of what platform you’re on, most people simply won’t learn to trust it. Users shouldn’t have to remember which device’s Siri can answer which questions – all they should have to remember is those two key words: “Hey Siri.”

Permalink

HomePod Review Roundup

Initial orders of Apple’s new HomePod smart speaker will arrive on doorsteps and in Apple stores beginning Friday in the US, UK, and Australia. Today, reviews were published by several media outlets that have had about a week to test the HomePod. Apple also invited several journalists for a tour of its audio labs in Cupertino with Phil Schiller, hardware VP Kate Bergeron, and senior director of audio design and engineering Gary Greaves.

The consensus of the first wave of reviews is that the HomePod sounds fantastic. Apple has brought its engineering expertise and computing power to bear in a way that reviewers say produces remarkable sound for the HomePod’s size and price.

However, Siri’s limitations and the lack of support for third-party music streaming services also mean that the HomePod’s voice assistant features lag behind those of the Amazon Echo and Google Home. As a result, the HomePod’s appeal will likely be limited to people who already subscribe to Apple Music, use iOS devices, and care about high-quality audio.

Matthew Panzarino of TechCrunch:

Apple’s HomePod is easily the best sounding mainstream smart speaker ever. It’s got better separation and bass response than anything else in its size and boasts a nuance and subtlety of sound that pays off the 7 years Apple has been working on it.

As a smart speaker, it offers best-in-class voice recognition, vastly outstripping the ability of other smart speakers to hear you trying to trigger a command at a distance or while music is playing, but its overall flexibility is limited by the limited command sets that the Siri protocol offers.

Buy a HomePod if you already have Apple Music or you want to have it and you’re in the market for a single incredibly over-designed and radically impressive speaker that will give you really great sound with basically no tuning, fussing, measuring or tweaking.

Nilay Patel sums up what that means for everyone else:

The Apple engineers I talked to were very proud of how the HomePod sounds, and for good reason: Apple’s audio engineering team did something really clever and new with the HomePod, and it really works. I’m not sure there’s anything out there that sounds better for the price, or even several times the price.

Unfortunately, Apple’s audio engineering team wasn’t in charge of just putting out a speaker. It was in charge of the audio components of a smart speaker, one that simply isn’t as smart as its competitors.

That’s really the crux of it: the HomePod sounds incredible, but not so world-bendingly amazing that you should switch away from Spotify, or accept Siri’s frustrating limitations as compared to Alexa.

Read more

iPad Diaries: ‘Type to Siri’ as a Smart Command Line

iPad Diaries is a regular series about using the iPad as a primary computer. You can find more installments here and subscribe to the dedicated RSS feed.

A couple of weeks ago, I shared a series of pictures on Twitter showing how I had been using iOS 11’s Type to Siri feature on my iPad Pro, which is always connected to an external keyboard when I’m working.

I did not expect that offhanded tweet – and its “smart command line” description – to be so interesting for readers who replied or emailed me with a variety of questions about Type to Siri. Thus, as is customary for tweets that end up generating more questions than retweets, it’s time to elaborate with a blog post.

In this week’s iPad Diaries column, I’ll be taking a closer look at Type to Siri, my keyboard setup, and the commands I frequently use for Siri on my iPad; I will also detail some features that didn’t work as expected along with wishes for future updates to Siri.

Read more

Apple Shares First Series of HomePod Ads→

Joe Rossignol, writing for MacRumors:

Apple today shared its first series of HomePod ads on its official YouTube channel, titled Bass, Beat, Distortion, and Equalizer.
[…]
The music-focused ads are each set to their own song, including Ain’t I by Lizzo, DNA by Kendrick Lamar, Holy Water by Hembree, and All Night by Big Boi. Apple continues to position the HomePod as a “breakthrough speaker” first and “intelligent home assistant” second in the description of each video.

If there was any doubt on how Apple is trying to position the HomePod, these ads have no mention – visual or otherwise – of Siri functionalities at all. They’re just about music. (Personally, I love the style and animations.)

As someone who actually believes in the utility of smart speakers, I’m curious to see how this strategy will play out for Apple this year, and if they’re going to air “lifestyle” HomePod + Siri commercials at some point (as they did many times before).

Permalink

Apple Announces HomePod Available to Order This Friday, In Stores on February 9

Today in a press release, Apple announced that its HomePod device will be available to order beginning this Friday (January 26) for the previously announced price of $349, and will ship for a release date of Friday, February 9. HomePod will be available in two color options: White and Space Gray.

HomePod was first unveiled last June during Apple’s WWDC keynote, with an announced ship date of December. It wasn’t able to make that date, receiving a new ‘Early 2018’ estimated release in mid-November. Historically, that kind of designation has meant anytime up through April is possible. Fortunately, prospective HomePod buyers won’t have to wait quite that long.

As Apple’s first entry into the smart speaker market, HomePod is the company’s answer to popular products like the Amazon Echo and Google Home. Unlike those other devices, however, HomePod is being marketed more as a premium-quality speaker, primed for music playback, than as a digital assistant hub. Siri is certainly an important component of the device, but at least for now, its role is being somewhat downplayed. At WWDC Phil Schiller announced that at launch, the HomePod’s version of Siri will only support a limited number of domains.

While these domains cover the majority of Siri’s normal functionality on iOS devices, some notable categories missing that would make sense for the HomePod include calendars, audiobook playback using iBooks, and Notes. With the HomePod’s release so early in the year, it’s possible we’ll receive word on additional domains at WWDC this June. Until then, what you’re getting with HomePod is exactly what Apple announced onstage: a powerful home speaker with Apple Music integration, which also happens to be a HomeKit hub that includes Siri, but in limited capacity.

One standout piece of news in today’s announcement is that the HomePod’s multi-room audio capabilities won’t be available at launch, but instead will come later through a software update. This seemingly supports previous rumors that AirPlay 2’s development may have been what led to HomePod’s initial delay.

Update: The HomePod page on Apple’s website confirms that not only is AirPlay 2’s multi-room support delayed until later this year, but so is the previously demoed capability to have two HomePods pair together for offering stereo sound.

The HomePod website also provides new details on how users will be able to interact with HomePod in non-voice ways. In addition to using the ‘Hey Siri’ trigger phrase, you can also touch and hold the top of the HomePod and talk to Siri. There are also controls for audio playback tied to different sets of taps on the HomePod’s surface, as shown below.

Apple and the Alexa Ecosystem

I recently read two interesting takes on the ever-growing Alexa ecosystem as it relates to Apple that made me think about the future of Siri and HomeKit. Here’s M.G. Siegler on Amazon’s plan to put Alexa everywhere:

The Echo Dot was the number one selling device across all of Amazon during the holiday shopping season. (The Fire TV stick with the Alexa-enabled remote was the second-most popular product.) Again, no absolute sales numbers beyond “tens of millions of Alexa-enabled devices” — more than we usually get, by the way — but no matter: tens of millions is impressive enough.

I’ve been thinking about this recently not just in the context of putting Echoes in hotels, but also relative to Apple. As we’re all well aware, Apple had to delay their foray into the space, the HomePod, into 2018. But not only did they miss the all-important holiday shopping season, I’m increasingly thinking that they may have missed the boat.

Believe me, I know how dangerous this line of thinking is with regard to Apple. Apple is almost never the first-mover in a market. Instead, they prefer to sit back and let markets mature enough to then swoop in with their effort, which more often than not is the best effort (this is both subjective in terms of my own taste, and often objective in terms of sales). But again, I increasingly don’t believe that this will be the case with their smart speaker.

Amazon has entered the speaker and home automation market with Alexa-enabled devices in two ways: first with their own Echo products, then with a growing roster of third-party manufacturers that are baking Alexa into their devices and almost treating Amazon’s assistant as a “standard” feature like WiFi or Bluetooth. There’s a fascinating parallel between Amazon Web Services – a suite of components embedded in the majority of modern websites and web apps – and Alexa Voice Service – a suite of voice APIs now embedded in hundreds of automation devices, general-purpose accessories and appliances, and web services.

Here’s Ben Bajarin on what Alexa’s presence at CES tells us about the ecosystem surrounding Apple:

While many Apple defenders want to dismiss the momentum we are observing with the Amazon ecosystem on display here at CES, while Amazon is similarly not present just like Apple, I believe it is a mistake to do so.

It is easy to say that because Apple was never present at CES that the show didn’t mean something to them or their ecosystem. It is easy, and correct to say that CES was not, or never was, a measure of the health of Apple’s products. It is, however, incorrect and dangerous to miss that CES had been, for some time, a barometer for the health of Apple’s ecosystem.

As I mentioned, our ability to measure any platforms ecosystem from what we observe at CES, is the main reason so many are paying attention to what is happening with Amazon’s Alexa platform. Google Assistant is certainly more present than it was last year, however, when you look at how third parties are talking about-and marketing-their support of these assistants they are putting significantly more effort into talking about Alexa than Google Assistant. Which is a telling signal. Again, to reiterate this point, third parties used to market, and spend energy talking about their integration with iOS or support of iPhone/iPad with the same rigor they are now talking about Amazon’s Alexa. This can not be ignored.

You could argue that most Apple-compatible gadgets and accessories announced at CES used to appear in tech blogs only to be forgotten a few months later because they were fads, vaporware, or ultimately not essential to the growth of the iOS ecosystem, and that the same will happen with Alexa-enabled devices we’ve seen this year. The difference, I think, is that this new generation of home automation products is an ecosystem in itself with higher value than, say, the iPad keyboards or stylii we used to see at CES. Alexa hasn’t “won”, but it has momentum among third-party companies making products that are or will soon be in our homes, sharing the same space of our TVs, routers, consoles, and mobile devices.

Read more

SiriKit Support Will Be Included on HomePod for Certain Third-Party App Domains

In an update on its developer site today, Apple announced that SiriKit support will be included in the forthcoming HomePod device.

iOS 11.2 introduces SiriKit for HomePod, the powerful speaker that sounds amazing, adapts to wherever it’s playing, and provides instant access to Apple Music. HomePod is also a helpful home assistant for everyday questions and tasks. With the intelligence of Siri, users control HomePod through natural voice interaction. And with SiriKit, users can access iOS apps for Messaging, Lists, and Notes. Make sure your SiriKit integration is up to date and test your app’s voice-only experience today.

When the HomePod was first unveiled at WWDC in June, there was no word regarding whether it would support third-party apps through SiriKit. While some expected further details on HomePod to arrive in September’s keynote, that event came and went with no news. Today marks the first time we’ve learned anything new about HomePod from official sources since its initial introduction.

Messaging, Lists, and Notes are the only SiriKit domains that will work with HomePod at launch, but it’s likely we’ll see more added over time. This means the HomePod will be able to do things like send messages in Telegram, create tasks in Todoist or Things, and create notes in Evernote.

Information about how SiriKit on HomePod will work is included on Apple’s full SiriKit site, which contains the following detail:

Siri recognizes SiriKit requests made on HomePod and sends those requests to the user’s iOS device for processing.

This means SiriKit support on HomePod will take a fundamentally different path than that of competing products like the Amazon Echo. In most cases the Echo’s set of third-party Alexa skills can be operated completely independent of another device. For the time being at least, third-party support on HomePod will rely on a nearby iPhone or iPad.

There are still many HomePod details that remain unclear. For example, we don’t yet know if SiriKit requests or iCloud requests will be tied to a single user’s device, or if a family will be able to interact with the device in a user-specific way. Time will bring the full story into view, but for now, knowing that HomePod will launch with at least some third-party app support is good news.