Developers Getting Access to NFC Transactions via the Secure Element in iOS 18.1 →

Linked By Federico Viticci

Earlier today, Apple announced another major new functionality coming to iOS 18.1: the ability for third-party apps to offer NFC transactions via the iPhone’s Secure Element:

Starting with iOS 18.1, developers will be able to offer NFC contactless transactions using the Secure Element from within their own apps on iPhone, separate from Apple Pay and Apple Wallet. Using the new NFC and SE (Secure Element) APIs, developers will be able to offer in-app contactless transactions for in-store payments, car keys, closed-loop transit, corporate badges, student IDs, home keys, hotel keys, merchant loyalty and rewards cards, and event tickets, with government IDs to be supported in the future.

This is coming in iOS 18.1, which will also mark the official debut of Apple Intelligence. Even better, Apple has published extensive documentation on the new APIs, from which I noticed one detail: in addition to overriding the iPhone’s side button double-click with a different app, a third-party app running in the foreground will still be able to initiate its own NFC transactions, even if you set a different default app.

Eligible apps running in the foreground can prevent the system default contactless app from launching and interfering with the NFC transaction.

And:

You can acquire a presentment intent assertion to suppress the default contactless app when the user expresses an active intent to perform an NFC transaction, like choosing a payment or closed-loop transit credential, or activating the presentment UI. You can only invoke the intent assertion capability when your app is in the foreground.

The irony of all this, of course, is that Apple is under regulatory scrutiny in both Europe and the United States regarding the inability for third-party developers to offer alternative wallets and tap-to-pay systems on iPhone. But as it’s becoming apparent lately, it seems there’s no greater project manager for new iOS features than the fear of regulation.

Permalink

EarPods Rule →

Linked By Federico Viticci

Even though we have a podcast together, I promise I did not talk to my friend Brendon about something I started doing myself last month: using EarPods – yes, the old wired ones – as my “universal earbuds” that can connect to just about anything these days. In any case, Brendon came to the same conclusion:

At the death of my most recent pair of Beats Fit Pro — the left earbud started to emit a loud electrical sound every so often or just disconnect entirely — I decided to give up on them for the time being. I instead bought some wired Apple EarPods which I haven’t used since the final days of the iPod. It’s hard to overstate how much I’ve loved having them with me for the past month.

And:

I’m not about to wax poetic about all of the ways using wired headphones in 2024 “changes everything” like a clickbaity YouTube video, but I will say that the proliferation of USB-C on pretty much every device is slowly returning the EarPods to their once-ubiquitous days of the 3.5mm jack. Yes I’m using them on my iPhone when I’m commuting, doing chores around the house, meditating, and what-have-you — but being able to plug them into my gaming devices, laptop, and tablet does in some ways feel like a return to form when it comes to ease of use.

I’m still using AirPods when I want to listen to music or podcasts without bothering my girlfriend at home or when I’m taking the dogs for a walk (although the Meta Ray-Bans have replaced a lot of my AirPods usage outdoors – something I plan to write about soon). A few weeks ago, however, fed up with limitations of Bluetooth multipoint-enabled earbuds, I thought: maybe I should just get Apple’s $20 USB-C EarPods and stop worrying about which wireless earbuds I use with my Apple devices and various gaming handhelds.

I’m here to tell you, like Brendon, that those $20 earbuds still rule. The ubiquity of USB-C means I can use them with my iPhone, iPad, Legion Go, Steam Deck, and even more novel devices such as the RG Cube and ROG Ally X (stay tuned for my thoughts on these on a future episode of NPC). I don’t have to worry about battery life, pairing, or latency. Sure, there’s a wire, and there’s no noise cancelling when using them – but these are my “downtime earbuds” anyway, so I don’t care.

Wireless earbuds – and specifically AirPods – are amazing. But if, like me, you often find yourself playing around with non-Apple devices and wishing you didn’t have to buy separate wireless earbuds for them…Apple’s EarPods are still great, and they’re better than ever thanks to USB-C.

Hear me out: a single cable standard that ensures headphones can work with any device, with no concerns regarding wireless protocols, batteries, and latency. What a concept, right?

Permalink

iOS 18 After One Month: Without AI, It’s Mostly About Apps and Customization

By Federico Viticci

iOS 18 launches in public beta today.

My experience with iOS 18 and iPadOS 18, launching today in public beta for everyone to try, has been characterized by smaller, yet welcome enhancements to Apple’s productivity apps, a redesign I was originally wrong about, and an emphasis on customization.

There’s a big omission looming over the rollout of these public betas, and that’s the absence of any Apple Intelligence functionalities that were showcased at WWDC. There’s no reworked Siri, no writing tools in text fields, no image generation via the dedicated Image Playground app, no redesigned Mail app. And that’s not to mention the AI features that we knew were slotted for 2025 and beyond, such as Siri eventually becoming more cognizant of app content and gaining the ability to operate more specifically inside apps.

As a result, these first public betas of iOS and iPadOS 18 may be – and rightfully so – boring for most people, unless you really happen to care about customization options or apps.

Fortunately, I do, which is why I’ve had a pleasant time with iOS and iPadOS 18 over the past month, noting improvements in my favorite system apps and customizing Control Center with new controls and pages. At the same time, however, I have to recognize that Apple’s focus this year was largely on AI; without it, it feels like the biggest part of the iOS 18 narrative is missing.

As you can imagine, I’m going to save a deeper, more detailed look at all the visual customization features and app-related changes in iOS and iPadOS 18 for my annual review later this year, where I also plan to talk about Apple’s approach to AI and what it’ll mean for our usage of iPhones and iPads.

For now, let’s take a look at the features and app updates I’ve enjoyed over the past month.

Apple Executives on the Photos Overhaul in iOS 18 →

Linked By Federico Viticci

Alvin Cabral, writing for The National, got a nice quote from Apple’s Billy Sorrentino on the redesigned Photos app in iOS 18:

“As our features, users and libraries have grown, so has the density of the [Photos] app. So rather than hunt and peck throughout, we’ve created a simple streamlined single view photos experience based on deep intelligence,” Billy Sorrentino, senior director at Apple’s human interface design unit, told The National.

“Ultimately, we wanted to remove friction” in how Photos is used, he added.

It’s been a few weeks since I installed iOS 18 on my primary iPhone, and I feel pretty confident in saying this: I was wrong about the new Photos app at first.

I’ll reserve more in-depth comments for the public beta and final release of iOS 18; of course, given the drastic redesign of the app, there’s also a chance Apple may scrap their plans and introduce a safer update with fewer structural changes. However, over the past few weeks, I noticed that not only do I find myself discovering more old photos in iOS 18, but the modular approach of the more customizable Photos app really works for me. I was able to fine-tune the top carousel to my liking, and I customized pinned collections with shortcuts to my favorite sections. Put simply, because of these changes, I use the Photos app a lot more and find navigating it faster than before.

Anecdotally, when I showed my girlfriend the new Photos app, she argued that the single-page design should be nicer than iOS 17 since she never used the other tabs in the app anyway. I don’t think she’s alone in that regard, which is why I believe Apple should stick with this major redesign this time around.

Permalink

iPadOS 18 Adds Support for Formatting External Drives →

Linked By Federico Viticci

Nice find by Kaleb Cadle in the first beta of iPadOS 18:

Now in the Files app on iPadOS 18, when we right click or hold press on an external drive and select “Erase”, new options appear for reformatting the drive. Currently, the format options here are APFS, ExFAT, and MS-DOS (FAT), the same format options available in Disc Utility. This is a major improvement for iPad power users and it will be interesting to keep an eye out for new improvements to this functionality and others within the Files app over the course of the iPadOS 18 beta cycle. It seems Apple may be taking a similar tact to the way they incorporated much of the functionality of the Preview app into the Files app via Quick Look, but now with functionality from Disc Utility.

Check out the blog post for a screenshot of what the feature looks like. Given the growing number of handhelds that store their games (or OS) on SD cards that I have to manage for NPC now, I’m very glad I no longer have to use my Mac to reformat those drives.

Permalink

The Issues of iPadOS 18’s New Tab Bars →

Linked By Federico Viticci

Earlier today on Mastodon, I shared some concerns regarding the Books app in iPadOS 18 and how Apple implemented the new tab bar design in the app. Effectively, by eschewing a sidebar, the app has returned to feeling like a blown-up iPhone version – something I hoped we had left behind when Apple announced they wanted to make iPad apps more desktop-class two years ago.

Unfortunately, it gets worse than Books. As documented by Nico Reese, the developer of Gamery, the new tab bars seem to fall short of matching the previous design’s visual affordances as well as flexibility for developers. For starters, the new tabs are just text labels, which may work well in English, but not necessarily other languages:

Since the inception of the iPhone, tabs in a tab bar have always included a glyph and a label. With the new tab style, the glyphs are gone. Glyphs play a crucial role in UX design, allowing users to quickly recognize parts of the app for fast interaction. Now, users need to read multiple text labels to find the content they want, which is slower to perceive and can cause issues in languages that generally use longer words, such as German. Additionally, because tab bars are now customizable, they can even scroll if too many tabs are added!

You’ll want to check out Nico’s examples here, but this point is spot-on: since tab bars now sit alongside toolbar items, the entire UI can get very condensed, with buttons often ending up hidden away in an overflow menu:

Although Apple’s goal was to save space on the iPad screen, in reality, it makes things even more condensed. Apps need to compress actions because they take up too much horizontal space in the navigation bar. This constant adjustment of button placement in the navigation bar as windows are resized prevents users from building muscle memory. The smaller the window gets, the more items collapse.

If the goal was to simplify the iPad’s UI, well, now iPad users will end up with three ways to navigate apps instead of two, with the default method (the top bar) now generally displaying fewer items than before, without glyphs to make them stand out:

For users, it can be confusing why the entire navigation scheme changes with window resizing, and now they must adjust to three different variations. Navigation controls can be located at the top, the bottom, or the left side (with the option to hide the sidebar!), which may not be very intuitive for users accustomed to consistent navigation patterns.

The best way I can describe this UI change is that it feels like something conceived by the same people who thought the compact tab bar in Safari for iPad was a good idea, down to how tabs hide other UI elements and make them less discoverable.

Nico’s post has more examples you should check out. I think Marcos Tanaka (who knows a thing or two about iPad apps) put it well:

It makes me quite sad that one of the three iPad-specific features we got this year seems to be missing the mark so far. I hope we’ll see some improvements and updates on this front over the next three months before this feature ships to iPad users.

Permalink

Designing Dark Mode App Icons →

Linked By Federico Viticci

Apple’s announcement of “dark mode” icons has me thinking about how I would approach adapting “light mode” icons for dark mode. I grabbed 12 icons we made at Parakeet for our clients to illustrate some ways of going about it.

Before that though, let’s take some inventory. Of the 28 icons in Apple’s preview image of this feature, only nine have white backgrounds in light mode. However, all icons in dark mode have black backgrounds.

Actually, it’s worth noting that five “light mode” icons have black backgrounds, which Apple slightly adjusted to have a consistent subtle black gradient found on all of their new dark mode icons. Four of these—Stocks, Wallet, TV, and Watch—all seem to be the same in both modes. However, no other (visible) icons are.

Fantastic showcase by Louie Mantia of how designers should approach the creation of dark mode Home Screen icons in iOS 18. In all the examples, I prefer Mantia’s take to the standard black background version.

See also: Gavin Nelson’s suggestion, Apple’s Human Interface Guidelines on dark mode icons, and the updated Apple Design Resources for iOS 18.

Permalink

Apple Details Its AI Foundation Models and Applebot Web Scraping →

Linked By Federico Viticci

From Apple’s Machine Learning Research¹ blog:

Our foundation models are trained on Apple’s AXLearn framework, an open-source project we released in 2023. It builds on top of JAX and XLA, and allows us to train the models with high efficiency and scalability on various training hardware and cloud platforms, including TPUs and both cloud and on-premise GPUs. We used a combination of data parallelism, tensor parallelism, sequence parallelism, and Fully Sharded Data Parallel (FSDP) to scale training along multiple dimensions such as data, model, and sequence length.

We train our foundation models on licensed data, including data selected to enhance specific features, as well as publicly available data collected by our web-crawler, AppleBot. Web publishers have the option to opt out of the use of their web content for Apple Intelligence training with a data usage control.

We never use our users’ private personal data or user interactions when training our foundation models, and we apply filters to remove personally identifiable information like social security and credit card numbers that are publicly available on the Internet. We also filter profanity and other low-quality content to prevent its inclusion in the training corpus. In addition to filtering, we perform data extraction, deduplication, and the application of a model-based classifier to identify high quality documents.

It’s a very technical read, but it shows how Apple approached building AI features in their products and how their on-device and server models compare to others in the industry (on servers, Apple claims their model is essentially neck and neck with GPT-4-Turbo, OpenAI’s older model).

This blog post, however, pretty much parallels my reaction to the WWDC keynote. Everything was fun and cool until they showed generative image creation that spits out slop “resembling” (strong word) other people; and in this post, everything was cool until they mentioned how – surprise! – Applebot had already indexed web content to train their model without publishers’ consent, who can only opt out now. (This was also confirmed by Apple executives elsewhere.)

As a creator and website owner, I guess that these things will never sit right with me. Why should we accept that certain data sets require a licensing fee but anything that is found “on the open web” can be mindlessly scraped, parsed, and regurgitated by an AI? Web publishers (and especially indie web publishers these days, who cannot afford lawsuits or hiring law firms to strike expensive deals) deserve better.

It’s disappointing to see Apple muddy an otherwise compelling set of features (some of which I really want to try) with practices that are no better than the rest of the industry.

How long until this become the ‘Apple Intelligence Research’ website? ↩︎

Permalink

iOS and iPadOS 18: The MacStories Overview

By Federico Viticci

Image: Apple.

At its WWDC 2024 keynote held earlier today online and with an in-person event at Apple Park in Cupertino, California, Apple officially announced the next versions of the operating systems for iPhone and iPad – iOS and iPadOS 18.

As widely speculated in the lead up to the event, Apple’s focus for both OSes largely revolves around artificial intelligence, or as the company likes to refer to the AI acronym now, “Apple Intelligence”. The new AI features in iOS and iPadOS promise to make both operating systems, well, more intelligent than before thanks to a completely revamped Siri and proactive functionalities that learn from users’ habits and apps. Presented as a fast, private, and personal set of features that draws from the user’s context and combines it with generative models, Apple Intelligence – which will debut in U.S. English only later this year, with a beta expected later this summer – will power a variety of new system features and experiences, starting from a revamped Siri and text analysis features to image creation, performing actions inside apps, and more.

But AI-related improvements aren’t the only new features Apple announced today. From a renewed focus on Home Screen customization and redesigned Control Center to a new design for tab bars on iPad and expanded Tapbacks in Messages, Apple has showed that, while they can follow the rest of the tech industry in rethinking how AI can enhance how we use our devices, they can continue shipping other functionalities for iPhone and iPad, too. Or, at the very least, they certainly can for the iPhone and iOS.

We’ll have in-depth overviews for both iOS and iPadOS 18 when the public betas for each OS come out next month, and, of course, we’ll continue diving into the announcements later this week on MacStories via our WWDC 2024 hub as well as AppStories. We’ll also have a dedicated story about Apple Intelligence coming later on MacStories with the highlights of all the AI-infused features announced by Apple today.

In the meantime, here’s a recap of everything else that Apple showed today for iOS and iPadOS 18.

This Week's Sponsor: