Posts tagged with "macOS Sequoia"

Apple Reveals A Partial Timeline for the Rollout of More Apple Intelligence Features

Last week, Apple released the first developer betas of iOS 18.2, iPadOS 18.2, and macOS 15.2, which the press speculated would be out by the end of the year. It turns out that was a good call because today, Apple confirmed that timing. In its press release about the Apple Intelligence features released today, Apple revealed that the next round is coming in December and will include the following:

  • Users will be able to describe changes they want made to text using Writing Tools. For example, you can have text rewritten with a certain tone or in the form of a poem.
  • ChatGPT will be available in Writing Tools and when using Siri.
  • Image Playground will allow users to create images with Apple’s generative AI model.
  • Users will be able to use prompts to create Genmoji, custom emoji-style images that can be sent to friends in iMessage and used as stickers.
  • Visual intelligence will be available via the Camera Control on the iPhone 16 and iPhone 16 Pro. The feature will allow users to point the iPhone’s camera at something and learn about it from Google or ChatGPT. Apple also mentions that visual intelligence will work with other unspecified “third-party tools.”
  • Apple Intelligence will be available in localized English in Australia, Canada, Ireland, New Zealand, South Africa, and the U.K.

Apple’s press release also explains when other languages are coming:

…in April, a software update will deliver expanded language support, with more coming throughout the year. Chinese, English (India), English (Singapore), French, German, Italian, Japanese, Korean, Portuguese, Spanish, Vietnamese, and other languages will be supported.

And Apple’s Newsroom in Ireland offers information on the Apple Intelligence rollout in the EU:

Mac users in the EU can access Apple Intelligence in U.S. English with macOS Sequoia 15.1. This April, Apple Intelligence features will start to roll out to iPhone and iPad users in the EU. This will include many of the core features of Apple Intelligence, including Writing Tools, Genmoji, a redesigned Siri with richer language understanding, ChatGPT integration, and more.

It’s a shame it’s going to be another six months before EU customers can take advantage of Apple Intelligence features on their iPhones and iPads, but it’s nonetheless good to hear when it will happen.

It’s also worth noting that the timing of other pieces of Apple Intelligence is unclear. There is still no word on precisely when Siri will gain knowledge of your personal context or perform actions in apps on your behalf, for instance. Even so, today’s reveal is more than Apple usually shares, which is both nice and a sign of the importance the company places on these features.

New Developer Betas Released for iOS, iPadOS, and macOS with Image Playground, ChatGPT Integration, and More Apple Intelligence Features

iOS 18.1, iPadOS 18.1, and macOS 15.1 aren’t quite out the door, but Apple has already updated its developer betas with the next round of upcoming Apple Intelligence features. Developer betas of iOS 18.2, iPadOS 18.2, and macOS 15.2 are now available for download and include the following:

  • image generation in the form of Image Playground and Image Wand;
  • Genmoji (iOS and iPadOS only)
  • Visual Intelligence (iPhone 16 line only)
  • ChatGPT integration with Siri; and
  • new text manipulation features.
Image Playground. Source: Apple.

Image Playground. Source: Apple.

Image Playground is a feature that allows you to create images in two styles using in-app themes and other tools. Image Playground is available in apps like Messages, Freeform, Pages, and Keynote, but it’s also a standalone app. Regardless of where you use it, Image Playground looks like it’s designed to make it easy to create animated and sketch-style images using a variety of tools such as suggested concepts that pull from the context the image is created in, like a Messages thread. Creations can be previewed, there’s a history feature that allows you to undo changes made to images, and images are saved to an Image Playground Library that syncs across devices via iCloud.

Image Wand. Source: Apple.

Image Wand. Source: Apple.

Image Wand, which appears in the Apple Pencil tool palette, takes a rough hand-drawn sketch, photo, or note and turns any of them into an image similar to one created by Image Playground. Image Wand can be further refined by adding text, and if you circle a blank space, it will use surrounding text to build an image.

Also, Genmoji – which is only in the iOS and iPadOS betas for now – allows you to create emoji-style images that can be used in Messages and other apps as decorative stickers. Inputs can include a text description, people in your contacts, friends and family recognized in Photos, and characters created from whole cloth.

Visual Intelligence has been added to the Camera Control on the iPhone 16 line too. The feature lets you look up details about a place and work with text, copying, reading, summarizing, and translating it.

The next betas also integrate ChatGPT into Siri. As demoed at WWDC, you can opt to pose queries to ChatGPT without disclosing you identity or IP address and without the prompts being used to train OpenAI’s large language models. The ChatGPT integration is free and does not require an account with OpenAI either.

Writing Tools lets you describe your text changes in iOS 18.2, iPadOS 18.2, and macOS 15.2.

Writing Tools lets you describe your text changes in iOS 18.2, iPadOS 18.2, and macOS 15.2.

Finally, Apple has built a new Writing Tool that provides additional flexibility when manipulating text. From the Writing Tools UI, you’ll be able to submit a prompt to alter any text you’ve written. For instance, you could have Apple Intelligence make you sound more excited in your message or rewrite it in the form of a poem, neither of which is possible with the Writing Tools found in iOS and iPadOS 18.1 or macOS 15.1.

For developers, there are also new APIs for Writing Tools, Genmoji, and Image Playground.

As we’ve covered before, Apple’s AI models have been trained on a mix of licensed data and content from the web. If you’re a publisher or a creator who doesn’t want to be part of those models, you can opt out, but it doesn’t work retroactively. In other words, opting out won’t remove any data already ingested by Apple’s web crawlers, but it will work going forward.

I’m not a fan of generative AI tools, but I am looking forward to finally going beyond tightly controlled demos of these features. I want to see how well they work in practice and compare them to other AI tools. Apple appears to have put a lot of guardrails in place to avoid some of the disasters that have befallen other tech companies, but I’m pretty good at breaking software. It will be interesting to see how well these tools hold up under pressure.

macOS Sequoia: The MacStories Review

Sequoia is unlike any major macOS update in recent memory. Annual OS releases usually tell two stories. The first is the tale of that release, which consists of a combination of design, system, and built-in app changes that add to the existing Mac experience. The second story plays out over time, taking multiple years to unfold and reveal itself. The best macOS releases are those that strike a balance between the two.

Often, a macOS update’s multi-year story revolves around new developer technologies that signal a change in direction for the entire platform. Swift and Catalyst were like that. Neither had an immediate impact on the day-to-day experience of using a Mac. However, even though the final destination wasn’t entirely clear at first, the corresponding macOS releases included concrete first steps that provided a sense of where the Mac was heading.

It’s possible to look at macOS Sequoia and see something similar, but the resemblance is only skin deep. This year’s release includes meaningful updates to system apps and even a brand new one, Passwords. Plus, Apple Intelligence promises long-term, fundamental changes to how people use their Macs and will likely take years to fully realize.

But Sequoia feels fundamentally different from Swift, Catalyst, and other past releases. It’s light on new features, the design changes are few and far between, and Apple Intelligence isn’t part of macOS 15.0 at all – although more features are on the way and are currently part of the macOS 15.1 developer beta. So what sets Sequoia apart isn’t so much what you can do with it out of the box; what’s unique about this release is that you could install it and not even notice the changes.

That’s not to say that Sequoia is a bad update. There’s more to like than not, with excellent additions like iPhone Mirroring, window tiling, the new Passwords app, and Safari’s video viewer. The trouble is that the list of changes, good or bad, falls off steeply after that. A half loaf may be better than none, but Apple has taught us to expect more, which makes Sequoia vaguely unsatisfying and out of balance compared to other releases.

It’s clear is that Apple is placing a big bet that artificial intelligence will pay off for macOS the same way magic beans did for Jack and his mother. The question heading into macOS 15.1 and beyond is whether Apple’s beans are magical too. Perhaps they are, but based on what I’ve seen of macOS 15.1, I’m not feeling the magic yet. I’ll reserve judgement and revisit Apple Intelligence as it’s incrementally rolled out in the coming months. For now, though, let’s consider macOS Sequoia 15.0’s morsels that readers can actually dig into today.

Read more

    iOS and iPadOS 18 Review Extras: eBooks, Wallpapers, Screen Saver, and a Special Edition of MacStories Weekly

    A short time ago, Federico published his annual iOS and iPadOS 18 review. As in past years, we’re releasing a wide variety of perks exclusively for Club MacStories members throughout the week, but this year, the perks are a little different – just like the review.

    Here’s our friend Chris Lawley with the details:

    First of all, we’re releasing this week’s episode of AppStories+ to everyone who listens to the show for free.

    AppStories+ is the extended version of our flagship podcast that’s typically released a day early and ad-free in high-bitrate audio. The show is part of a Club Premier or AppStories+ subscription, but this week, everyone gets the extended version of the show. If you’re not a subscriber, you’ll still get an ad with the episode (we do have bills to pay), but you’ll also get the full extended version of the episode in high bitrate audio, just like subscribers. It’s our way of saying thanks to everyone who has listened to AppStories through the years and share why this year’s review is not just different, but part of an editorial evolution of MacStories.

    As Chris explains in his video, we have an eBook version of the review for all Club members. We’ll also publish a special making-of edition of MacStories Weekly, our Club newsletter, on Saturday.

    If you’re not already a member, you can join Club MacStories for $5/month or $50/year using the buttons below:

    A short sample of one of the six screen savers for Club Plus and Premier members.

    A short sample of one of the six screen savers for Club Plus and Premier members.

    Also, this year, there will be even more perks than ever for Club MacStories Plus and Premier members, including:

    • More eBooks of my macOS Sequoia review, Jonathan Reed’s watchOS 11 review, and Devon Dundee’s visionOS 2 review;
    • A bonus eBook that collects tips and tricks from Federico’s iOS and iPadOS 18 review;
    • High-res wallpapers of the delightful illustrations created for Federico’s review by Scout Wilkinson; and
    • A screen saver developed by James Thomson that brings Scout’s artwork to life on your Mac.

    To unlock all of these additional perks, use the buttons below to join Club MacStories Plus:

    or Club Premier:

    Now more than ever, an indie publication like MacStories depends on income from members who want to directly support what we do and our ability to collaborate with people like Scout and James more often. As always, though, we aim to provide as much value as we can to Club members, so we have more details after the break, for anyone who wants to learn more about this year’s perks and Club MacStories before joining.

    Read more

    macOS Sequoia: The MacStories Public Beta Preview

    Sequoia is not your typical macOS release. In recent years, new features of all Apple OSes have been increasingly meted out over time instead of dropping all at once in the fall. That’s been true of macOS, too, but this year, the magnitude of the staged release will be more pronounced, which has trickled through to the public beta released today.

    macOS Sequoia will be a phased release. That means you won’t find everything announced at WWDC in the public beta. Some features, notably large parts of Apple Intelligence, won’t be available until 2025. That’s something worth keeping in mind if you’re thinking about installing the Sequoia public beta today. The beta is generally stable, but you’re likely to run into bugs, and with many features still to come in the months ahead, the upside of running it is more limited than in past years.

    Apple Intelligence promises to round out Sequoia over time, but neither I nor anyone else outside of Apple has had a chance to try those features yet. So, for now, let’s focus on what you can expect if you install the macOS Sequoia public beta today.

    Read more

    macOS Sequoia: The MacStories Overview

    At its WWDC 2024 keynote held earlier today, Apple officially announced the next version of macOS, macOS Sequoia. As per its naming tradition over the past decade, this new release is once again named after a location in California; the version number for macOS Sequoia will be macOS 15.

    Apart from the substantial Apple Intelligence features that were announced today for all of its main platforms, Apple introduced some welcome improvements to its desktop operating system. The new features include enhancements across multiple native apps, an impressive new iPhone mirroring integration, and even some overdue window management features for the Mac.

    Here’s a recap of everything that Apple showed off today for macOS Sequoia.

    Read more