This Week's Sponsor:

Incogni

Put an End to Spam, Scams, and Robocalls on Your iPhone

Posts tagged with "automation"

Automation April: The Loupedeck Live S Is a More Portable and Affordable Automation Control Panel for the Mac

In 2021, I reviewed the Loupedeck Live, a programmable control panel for the Mac and Windows PCs for Club MacStories members as part of my Macintosh Desktop Experience column. It’s an excellent device, but its price put it at a disadvantage to a similarly-sized Elgato Stream Deck despite several other advantages that I explained in the review.

Last year, Loupedeck released the Loupedeck Live S, a smaller, more affordable Loupedeck that retains the core experience of the Loupedeck Live, but dispenses with a handful of physical buttons and dials. The new device retails for $189 compared to the Loupedeck Live, which is $269. That’s still $40 more than the 15-button Stream Deck MK.2, but a significantly narrower difference for a device that offers a wider range of functionality, making it worth another look if you were put off by the Loupedeck Live’s price.

Read more

S-GPT 1.0.1→

I just released a small bug fix update for S-GPT, my shortcut to integrate OpenAI’s ChatGPT large language model with the Shortcuts app on all Apple platforms.

Version 1.0.1 of S-GPT is a relatively minor update that comes with an initial round of improvements based on early feedback I’ve received for the shortcut, including:

  • A proper error-checking alert that tells what went wrong with a request to the ChatGPT API;
  • A better summarization of Safari webpages passed from the share sheet that no longer “hallucinates” results but actually summarizes text extracted via Safari’s Reader technology from any web article;
  • A new behavior for text input on watchOS, which now defaults to dictation rather than keyboard input. I’ve covered this more in detail in today’s issue of MacStories Weekly for Club members.

Additionally, I also realized that the usage tips that S-GPT was displaying every time it asked you to enter some text may have been nice the first three times you used the shortcut, but became annoying very quickly. That was especially true when using S-GPT with Siri in a voice context since they would be read aloud every time. For these reasons, I removed tips and simplified the shortcut’s questions to “What do you want to ask?” and “Want to follow up?”.

In case you missed my introduction of S-GPT earlier this week, you can read the original story here and find out more about how the shortcut works and what it does. I updated the links to the S-GPT and S-GPT Encoder shortcuts in the story to the latest version; you can also find the updated shortcuts in MacStories Shortcuts Archive.

I just released a small bug fix update for S-GPT, my shortcut to integrate OpenAI’s ChatGPT large language model with the Shortcuts app on all Apple platforms.

Version 1.0.1 of S-GPT is a relatively minor update that comes with an initial round of improvements based on early feedback I’ve received for the shortcut, including:

  • A proper error-checking alert that tells what went wrong with a request to the ChatGPT API;
  • A better summarization of Safari webpages passed from the share sheet that no longer “hallucinates” results but actually summarizes text extracted via Safari’s Reader technology from any web article;
  • A new behavior for text input on watchOS, which now defaults to dictation rather than keyboard input. I’ve covered this more in detail in today’s issue of MacStories Weekly for Club members.

Additionally, I also realized that the usage tips that S-GPT was displaying every time it asked you to enter some text may have been nice the first three times you used the shortcut, but became annoying very quickly. That was especially true when using S-GPT with Siri in a voice context since they would be read aloud every time. For these reasons, I removed tips and simplified the shortcut’s questions to “What do you want to ask?” and “Want to follow up?”.

In case you missed my introduction of S-GPT earlier this week, you can read the original story here and find out more about how the shortcut works and what it does. I updated the links to the S-GPT and S-GPT Encoder shortcuts in the story to the latest version; you can also find the updated shortcuts in MacStories Shortcuts Archive.

S-GPT

S-GPT is a shortcut to have conversations with OpenAI’s ChatGPT assistant on your iPhone, iPad, and Mac. The shortcut supports both text conversations as well as voice interactions when used inside Siri. S-GPT comes with native system integrations on Apple platforms including the ability to process text from your clipboard, summarize text found in photos, export conversations to Files and Finder, and even create playlists in the Music app. The shortcut requires an OpenAI API token and a helper shortcut called S-GPT Encoder that needs to be downloaded separately.

Get the shortcut here.

S-GPT Encoder

This is a helper shortcut for S-GPT that needs to be downloaded and installed separately. Without this shortcut, S-GPT won’t work.

Get the shortcut here.

Permalink

Introducing S-GPT, A Shortcut to Connect OpenAI’s ChatGPT with Native Features of Apple’s Operating Systems

S-GPT for Shortcuts.

S-GPT for Shortcuts.

Update, April 13: I’ve updated S-GPT to version 1.0.2. You can read the full changelog here. All download links have been updated.

Update, April 13: For Club MacStories+ and Premier members, I’ve published Part 1 of an extensive ‘Making Of’ series about S-GPT. This is a technical deep dive for my Automation Academy series. You can find it here and sign up for or upgrade to a Premier account using the buttons below.

Update, April 7: For Club MacStories members, I’ve shared some optional prompts to add different personalities to S-GPT, including two inspired by Roy Kent and Steve Jobs. You can get the prompts and read more here; the main S-GPT shortcut is and will remain free-to-use for everyone, of course.

Update, April 7: I’ve updated S-GPT to version 1.0.1. You can read more details here. All download links to the shortcuts have been updated to the latest version.

It’s the inaugural week of the second annual edition of Automation April, and to celebrate the occasion, I’ve been working on something special: today, I’m introducing S-GPT, an advanced conversational shortcut for ChatGPT that bridges OpenAI’s assistant to native system features of iOS, iPadOS, macOS, and watchOS.

S-GPT (which stands for Shortcuts-GPT) is free to use for everyone, but it requires an OpenAI account with an associated pay-as-you-go billing plan since it takes advantage of OpenAI’s developer API, which has a cost. S-GPT was built with the latest ChatGPT API, and it can be used both with the existing ChatGPT 3.5 model or – if you have access to it – the ChatGPT 4 API.

While the shortcut is free for MacStories readers, I will be publishing a detailed, in-depth Automation Academy class soon for Club MacStories Plus or Premier members to explain the techniques and strategies I used to build this shortcut. I genuinely think that S-GPT is, from a technical perspective, my best and most advanced work to date; I hope my Academy class will help others learn some useful tips for Shortcuts and, in return, make even better automations for our contest.

With that said, let’s look at what S-GPT is and what you can do with it.

Read more

Automation April: Thinking About Linking

Links are the currency of information overload and distraction. There’s more media available than we could ever get to in a lifetime, and more things we might want to buy, places may want to visit, and other things to explore online than can be fit into a day.

The same problem exists in our work lives. That’s especially true for the kind of work I do. Links are part of everything. Whether I’m researching, writing, or preparing to record a podcast, I’m collecting, managing, and sharing links. I could follow all those trails as they cross my path, but I’d never get anything done.

Instead of flitting from one online discovery to the next with no plan, wasting precious time, I save links for later, putting them aside until I have time for them. I’ve been doing this forever, but I’ve also never been happy with my system. So, it was inevitable that I’d begin tinkering with my setup again, both with the apps I use and the shortcuts that support them.

Read more

Apple Frames 3.1.1 with Support for Passthrough Mode→

The 'Shortcut Result' variable, used as an image variable in a shortcut that calls Apple Frames.

The ‘Shortcut Result’ variable, used as an image variable in a shortcut that calls Apple Frames.

I just released a small update to Apple Frames 3.1, which came out earlier this week, with a new output command: &passthrough. With this output command for the Apple Frames API, you’ll be able to generate a framed image (from whatever source you like) and simply pass its result to the next action in a shortcut as a native image variable.

I wrote about this as part of my Extension column in MacStories Weekly today, where I also covered the ability to run Apple Frames from the command line on macOS. Here’s the excerpt about version 3.1.1 of Apple Frames and the new passthrough mode:

As I was researching this column for Weekly, I realized there was an obvious candidate for an output command I did not include in Apple Frames 3.1: a passthrough command to, well, pass framed images along as input for the next action of a shortcut.

Here’s what I mean: when you run Apple Frames from a helper shortcut using the ‘Run Shortcut’ action, that action produces an output variable called ‘Shortcut Result’. If you’re running Apple Frames as a function, thus turning it into a feature of another workflow, it can be useful to take the framed images it produces and use them as a native variable in other actions of the shortcut. The problem is that the output commands I launched with Apple Frames 3.1 all involved “storing” the framed images somewhere, whether it was Files or the system clipboard.

This is no longer the case with the &passthrough output command I added to Apple Frames 3.1.1, which you can redownload from the MacStories Shortcuts Archive or directly from this link. If you run the Apple Frames API with this command, framed images will be passed along as native output of the shortcut, which you can reuse as a variable elsewhere in a shortcut that’s invoking Apple Frames.

And:

Any shortcut or longer workflow that involves running Apple Frames in the background and retrieving the screenshots it frames can take advantage of this method, allowing you to bypass the need to store images in the clipboard, even if temporarily. Essentially, passthrough mode turns Apple Frames into a native action of the Shortcuts app that returns a standard image variable as its output.

This is the only change in version 3.1.1 of Apple Frames, and I’m excited to see how people will take advantage of it to chain Apple Frames with other shortcuts on their devices. You can download the updated version of Apple Frames below.

Apple Frames

Add device frames to screenshots for iPhones (11, 8/SE, and 12-13-14 generations in mini/standard/Plus/Pro Max sizes), iPad Pro (11” and 12.9”, 2018-2022 models), iPad Air (10.9”, 2020-2022 models), iPad mini (2021 model), Apple Watch S4/5/6/7/8/Ultra, iMac (24” model, 2021), MacBook Air (2020-2022 models), and MacBook Pro (2021 models). The shortcut supports portrait and landscape orientations, but does not support Display Zoom; on iPadOS and macOS, the shortcut supports Default and More Space resolutions. If multiple screenshots are passed as input, they will be combined in a single image. The shortcut can be run in the Shortcuts app, as a Home Screen widget, as a Finder Quick Action, or via the share sheet. The shortcut also supports an API for automating input images and framed results.

Get the shortcut here.

Permalink

Apple Frames 3.1: Extending Screenshot Automation with the New Apple Frames API

Apple Frames 3.1 comes with a lightweight Apple Frames API to extend its automation capabilities.

Apple Frames 3.1 comes with a lightweight Apple Frames API to extend its automation capabilities.

Update, March 3: Version 3.1.1 of Apple Frames has been released with support for a new passthrough output command. This post has been updated to reflect the changes. You can redownload the updated shortcut at the end of this post.

Today, I’m happy to introduce something I’ve been working on for the past couple of months: Apple Frames – my shortcut to put screenshots captured on Apple devices inside physical device frames – is getting a major upgrade to version 3.1 today. In addition to offering support for more devices that I missed in version 3.0 as well as some bug fixes, Apple Frames 3.1 brings a brand new API that lets you automate and extend the Apple Frames shortcut itself.

By making Apple Frames scriptable, I wanted to allow power users – such as designers and developers who rely on this shortcut to frame hundreds of images each week – to save valuable time without compromising the accessible nature of Apple Frames for other people. This is why all of the new advanced features of Apple Frames are optional and hidden until you go look for them specifically. Furthermore, even if you do want to use the Apple Frames API, you’ll see that I designed it in the spirit of Shortcuts: it does not require any code and it’s entirely powered by simple, visual ‘Text’ actions.

I’m incredibly excited about what Apple Frames can do in version 3.1, so let’s dive in.

Read more

Masto-Redirect, a Mastodon Shortcut to Redirect Profiles and Posts to Your Own Instance

Using Masto-Redirect in Safari.

Using Masto-Redirect in Safari.

Like many others over the past month, I’ve been thinking deeply about my experience with Twitter and whether I want to align my social media usage with the kind of platform Twitter is rapidly becoming. It’s a complex discussion (if my readers are still on Twitter, am I doing them a disservice by not using Twitter?), but in the meantime, I’ve decided to learn more about Mastodon. And in doing so, I came across an aspect of the service that I wanted to improve with a shortcut.

I created an account on Mastodon.social all the way back in 2018, and you can find me as @viticci there as well. I don’t want to turn this post into a guide to Mastodon (you can find an excellent one here), but, long story short, Mastodon is a decentralized service that is based on a federated network of instances. Essentially, there isn’t a single “Mastodon website” like, say, twitter.com; instead, there can be multiple Mastodon instances across different domains (hence why it’s “decentralized”) but, thanks to an underlying API, you can follow and be followed by people regardless of the instance they’re on. I can be on Mastodon.social, and you can be on Journa.host or Mastodon.online (different instances of Mastodon), but we can still communicate with one another via the protocol Mastodon uses. It’s like living in different countries but speaking the same language. You can read more about this here.

Read more

Apple Frames 3.0: Completely Rewritten, Support for iPhone 14 Pro and Dynamic Island, New Devices, Multiple Display Resolutions, and More

Apple Frames 3.0.

Apple Frames 3.0.

Today, I’m pleased to announce the release of version 3.0 of Apple Frames, my shortcut to put screenshots taken on various Apple devices inside physical frames for iPhone, iPad, Mac, and Apple Watch.

Apple Frames 3.0 is a major update that involved a complete re-architecture of the shortcut to improve its performance and reliability on all Apple platforms. For Apple Frames 3.0, I entirely rebuilt its underlying file structure to move away from base64 and embrace Files/Finder to store assets. As a result, Apple Frames 3.0 is faster, easier to debug, and – hopefully – easier to maintain going forward.

But Apple Frames 3.0 goes beyond a new technical foundation. This update to the shortcut introduces full compatibility with the iPhone 14 Pro and 14 Pro Max with Dynamic Island, Apple Watch Ultra, and the M2 MacBook Air. And that’s not all: Apple Frames 3.0 also brings full support for resolution scaling on all iPad models that offer the ‘More Space’ display mode in iPadOS 16. And in the process, I also added support for ‘Default’ and ‘More Space’ options on the Apple Silicon-based MacBook Airs, MacBook Pros, and iMac. All of this, as always, in a native shortcut designed for high performance that uses Apple’s official device images and requires no manual configuration whatsoever.

Apple Frames 3.0 is the biggest, most versatile version of Apple Frames to date, and I’m proud of the results. Let’s dive in.

Read more