Businesses around the world were unable to take payments when Square suffered a total outage earlier this month. The outage started on the 7th of September and took almost 24 hours to resolve.
The business impact of this outage was significant. Merchants couldn’t accept payments via their Square devices for the duration. As the Wall Street Journal reported:
Jesse Stommel, owner of PlayForge, a toy-and-games store in Littleton, Colo., said they asked customers if they could manually write down their credit-card information. “Some customers just walked away,” he said. Stommel estimated he lost around 30% of usual weekday business.
“If this had happened on a Saturday, we would’ve lost a huge portion of our weekly business,” Stommel said.
Some businesses, such as a Blue Bottle Coffee in downtown San Francisco, taped “cash only” signs on their doors Thursday afternoon. Businesses as far away as Australia said they were affected.
Asking for customer to pay in cash may have been OK a few years ago. Nowadays, many Americans don’t use cash in a typical week, making it less likely they will carry cash at all. So “cash only” will likely mean customers going elsewhere.
The share price of Square’s parent company, Block, dropped by 5.6% during afternoon trading on the day of the 7th of September. Such a drop shows how financial markets viewed the situation. Subsequently Square’s root cause analysis identified the issue as a DNS (Domain Name System) Failure:
While making several standard changes to our internal network software, the combination of updates prevented our systems from properly communicating with each other, and ultimately caused the disruption. The issue also affected many of our internal tools for troubleshooting and support, making them temporarily unavailable.
In response, Square is increasing the ability to take payments when connectivity goes down. This will help mitigate any future similar issues. But companies will be concerned about the extent of the outage and how long it took to resolve.
On the 19th of September, Square announced that CEO Alyssa Henry is stepping down. Square’s founder, Jack Dorsey, will now return to be CEO. This change was not directly linked to the outage in official company communication, but some will speculate that this was a factor.
Square is now facing calls for refunds from many unhappy merchants. There will have been many lost sales, and closer regulatory scrutiny can be expected. Following the outage, Australia’s payments regulator is considering publishing reliability data, so that companies can compare the uptime of various Point of Sale solution providers.
Businesses Need a Back-Up Plan
DNS failures, are not uncommon. Online workspace company Notion was hit by a comparable issue in 2021. Later in 2021 Facebook suffered a global outage due to a BGP error (a similar, but slighty different issue to DNS).
But if WhatsApp goes down, most people will have a backup - sending an SMS, using another messenger service such as Signal, or even sending an email.
If their payments processor goes down, most businesses don’t have an alternative option except reverting to cash only. So, companies big and small should have a backup option in case their payment processor fails.
Businesses should be proactive in getting a backup solution. Outages are rare, but it makes sense to prepare. Not much can happen if an outage occurs without a backup solution in place. Let’s consider that:
Large merchants often connect to many payments processors. This is for redundancy and to benchmark different providers’ capabilities.
The easiest option for a small business would be to buy a second card reader. Square, SumUp and PayPal POS (known as Zettle in Europe) offer similar devices on a pay-as-you-use basis. So if one stops working, swap to the other.
Software companies are now building apps which can take payments directly on a smartphone. Download an app and take payments directly from an iPhone or Android device. Use it as a backup or as the primary Point of Sale.
MPoC regulation enables tap-to-phone technology to process payments even if the connection is lost. Once the connection is back up, transactions can be completed.
Open Banking and Orchestration
From reading Popular Fintech this week, I was reminded that outages can even be at the level of a card scheme itself:
In the summer of 2018, Visa experienced a hardware failure that impacted card transactions for millions of cardholders in the UK and Europe on Friday night.
In this scenario, Visa transactions failed regardless of the payment processor used.
Businesses should consider providing payment solutions beyond the traditional card networks. There's the option to increase payment choice for consumers. This can help protect against a scenario where card payments entirely go down.
QR code payment methods are becoming more common. Often, scanning a QR Code will facilitate payment from a consumer’s to a company’s bank account, hence the name Account-to-Account payments.
One example in Europe is that of Satispay. Satispay’s QR Codes are even high up in the Italian Alps (see photo below), and to date, their app has been downloaded more than four million times.
Satispay can be used for E-Commerce payments, in-stores, and even at vending machines. Adoption has risen with tailored cashback offers for specific merchants, and referral codes for €5 credit.

One challenge with any secondary Point of Sale solution is that payments is just one of the services offered. Successful payments software may incorporate various solutions. For instance Inventory Management, Data Analytics, and Customer Relationship Management tools.
Any backup or secondary Point-of-Sale solution will usually exist outside these extra services. Software can mirror these other services and bring them together with the primary solution via an API at a later point.
This is an opening for building Payment Orchestration in a Point-of-Sale environment. This concept brings together various payment processors, payment options, and capabilities from a single integration point.
So far, Payment Orchestration has focused on E-Commerce - with Apexx Global being one of the better-known providers. Tietoevry can connect Point of Sale solutions to various card acquirers in the card present space.
Expect Payment Orchestration to grow and cater for all payments, whether E-Commerce or Point-of-Sale. It will become an Omni-Channel offering. Then the lines between payment processors will blur and merchants will be able to more easily mitigate risks such as outages.
If you enjoyed this post, please consider liking this post or leaving a comment. It's much appreciated. Please consider subscribing to receive new posts via email or in the Substack app. If you’re an existing subscriber, you can upgrade your subscription to support this newsletter.