Authentication
MFA strength compared
All MFA beats passwords alone, but not equally. A side-by-side of what each form resists, using CISA's ranking and NIST SP 800-63B-4's requirements.
Multi-factor authentication requires two or more different kinds of evidence. It stops attacks that rely on a stolen or guessed password alone. It does not stop every attack, and the forms of MFA differ a lot in what they resist. This page ranks them using CISA's 2022 fact sheet and maps them to the authentication assurance levels in NIST SP 800-63B-4 (July 2025). It then compares them against the specific attacks that defeat weaker MFA.
Factors and authenticators
SP 800-63B-4 and CISA use the same three factors: something you know (a password or PIN), something you have (a device or key), and something you are (a biometric characteristic). Two details from SP 800-63B-4 trip people up:
- A biometric is never an authenticator on its own. Section 3.2.3: biometrics "SHALL only be used as part of multi-factor authentication with a physical authenticator". A fingerprint that unlocks a security key or phone is an activation factor for that device.
- One device can be two factors. A multi-factor authenticator, such as a security key that needs a PIN or a phone authenticator unlocked by a biometric, provides both factors in a single event. SP 800-63B-4 section 2.2.1 accepts either a multi-factor authenticator or two single-factor authenticators for AAL2.
CISA's ranking, strongest to weakest
CISA's fact sheet Implementing Phishing-Resistant MFA (October 2022), Table 1, lists MFA forms "from strongest to weakest based on their susceptibility" to phishing, push bombing, SS7 exploitation and SIM swap:
| Rank | Form | CISA's threat assessment |
|---|---|---|
| 1 | Phishing-resistant MFA: FIDO/WebAuthn authentication; PKI-based (for example PIV and CAC smart cards) | Resistant to phishing. Push bombing, SS7 and SIM swap not applicable. CISA calls it "the gold standard". |
| 2 | App-based authentication: one-time password apps; mobile push with number matching; token-based OTP | Vulnerable to phishing. Resistant to push bombing. SS7 and SIM swap not applicable. CISA calls these the best options for small and medium-sized businesses that cannot immediately implement phishing-resistant MFA. |
| 3 | Mobile push without number matching | Vulnerable to push bombing and user error. SS7 and SIM swap not applicable. |
| 4 | SMS or voice | Vulnerable to phishing, SS7 and SIM swap. "Should only be used as a last resort", though it can serve as a temporary step while moving to stronger MFA. |
CISA also states plainly that "any form of MFA is better than no MFA". Ranking MFA forms is about where to go next, not a reason to remove MFA you already have.
How each form holds up against specific attacks
The first four columns follow CISA's fact sheet. The phishing entries for OTP, push and SMS also follow from SP 800-63B-4: section 3.2.5 requires cryptographic authentication for phishing resistance and says manually entered OTP and out-of-band outputs SHALL NOT be considered phishing-resistant, and section 3.1.3 states that out-of-band authentication is not phishing-resistant. The last column draws on the endpoint-compromise and eavesdropping examples in SP 800-63B-4 Table 3.
| Form | Real-time phishing (AiTM proxy) | Push bombing | SIM swap | SS7 interception | Malware on the endpoint |
|---|---|---|---|---|---|
| FIDO/WebAuthn security key or passkey | Resists | Not applicable | Not applicable | Not applicable | Partial: a hardware key cannot be copied, but malware can misuse an unlocked session |
| PKI smart card (PIV/CAC) | Resists | Not applicable | Not applicable | Not applicable | Partial: as above |
| OTP app or hardware token | Vulnerable: code is relayed | Not applicable | Not applicable | Not applicable | Vulnerable: code can be captured as typed |
| Push with number matching | Vulnerable: proxy shows the real number | Resists | Not applicable | Not applicable | Vulnerable if the phone is compromised |
| Push, approve only | Vulnerable | Vulnerable | Not applicable | Not applicable | Vulnerable if the phone is compromised |
| SMS or voice code | Vulnerable | Not applicable | Vulnerable | Vulnerable | Vulnerable: a malicious app can read SMS |
"Resists" means the authentication step itself. No authenticator protects a session that has already been established on a compromised endpoint. Session theft is a separate problem.
The underlying reasons are covered on phishing-resistant MFA (why relaying fails against WebAuthn) and OTP and push (push bombing and number matching).
How SP 800-63B-4 assurance levels map
NIST does not rank products. It sets requirements per assurance level, and authenticator types either meet them or not. A simplified mapping (see assurance levels for the full requirements):
| Level | What SP 800-63B-4 requires | Forms that can satisfy it |
|---|---|---|
| AAL1 | Single-factor or multi-factor. Verifiers SHOULD offer MFA. | Any of the forms above, or a password alone. |
| AAL2 | Two factors (2.2.1). At least one replay-resistant authenticator (2.2.2). Verifiers SHALL offer at least one phishing-resistant option and SHOULD encourage its use. | Password plus OTP, push that transfers the secret (approve-only push is no longer acceptable, section 3.1.3) or SMS (SMS as a restricted authenticator); multi-factor OTP; multi-factor cryptographic authenticators, including synced passkeys. |
| AAL3 | Cryptographic authenticator with a non-exportable private key that SHALL provide phishing resistance. Authentication intent required. Syncable authenticators SHALL NOT be used (2.3.2). | Hardware security keys and device-bound passkeys meeting the requirements; PIV/CAC smart cards. |
For US federal systems, section 2.2.2 goes further: "Federal agencies SHALL require their staff, contractors, and partners to use phishing-resistant authentication to access federal information systems."
Restricted authenticators: SMS and voice
SP 800-63B-4 section 3.2.9 introduces the idea of a restricted authenticator: one that NIST allows but with extra conditions, because its ability to resist attacks has degraded. At publication there is exactly one: "the use of the PSTN for out-of-band authentication", meaning codes sent by SMS or voice call (section 3.1.3.3).
Using a restricted authenticator requires the organization to "assess, understand, and accept the risks". If the relying party finds the risk unacceptable, the restricted authenticator "SHALL NOT be used". When it is used, the CSP SHALL:
- offer at least one alternative authenticator that is not restricted and works at the required AAL;
- give subscribers meaningful notice of the security risks and of the unrestricted alternatives;
- address the additional risks in its risk assessment; and
- keep a migration plan, in its Digital Identity Acceptance Statement, for the day the restricted authenticator is no longer acceptable.
Section 3.1.3.3 adds that verifiers SHOULD consider risk indicators such as "device swap, SIM change, number porting" before sending a code over the PSTN. Changing the registered phone number counts as binding a new authenticator.
One more change matters for push: the "compare and approve" style of out-of-band authentication, where the user simply approves a prompt, is "no longer considered acceptable" in SP 800-63B-4 because of authentication fatigue. The secret must be transferred between the devices. Details are on OTP and push.
Choosing what to deploy
- Administrators and high-value users first. CISA suggests IT administrators and help-desk staff as a first phase, and names system administrators, attorneys with e-discovery rights and HR staff as high-value targets. Give them phishing-resistant MFA.
- Everyone else next. Passkeys and platform authenticators make phishing-resistant MFA practical for whole workforces and for customers. See passkeys.
- Where you cannot yet, harden what you have. Turn on number matching for push and investigate denied push requests (CISA). Limit the rate of push prompts (SP 800-63B-4 section 3.1.3.2, SHOULD).
- Retire SMS and voice where possible. If you keep them, meet the restricted-authenticator conditions above and watch for SIM-change signals.
- Close the side doors. Weak recovery, legacy protocols that bypass MFA, and fallback to weaker methods all undo a strong primary method. See account recovery.
Sources
- CISA fact sheet: Implementing Phishing-Resistant MFA (October 2022), CISA. Public domain (U.S. government work).
- NIST SP 800-63B-4: Authentication and Authenticator Management, NIST. Public domain (U.S. government work).