privileged.id

Authentication

MFA strength compared

All MFA beats passwords alone, but not equally. A side-by-side of what each form resists, using CISA's ranking and NIST SP 800-63B-4's requirements.

Reviewed 6 min read 2 primary sources

Multi-factor authentication requires two or more different kinds of evidence. It stops attacks that rely on a stolen or guessed password alone. It does not stop every attack, and the forms of MFA differ a lot in what they resist. This page ranks them using CISA's 2022 fact sheet and maps them to the authentication assurance levels in NIST SP 800-63B-4 (July 2025). It then compares them against the specific attacks that defeat weaker MFA.

Factors and authenticators

SP 800-63B-4 and CISA use the same three factors: something you know (a password or PIN), something you have (a device or key), and something you are (a biometric characteristic). Two details from SP 800-63B-4 trip people up:

  • A biometric is never an authenticator on its own. Section 3.2.3: biometrics "SHALL only be used as part of multi-factor authentication with a physical authenticator". A fingerprint that unlocks a security key or phone is an activation factor for that device.
  • One device can be two factors. A multi-factor authenticator, such as a security key that needs a PIN or a phone authenticator unlocked by a biometric, provides both factors in a single event. SP 800-63B-4 section 2.2.1 accepts either a multi-factor authenticator or two single-factor authenticators for AAL2.

CISA's ranking, strongest to weakest

CISA's fact sheet Implementing Phishing-Resistant MFA (October 2022), Table 1, lists MFA forms "from strongest to weakest based on their susceptibility" to phishing, push bombing, SS7 exploitation and SIM swap:

RankFormCISA's threat assessment
1Phishing-resistant MFA: FIDO/WebAuthn authentication; PKI-based (for example PIV and CAC smart cards)Resistant to phishing. Push bombing, SS7 and SIM swap not applicable. CISA calls it "the gold standard".
2App-based authentication: one-time password apps; mobile push with number matching; token-based OTPVulnerable to phishing. Resistant to push bombing. SS7 and SIM swap not applicable. CISA calls these the best options for small and medium-sized businesses that cannot immediately implement phishing-resistant MFA.
3Mobile push without number matchingVulnerable to push bombing and user error. SS7 and SIM swap not applicable.
4SMS or voiceVulnerable to phishing, SS7 and SIM swap. "Should only be used as a last resort", though it can serve as a temporary step while moving to stronger MFA.

CISA also states plainly that "any form of MFA is better than no MFA". Ranking MFA forms is about where to go next, not a reason to remove MFA you already have.

CISA ranking of MFA forms, strongest to weakest, as bars of decreasing lengthSTRONGESTWEAKESTPhishing-resistant MFAResists phishing; push bombing, SS7, SIM swap not applicableApp or token OTP, push with number matchingPhishable; resists push bombingPush without number matchingPush bombing and user errorSMS or voicePhishing, SS7 and SIM swap; last resort
Order and threat notes from CISA, Implementing Phishing-Resistant MFA (October 2022), Table 1. Bar length shows rank only, not a measured strength.

How each form holds up against specific attacks

The first four columns follow CISA's fact sheet. The phishing entries for OTP, push and SMS also follow from SP 800-63B-4: section 3.2.5 requires cryptographic authentication for phishing resistance and says manually entered OTP and out-of-band outputs SHALL NOT be considered phishing-resistant, and section 3.1.3 states that out-of-band authentication is not phishing-resistant. The last column draws on the endpoint-compromise and eavesdropping examples in SP 800-63B-4 Table 3.

FormReal-time phishing (AiTM proxy)Push bombingSIM swapSS7 interceptionMalware on the endpoint
FIDO/WebAuthn security key or passkeyResistsNot applicableNot applicableNot applicablePartial: a hardware key cannot be copied, but malware can misuse an unlocked session
PKI smart card (PIV/CAC)ResistsNot applicableNot applicableNot applicablePartial: as above
OTP app or hardware tokenVulnerable: code is relayedNot applicableNot applicableNot applicableVulnerable: code can be captured as typed
Push with number matchingVulnerable: proxy shows the real numberResistsNot applicableNot applicableVulnerable if the phone is compromised
Push, approve onlyVulnerableVulnerableNot applicableNot applicableVulnerable if the phone is compromised
SMS or voice codeVulnerableNot applicableVulnerableVulnerableVulnerable: a malicious app can read SMS

"Resists" means the authentication step itself. No authenticator protects a session that has already been established on a compromised endpoint. Session theft is a separate problem.

The underlying reasons are covered on phishing-resistant MFA (why relaying fails against WebAuthn) and OTP and push (push bombing and number matching).

How SP 800-63B-4 assurance levels map

NIST does not rank products. It sets requirements per assurance level, and authenticator types either meet them or not. A simplified mapping (see assurance levels for the full requirements):

LevelWhat SP 800-63B-4 requiresForms that can satisfy it
AAL1Single-factor or multi-factor. Verifiers SHOULD offer MFA.Any of the forms above, or a password alone.
AAL2Two factors (2.2.1). At least one replay-resistant authenticator (2.2.2). Verifiers SHALL offer at least one phishing-resistant option and SHOULD encourage its use.Password plus OTP, push that transfers the secret (approve-only push is no longer acceptable, section 3.1.3) or SMS (SMS as a restricted authenticator); multi-factor OTP; multi-factor cryptographic authenticators, including synced passkeys.
AAL3Cryptographic authenticator with a non-exportable private key that SHALL provide phishing resistance. Authentication intent required. Syncable authenticators SHALL NOT be used (2.3.2).Hardware security keys and device-bound passkeys meeting the requirements; PIV/CAC smart cards.

For US federal systems, section 2.2.2 goes further: "Federal agencies SHALL require their staff, contractors, and partners to use phishing-resistant authentication to access federal information systems."

Restricted authenticators: SMS and voice

SP 800-63B-4 section 3.2.9 introduces the idea of a restricted authenticator: one that NIST allows but with extra conditions, because its ability to resist attacks has degraded. At publication there is exactly one: "the use of the PSTN for out-of-band authentication", meaning codes sent by SMS or voice call (section 3.1.3.3).

Using a restricted authenticator requires the organization to "assess, understand, and accept the risks". If the relying party finds the risk unacceptable, the restricted authenticator "SHALL NOT be used". When it is used, the CSP SHALL:

  1. offer at least one alternative authenticator that is not restricted and works at the required AAL;
  2. give subscribers meaningful notice of the security risks and of the unrestricted alternatives;
  3. address the additional risks in its risk assessment; and
  4. keep a migration plan, in its Digital Identity Acceptance Statement, for the day the restricted authenticator is no longer acceptable.

Section 3.1.3.3 adds that verifiers SHOULD consider risk indicators such as "device swap, SIM change, number porting" before sending a code over the PSTN. Changing the registered phone number counts as binding a new authenticator.

One more change matters for push: the "compare and approve" style of out-of-band authentication, where the user simply approves a prompt, is "no longer considered acceptable" in SP 800-63B-4 because of authentication fatigue. The secret must be transferred between the devices. Details are on OTP and push.

Choosing what to deploy

  1. Administrators and high-value users first. CISA suggests IT administrators and help-desk staff as a first phase, and names system administrators, attorneys with e-discovery rights and HR staff as high-value targets. Give them phishing-resistant MFA.
  2. Everyone else next. Passkeys and platform authenticators make phishing-resistant MFA practical for whole workforces and for customers. See passkeys.
  3. Where you cannot yet, harden what you have. Turn on number matching for push and investigate denied push requests (CISA). Limit the rate of push prompts (SP 800-63B-4 section 3.1.3.2, SHOULD).
  4. Retire SMS and voice where possible. If you keep them, meet the restricted-authenticator conditions above and watch for SIM-change signals.
  5. Close the side doors. Weak recovery, legacy protocols that bypass MFA, and fallback to weaker methods all undo a strong primary method. See account recovery.

Sources

  1. CISA fact sheet: Implementing Phishing-Resistant MFA (October 2022), CISA. Public domain (U.S. government work).
  2. NIST SP 800-63B-4: Authentication and Authenticator Management, NIST. Public domain (U.S. government work).