GirderGroup

AI Compliance Tools for Small Firms: What the Market Gets Wrong

Most tools sold to small firms assume the hard problem is already solved. An engineering view of where automation helps and where it just adds alerts.

Dwayne ThompsonEngineering, standards & trade editor · Kingston
August 14, 2023 · 8 min read
A circuit board in close-up, illustrating compliance engineering for small firms.
A circuit board in close-up, illustrating compliance engineering for small firms. · Image: Girder Group

Most AI compliance tools sold to small firms are surveillance tools. Most small firms’ actual problem is not surveillance. That mismatch is the single most expensive misunderstanding in the market, and it explains why a firm can buy sophisticated software and still fail an examination for a basic reason.

Key takeaways

  • The off-channel penalties were for failing to capture and keep messages, not for failing to detect misconduct in them. Capture is the first-order problem.
  • For a small team the constraint is human triage hours. A tool that adds low-precision alerts makes the firm less safe, not more.
  • The audit-trail alternative rewards explainability and clean retrieval; a black box fails the part that matters.
  • Measure any tool in hours removed from your one or two people, not in features.

What the enforcement record actually punishes

Look at what the enforcement record punishes. The off-channel penalties, more than $1.1 billion across 16 firms in 2022, $289 million across 11 firms in 2023, $390 million across 26 firms in 2024, were not imposed because firms failed to detect misconduct in their messages (SEC 2022-174; 2023-149; 2024-144). They were imposed because firms did not capture and keep the messages at all. Detection is a second-order problem. Capture is the first-order one, and it is the one most tools assume away.

“Detection is a second-order problem. Capture is the first-order one, and it is the one most tools assume away.”

Four things the market gets wrong

1. It sells detection to firms with a capture gap. A surveillance model is only as good as the messages flowing into it. If chat, SMS, and collaboration channels are not fully captured, and as we have documented, most are not, the model scores a partial feed and produces false confidence.

2. It equates more alerts with more safety. A large bank staffs a team to triage alerts; a small firm has one or two people who also do everything else. Hundreds of low-precision flags make the queue longer than anyone can clear, which manufactures a paper trail of ignored alerts. Precision is the whole game.

3. It ignores the evidentiary burden. Under the amended Rule 17a-4 audit-trail alternative, a firm has to prove who changed what and when. A model that flags a message but cannot show its reasoning, or an archive that cannot produce a clean record on demand, fails the part that matters.

4. It treats “AI” as a synonym for value. Adoption is real, 75% of UK financial firms reported using AI in the 2024 survey (Bank of England & FCA, 2024), but adoption is not fit. A pattern-matcher that adds noise to a two-person function is a downgrade dressed as an upgrade.

What this means operationally

Buy capture and retrieval before you buy detection. Until every channel lands in a compliant, retrievable store, a surveillance model is scoring a hole in your data.

Weight precision over recall for a small team. Ask a vendor for its false-positive rate on a book your size, not its detection breadth.

Require explainability and clean production. Any tool touching your records should show why it flagged something and produce an indexed record on demand.

Measure the tool in hours removed. If it adds a queue, it failed, whatever the demo showed.

How AI could address the gap

The version of AI that helps a small firm is unglamorous and points inward. Instead of scanning for the rare bad actor, it watches the firm’s own coverage: reconciling people, devices, and channels against what is actually captured, and raising a single high-precision flag when a gap opens. It drafts the plain-language explanations an examiner or senior manager will ask for. It runs the retrieval tests a firm would otherwise never get around to.

This is the opposite of the surveillance pitch. It assumes the scarce resource is human attention, not detection horsepower. For a firm without a compliance department, that trade, machines hold the standing watch on coverage and a named person owns the decisions, is the one that actually reduces risk. It is also the frame behind the FCA’s principles-based expectations: the tool keeps the evidence current; the accountability stays human.

Building the platforms, portals, and systems that make these obligations provable is what Girder Group does.

Sources

  1. 1.Release 2022-174, 27 September 2022.U.S. Securities and Exchange Commission
  2. 2.Release 2023-149, 8 August 2023.U.S. Securities and Exchange Commission
  3. 3.Release 2024-144, 14 August 2024.U.S. Securities and Exchange Commission
  4. 4.Artificial intelligence in UK financial services, 2024.Bank of England & Financial Conduct Authority
  5. 5.17 CFR § 240.17a-4 (audit-trail alternative), current text.Electronic Code of Federal Regulations

Dwayne Thompson

Engineering, standards & trade editor · Girder Group · Kingston

Dwayne Thompson writes on compliance engineering, standards (NIST), and trade and logistics regulation (CBP, DOT, FMC), from Girder Group's Kingston desk.

Meet the desk

Work with Girder Group

The systems that make these obligations provable.

Girder Group builds the platforms, portals, and cloud systems that regulated organisations run on. Talk to the firm behind this research.

Start a conversation

Stay informed

New research in your inbox.

Briefings on recordkeeping and AI governance, published as the rules develop. We never share your address.

Unsubscribe anytime.