---
answer: direct
beat: ai-technology
source: 1 article · updated: November 17, 2026
---

What is self-supervised learning doing when there's no labeled data?

Instead of labels, the model is trained on prediction tasks it can generate from the raw sequence itself: Next Token Prediction (predict the next transaction given the history) and Masked Language Modeling (guess transactions that were hidden from the sequence). Both objectives force the model to learn real structure in spending behavior — recurring payments, spending cycles — without any human labeling a single example.

Answered in

Why Fintechs Are Replacing Hand-Built Features With Foundation Models

Manually engineered features don't transfer between fraud, credit, and recommendation models. A transformer trained on raw transactions can.

Crashtech Editorial November 17, 2026 How AI Actually Works

Read the full analysis

Other questions this article answers

More how ai actually works questions

Every answer on Crashtech is written by the editor of the article it comes from — never auto-summarised. Browse all answers or the How AI Actually Works beat.