← Back
Home › Systems › Finance and trading

sanctions-screening

sanctions, PEP and adverse-media screening

LSEG World-Check, Dow Jones R&C, ComplyAdvantage

SystemTechniques · 12Primitives · 60 sanctions-screening Durable workflow executiondistributed · medium: Ordinary code made crash-proof by logging every side-effect result and replaying the code from that log; activities run at least once, workflow logic must be deterministic.›Named entity recognitionmachine-learning · medium: Find the character spans of entities in text and give each a type, by labelling every token and decoding a valid label sequence.›Relation extractionmachine-learning · medium: Extracting (subject, relation, object) triples from text with classifiers or LLMsTrigram indexsearch-sort · medium: Trigram posting lists accelerating regex and substring searchTamper-evident audit logsecurity · medium: An append-only log whose Merkle root, signed per batch, lets anyone verify an entry is present and history was never rewritten, with log-size proofs.›Entity resolutionstorage · medium: Decide which records describe the same real-world thing: block to cut the pair space, score pairs with a probabilistic model, cluster the matches transitively.›Inverted indexstorage · medium: Map each term to a sorted, compressed list of the documents containing it; the core of full-text search and other fast set queries.›Calibrationmachine-learning · low: Make predicted probabilities match observed frequencies: measure with ECE, fix post hoc with temperature, Platt or isotonic scaling on held-out data.›Fuzzy string matchingsearch-sort · low: Edit distance, Jaro-Winkler and trigram indexes for approximate name and address matchingAho-Corasick multi-pattern matchingsearch-sort · low: Find all occurrences of many fixed patterns in one pass over the text, in time independent of the pattern count, using a trie with failure links.›BFS and DFSgraphs · low: The two basic graph traversals; BFS gives hop distances and levels, DFS gives discovery/finish order for cycles, components and topological order.›Evaluation metricsmachine-learning · low: Precision, recall, ROC AUC, average precision, log loss, NDCG and pass@k computed correctly, plus paired confidence intervals for comparing models.›Language identificationmachine-learning · low: Score a text's character n-grams against per-language statistics, after a cheap script check, and return an ISO 639 code with a confidence or "und".›Text normalizationmachine-learning · low: Rewrite messy text into one canonical form for matchers and models, or into spoken words for speech output (and back), keeping a map to the original offsets.›Edit distancesearch-sort · low: Levenshtein/Damerau distance by DP, bit-parallel Myers variantLevenshtein automatasearch-sort · low: Levenshtein automata / edit-distance search over dictionaries for typo toleranceName transliterationsearch-sort · low: Convert personal names between scripts (Cyrillic, Arabic, CJK to Latin) with rule tables and variant generation for matchingPhonetic name matchingsearch-sort · low: Reduce names to phonetic keys (Soundex, Metaphone, Double Metaphone) so differently spelled but similar-sounding names collideUnicode text tokenization for searchsearch-sort · low: Turn multilingual text into index terms: segment words (UAX 29 style, CJK bigrams), normalize, case-fold and accent-fold, identically at index and query time.›Snapshot diffingstorage · low: Diff current vs previous table snapshot by row hashes to emit inserts/updates/deletesXML Streaming Parserstorage · low: Tokenize XML into start, text and end events in constant memory, so a few fields can be extracted from huge, broken or hostile documents.›Record replaydistributed · low: Record every nondeterministic input (time, randomness, I/O, model and tool outputs, per-tick player input) and re-execute deterministically for debugging, replays and state rebuildEvent sourcingfinance · low: Persist state changes as an append-only stream of immutable events per entity; current state is a fold over them, guarded by expected-version appends.›+ 5 more techniques+ 44 more primitives

Similar systems

Share the most building blocks with this one.

background-screening 24 %translation-management 24 %aml-monitoring 20 %knowledge-graph 19 %interbank-messaging 15 %