When working on the common data engineering problem of identifying which records across two different databases correspond to the same real-world entity — a process known as record linkage — one inevitably runs into issues associated with the worst-case quadratic complexity of doing pairwise comparisons. To understand where things can get computationally heavy, let’s look … More Blocking Algorithms for Real-World Applications from Fraud Detection to LLMs