An Email Test for the Peter Principle

The Peter Principle states that in most hierarchical organisations, there is a natural tendency for employees to rise in the management hierarchy through promotion until they reach the levels of their respective incompetence. This is a statistical statement about people in an organisation, and there are cultural and management practices that can be put in place to … More An Email Test for the Peter Principle

Financial Intelligence as a Platform Business

We have all read about network effects and how they underlie the business models of fast-growing and high-margin companies like Facebook, Google, Netflix, and Apple. The book Platform Revolution by Parker, Van Alstyne and Choudary seeks to distill the key characteristics of these so-called Platform Businesses, whose overarching purpose is “to consummate matches among users … More Financial Intelligence as a Platform Business

A Note on Problem Solving for Young Researchers

Many beginning researchers find it hard to cope with the sheer amount of reading they have to do to come up to speed in a certain technical field, and the issue is often compounded by the “lacking the prerequisites to the read the prerequisites” problem due to inadequate mathematical training at the undergraduate level. Here’s … More A Note on Problem Solving for Young Researchers

The Data Quality Trap

There is a lot of work in the data management community that looks at data quality as a first-class problem, capable of being solved largely as an independent problem that can then benefit many downstream systems. There is certainly a lot going for this line of thinking. My own view, drummed into me by a former NASA scientist who I … More The Data Quality Trap

Hardening Bloom Filters using Paillier Encryption

Bloom Filters is a popular technique for privacy-preserving record linkage. However, recent work by Christen et al [1] and others have shown that Bloom Filters (BF) are susceptible to different forms of frequency attack. There are many ideas on hardening BF to protect against frequency attacks, and one idea we will explore in this blog article … More Hardening Bloom Filters using Paillier Encryption

Interview Questions for a Data Science Leadership Role

It’s not always easy for a technically competent data scientist to make the transition to a data science leadership role. Here are some interview questions I use to assess whether a candidate has successfully made that transition. Can you tell us a little bit about yourself and why you applied for this role? What is … More Interview Questions for a Data Science Leadership Role