New research says that quantifying progress in AI must account for the fact that the humans AI is measured against are actually a variable, noisy benchmark.