Recent breakthroughs indicate that AI systems can replace human raters in search evaluation. Still, concerns remain over quality and bias.