a palantir employee does a great job of explaining why their technology is frightening, as part of pushing back on someone from NO who wanted predictions with numerical rankings for potential offenders/victims:
> “The looming concern is that an opaque scoring algorithm substitutes the veneer of quantitative certainty for more holistic, qualitative judgement and human culpability,” Bowman wrote. “One of the lasting virtues of the SNA work we’ve done to date is that we’ve kept human analysts in the loop to ensure that networks are being explored and analyzed in a way that passes the straight-face test.”
> “The looming concern is that an opaque scoring algorithm substitutes the veneer of quantitative certainty for more holistic, qualitative judgement and human culpability,” Bowman wrote. “One of the lasting virtues of the SNA work we’ve done to date is that we’ve kept human analysts in the loop to ensure that networks are being explored and analyzed in a way that passes the straight-face test.”