@uriel @teledyn It was published at the 2021 ACM Conference on Fairness, Accountability, and Transparency. It's not a conference on AI models, it's a conference about accountability and transparency of computing systems.
"Science" is more than math and data and methodology. It includes many kinds of analysis, including reasoning from first principles and making inductive and deductive arguments, as well as presentation of new ideas.
At a conference on fairness, accountability and transparency, I would expect to see a paper containing analysis of potential bias and obfuscation as well as recommendations for avoiding them, and I would have no problem counting it as a scientific paper if it makes a clear, sound argument for why a given thing will produce biased results and enable avoidance of accountability. The fact that these specific outcomes were later independently found to occur simply reinforces the conclusion that the analysis was sound.
The criteria for what counts as a "scientific paper" are amorphous. Different research areas have different norms. For decades, robotics conference papers basically consisted of "Look ma! No hands!"
The real surprise to me is that a conference accepted a 14 page paper. In my field, the norm is six pages and you can pay extra for up to a total of eight.
Link to paper: https://dl.acm.org/doi/10.1145/3442188.3445922