Google AI: About Google's approach to research publication

 Here is the article. 

My notes:

1. It ignored too much relevant research — for example, it talked about the environmental impact of large models, but disregarded subsequent research showing much greater efficiencies.  Similarly, it raised concerns about bias in language models, but didn’t take into account recent research to mitigate these issues.  We acknowledge that the authors were extremely disappointed with the decision that Megan and I ultimately made, especially as they’d already submitted the paper. 
2. We accept and respect her decision to resign from Google.
3. critical DEI programs - Google it!

About Google's approach to research publication

I understand the concern over Timnit Gebru’s resignation from Google.  She’s done a great deal

to move the field forward with her research.  I wanted to share the email I sent to Google Research

and some thoughts on our research process.

Here’s the email I sent to the Google Research team on Dec. 3, 2020:

Hi everyone,

I’m sure many of you have seen that Timnit Gebru is no longer working at Google.

This is a difficult moment, especially given the important research topics she was

involved in, and how deeply we care about responsible AI research as an org and

as a company.

Because there’s been a lot of speculation and misunderstanding on social media,

I wanted to share more context about how this came to pass, and assure you we’re

here to support you as you continue the research you’re all engaged in.

Timnit co-authored a paper with four fellow Googlers as well as some external

collaborators that needed to go through our review process (as is the case with

all externally submitted papers).  We’ve approved dozens of papers that Timnit

and/or the other Googlers have authored and then published, but as you know,

papers often require changes during the internal review process (or are even

deemed unsuitable for submission).  Unfortunately, this particular paper was

only shared with a day’s notice before its deadline — we require two weeks

for this sort of review — and then instead of awaiting reviewer feedback, it was

approved for submission and submitted.

A cross functional team then reviewed the paper as part of our regular process

and the authors were informed that it didn’t meet our bar for publication and were

given feedback about why.  It ignored too much relevant research — for example,

it talked about the environmental impact of large models, but disregarded subsequent

research showing much greater efficiencies.  Similarly, it raised concerns about bias

in language models, but didn’t take into account recent research to mitigate these

issues.  We acknowledge that the authors were extremely disappointed with the

decision that Megan and I ultimately made, especially as they’d already submitted

the paper. 

Timnit responded with an email requiring that a number of conditions be met in

order for her to continue working at Google, including revealing the identities of

every person who Megan and I had spoken to and consulted as part of the review

of the paper and the exact feedback.  Timnit wrote that if we didn’t meet these

demands, she would leave Google and work on an end date.  We accept and

respect her decision to resign from Google.

Given Timnit's role as a respected researcher and a manager in our Ethical AI team,

I feel badly that Timnit has gotten to a place where she feels this way about the work

we’re doing.  I also feel badly that hundreds of you received an email just this week

from Timnit telling you to stop work on critical DEI programs.  Please don’t.  I

understand the frustration about the pace of progress, but we have important work

ahead and we need to keep at it.

I know we all genuinely share Timnit’s passion to make AI more equitable and

inclusive.  No doubt, wherever she goes after Google, she’ll do great work and

I look forward to reading her papers and seeing what she accomplishes.

Thank you for reading and for all the important work you continue to do. 

-Jeff

I’ve also received questions about our research and review process, so I wanted to share

more here.  I'm going to be talking with our research teams, especially those on the Ethical

AI team and our many other teams focused on responsible AI, so they know that we strongly

support these important streams of research.  And to be clear, we are deeply committed to

continuing our research on topics that are of particular importance to individual and intellectual

diversity  -- from unfair social and technical bias in ML models, to the paucity of representative

training data, to involving social context in AI systems.  That work is critical and I want our

research programs to deliver more work on these topics -- not less.

In my email above, I detailed some of what happened with this particular paper.  But let me

give a better sense of the overall research review process.  It’s more than just a single

approver or immediate research peers; it’s a process where we engage a wide range of

researchers, social scientists, ethicists, policy & privacy advisors, and human rights specialists

from across Research and Google overall.  These reviewers ensure that, for example, the

research we publish paints a full enough picture and takes into account the latest relevant

research we’re aware of, and of course that it adheres to our AI Principles.

Those research review processes have helped improve many of our publications and research

applications. While more than 1,000 projects each year turn into published papers, there are

also many that don’t end up in a publication.  That’s okay, and we can still carry forward

constructive parts of a project to inform future work.  There are many ways we share our research;

e.g. publishing a paper, open-sourcing code or models or data or colabs, creating demos, working

directly on products, etc. 

This paper surveyed valid concerns with large language models, and in fact many teams at Google

are actively working on these issues. We’re engaging the authors to ensure their input informs the

work we’re doing, and I’m confident it will have a positive impact on many of our research and

product efforts.

But the paper itself had some important gaps that prevented us from being comfortable putting

Google affiliation on it.  For example, it didn’t include important findings on how models can be

made more efficient and actually reduce overall environmental impact, and it didn’t take into account

some recent work at Google and elsewhere on mitigating bias in language models.   Highlighting

risks without pointing out methods for researchers and developers to understand and mitigate those

risks misses the mark on helping with these problems.  As always, feedback on paper drafts generally

makes them stronger when they ultimately appear.

We have a strong track record of publishing work that challenges the status quo -- for example,

we’ve had more than 200 publications focused on responsible AI development in the last year alone. 

Just a few examples of research we’re engaged in that tackles challenging issues:

• Measuring and reducing gendered correlations in pre-trained NLP models

• Evading Deepfake-Image Detectors with White- and Black-Box Attacks

• Extending the Machine Learning Abstraction Boundary: A Complex Systems Approach to Incorporate Societal Context

• CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims

• What Does AI Mean for Smallholder Farmers? A Proposal for Farmer-Centered AI Research [forthcoming]

• SoK: Hate, Harassment, and the Changing Landscape of Online Abuse

• Accelerating eye movement research via accurate and affordable smartphone eye tracking

• The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks

• Assessing the impact of coordinated COVID-19 exit strategies across Europe

• Practical Compositional Fairness: Understanding Fairness in Multi-Component Ranking Systems

I’m proud of the way Google Research provides the flexibility and resources to explore many avenues

of research.  Sometimes those avenues run perpendicular to one another.  This is by design.  The

exchange of diverse perspectives, even contradictory ones, is good for science and good for society. 

It’s also good for Google.  That exchange has enabled us not only to tackle ambitious problems, but

to do so responsibly.

Our aim is to rival peer-reviewed journals in terms of the rigor and thoughtfulness in how we review

research before publication.  To give a sense of that rigor, this blog post captures some of the detail

in one facet of review, which is when a research topic has broad societal implications and requires

particular AI Principles review -- though it isn’t the full story of how we evaluate all of our research,

it gives a sense of the detail involved: https://blog.google/technology/ai/update-work-ai-responsible-innovation/

We’re actively working on improving our paper review processes, because we know that too many

checks and balances can become cumbersome.  We will always prioritize ensuring our research

is responsible and high-quality, but we’re working to make the process as streamlined as we can

so it’s more of a pleasure doing research here.

A final, important note -- we evaluate the substance of research separately from who’s doing it.  But

to ensure our research reflects a fuller breadth of global experiences and perspectives in the first

place, we’re also committed to making sure Google Research is a place where every Googler can

do their best work.  We’re pushing hard on our efforts to improve representation and inclusiveness

across Google Research, because we know this will lead to better research and a better experience

for everyone here.