Cloud AI Protection Analyst by Google

February 22, 2024
Cloud AI Protection Analyst by Google

Job Description

About the job:

Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. They use technical know-how, excellent problem-solving skills, user insights, and proactive communication to protect users and our partners from abuse across Google products like Search, Maps, Gmail, and Google Ads. On this team, you’re a big-picture thinker and strategic team-player with a passion for doing what’s right. You work globally and cross-functionally with Google engineers and product managers to identify and fight abuse and fraud cases at Google speed – with urgency. And you take pride in knowing that every day you are working hard to promote trust in Google and ensuring the highest levels of user safety.

The growth of the Cloud AI business relies on providing safe and exceptional customer experiences. Cloud AI Protection (CAIP) team enables the growth of Google Cloud and Workspace AI businesses by curbing associated safety risks. On this team, you will be at the forefront of analyzing and resolving safety issues related to Google’s AI products. You will collaborate globally and cross-functionally with AI development teams and gain access to the latest AI innovations.

At Google we work hard to earn our users’ trust every day. Trust & Safety is Google’s team of abuse fighting and user trust experts working daily to make the internet a safer place. We partner with teams across Google to deliver bold solutions in abuse areas such as malware, spam and account hijacking. A diverse team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and fight abuse across all of Google’s products, protecting our users, advertisers, and publishers across the globe in over 40 languages.

Minimum qualifications:

  • Bachelor’s degree in a quantitative discipline (e.g., Computer Science, Statistics, Mathematics, Operations Research) or equivalent practical experience.
  • 3 years of experience in data analysis or in a data science setting.
  • Experience with programming languages (e.g., Python, R, Julia) and database languages (e.g., SQL).

Preferred qualifications:

  • Master’s degree or PhD in a quantitative discipline (e.g., Computer Science, Statistics, Mathematics, Operations Research, etc.).
  • Experience working on Large Language Models (LLMs).
  • Experience analyzing the performance of Machine Learning (ML) models.
  • Experience with software development in one or more programming languages (e.g., Python, C, C++, Java, JavaScript) and/or data-focused programming.
  • Ability to generate actionable insights to drive business impact.

Responsibilities:

  • Conduct comprehensive safety analysis and evaluations of AI models to assess safety performance, accuracy, and efficiency of Google Cloud and Google Workspace Generative-AI products.
  • Establish metrics to benchmark Generative-AI issues and measure improvements.
  • Design and execute adversarial testing scenarios to assess the robustness and security of AI models and analyze datasets to extract insights into model safety performance and behavior.
  • Improve tools through data analysis, leveraging technical expertise to enhance the efficiency of evaluation processes, as well as generate comprehensive reports summarizing findings, insights, and actionable recommendations for stakeholders.
  • Collaborate with cross-functional groups such as Engineering, Product, and Policy  to integrate findings into the launch process optimizing safety experience for customers.