Product Manager / Owner
AI drafts and prototypes, so deciding what to build is the constraint
Print / Save as PDF
Top 3 changes for you
- 1Writing PRDs and product documentationProduct docs are a common AI task for product teams
- 2Communicating a product ideaWorking prototypes in hours can help win stakeholder buy-in
- 3Defining quality for AI featuresYou may be the expert grading AI outputs pass or fail
- Tools to try first
- ChatGPT(opens in new tab)
- Skills to build
- Writing evals and pass/fail criteria for AI features
- Reviewing real AI interactions to find failure modes
How your work changes
#Open any item to see before and now, with sources.
RequirementsWriting PRDs and product documentationIn Atlassian's survey, documentation is among the most common AI uses
Before
Product managers wrote requirement documents, user stories and presentations by hand, then refined them with design and engineering.
Now
Atlassian's State of Product 2026 found product documentation among the most common AI use cases on product teams.[1]
DesignCommunicating a product ideaOne study: high-fidelity AI prototypes helped participants win buy-in faster
Before
Ideas were described in documents and slides, and turning them into mockups or clickable prototypes usually depended on a designer or engineer.
Now
In one CHI 2026 study of how technical and non-technical people build products with AI tools (a survey of 85 people, plus interviews with 31 hackathon participants and 8 practitioners), participants said teams could now assemble working front-end versions in hours. They described a shift toward throw-away prototypes, valued for immediate exploration or demonstration. Participants used prototypes built with tools such as Lovable to persuade customers, investors and partners. The authors conclude that the unusually high fidelity of these early prototypes helped participants secure buy-in from stakeholders much faster than with traditional methods such as wireframes or paper prototypes.[7]
BuildMoving from a validated prototype to a real productCagan: prototypes are for learning; products must also handle scale and security
Before
Discovery produced specs, designs and prototypes that engineers then built into the product.
Now
Marty Cagan separates discovery, where teams are "building to learn", from delivery, where they are "building to earn". A learning prototype may cover just a few important use cases. A commercial product often has dozens or hundreds, and must also handle reliability, telemetry, performance at scale, data security and compliance. In one study of people building products with AI tools, deployment and long-term maintainability still depended on technical expertise, and non-technical users consistently hit barriers when moving beyond prototyping. Participants noted that adding features was simple, but modifying or removing them proved far more complex than building something new.[2][7]
PlanUnderstanding customer needsOne study: LLMs sorted feedback; their specs sometimes fabricated requirements
Before
Product managers read interview notes, support tickets and survey comments themselves, or waited for a scheduled research study to summarise them.
Now
In one 2025 study, five lightweight open-source LLMs classified app store reviews by request type and non-functional requirement with moderate-to-high accuracy. They also generated requirement specifications that were generally complete and coherent but often verbose and sometimes included fabricated requirements; one evaluator rated these, and the authors note a limited sample and call their results exploratory. The authors warn that moderate accuracy may produce noisy classifications that mislead analysts, so important feedback can be missed, and conclude that these models still require human oversight.[8]
PlanDeciding what to buildNg argues deciding what to build becomes the bottleneck as coding speeds up
Before
Roadmaps and prioritisation were planned around limited engineering capacity.
Now
Andrew Ng argues that agentic coding speeds up writing software to a given specification, so deciding what to build becomes the bottleneck, especially in early-stage projects. He values PMs with high user empathy who can make product decisions quickly. Atlassian's State of Product 2026 found that AI is not yet helping with prioritisation and planning. In one CHI 2026 study of people building products with AI tools, the authors argue that discovery and problem definition remain indispensable, and that tools promising instant results amplify the temptation to skip these early stages.[1][4][7]
TestDefining quality for AI featuresA study: LLM judges need human checks; Husain and Shankar suggest expert grading
Before
Product managers wrote acceptance criteria, and testers checked that features behaved as specified.
Now
A 2024 study notes that LLMs are increasingly used to help humans evaluate LLM outputs, but LLM-generated evaluators inherit the problems of the LLMs they evaluate and need further human validation. In its qualitative study with nine industry practitioners, users needed criteria to grade outputs, but grading outputs helped them define those criteria. For most small and medium-size companies, Hamel Husain and Shreya Shankar recommend one principal domain expert, in many situations the product manager, who reviews a representative set of around 100 user interactions and gives each a pass/fail judgement and critique.[3][6]
- Related on the QA Engineer / Tester page: Testing features built on large language models
- Related on the UX/UI Designer page: Defining what good output looks like
Risks to watch
#A polished prototype can hide how much work a real product takes
A polished prototype can hide how much work a real product takes. Marty Cagan notes that some product managers "embarrass themselves in front of their engineers" by assuming the leap is easy.[2]
In one PM study, uncertainty and diffused responsibility held back ethical AI use
Uncertainty and diffused responsibility can hold back responsible AI use. In a study drawing on twenty-five interviews and a global survey of over three hundred respondents in product management-related roles, uncertainty around responsible AI and a sense of diffused responsibility constrained ethical action, while leadership commitment and organisational principles enabled it.[5]
Time saved is not the same as better decisions
Time saved is not the same as better decisions. Atlassian found the most common AI uses are routine tasks and documentation, while AI is not yet helping with prioritisation or planning.[1]
Trying a few prompts by hand does not show how an AI feature fails
Trying a few prompts by hand does not show how an AI feature fails. Husain and Shankar argue you cannot know what to measure until you systematically find out how the product fails in specific contexts.[3]
In Atlassian's survey, integration, trust in AI output and data security held teams back
Product teams in Atlassian's survey named integration challenges, trust in AI outputs and data security concerns as barriers holding them back.[1]
Skills to build
#Human skills: what's new, what matters more, and what AI now does for you.
New skillsDidn't really exist in the role before
- Writing evals and pass/fail criteria for AI features
- Reviewing real AI interactions to find failure modes
- Building throwaway prototypes with AI tools
- Choosing which AI tool fits which prototyping task
More important nowExisting skills that AI makes more valuable
- User empathy
- Making product decisions quickly
- Synthesising customer insight from many sources
- Data literacy
- Systems and strategic thinking
- Explaining the gap between a prototype and a shippable product
Less centralStill useful, but AI now does much of it
- Drafting long PRDs from a blank page
- Building slides and first-draft roadmap documents by hand
- Waiting on design or engineering for a first clickable mockup
Tools
#"Start here" tools are the editor's pick of where to begin for this role. Our suggestion
Start here
Widely used and core to this role
- ChatGPT(opens in new tab)
· AI chat assistant
General AI assistant for drafting PRDs, presentations and research summaries, and for simple prototypes in chat.
Also worth a look
Depends on your team and stack
Show 6 toolsHide tools
- Claude(opens in new tab)Anthropic
General AI assistant for drafting and critiquing documents, analysing uploaded material, and simple prototypes in chat.
Turning a prompt and existing design context into an interactive prototype.[2]
- Lovable(opens in new tab)Lovable
Generating high-fidelity prototypes from a prompt to explore an idea or show it to stakeholders.[2][7]
- v0(opens in new tab)Vercel
Generating web app prototypes from natural-language prompts.
- Dovetail(opens in new tab)Dovetail
Collecting interviews, calls, surveys and feedback in one place and using AI to find themes, with links back to the source material.
- Braintrust(opens in new tab)Braintrust
Building eval datasets, scoring AI feature output with code, LLM judges or humans, and comparing prompt or model versions.
Your first steps
#- 1Check your company's AI policy for which tools you may use and what customer data may go into them.
- 2Use an approved AI assistant to draft your next PRD or one-pager, then compare the draft against what you would have written and note what it missed.
Show 3 more stepsShow fewer steps
- 3Build one throwaway prototype of an idea on your roadmap and show it to three customers before writing the full spec.
- 4Take a recent AI summary of customer feedback and spot-check a sample of its claims against the original tickets or transcripts.
- 5If your product has an AI feature, read about 100 real interactions, write down what went wrong, and agree pass/fail criteria with engineering.
A week in this role now
A typical week now has less blank-page writing and more checking. You might ask an assistant for a first draft of a one-pager, then spend your time correcting what it got wrong about the customer and the constraints. When an idea is still fuzzy, you build a rough prototype in an afternoon and put it in front of a few customers or your engineers, instead of waiting for a mockup. Feedback summaries arrive faster, but you still open the underlying tickets and transcripts before acting on a theme.
The harder part of the job is the part that did not get faster: choosing what is worth building and saying no to the rest. If your team ships AI features, part of the week goes to reading real interactions, agreeing what counts as a failure and keeping eval criteria up to date with engineering. Prototypes are for learning. Treat the gap between a working demo and a reliable product as real engineering work, and talk about it that way with your team.
Agent Skills
AI instructions to copy
#Each one is a text file (SKILL.md) that tells an AI tool, step by step, how to do one task the way you want. Copy it into a chat, or add it to a tool that supports Agent Skills. Which tools, and how
Starter instructions for this role
Our suggestionWritten from the changes above. Read and adapt one before you use it.
Customer feedback synthesisTurns tickets, surveys, reviews and call notes into themes traced back to the source
How to use it
- In any AI chat, such as ChatGPT, Microsoft 365 Copilot or Claude: choose Copy instructions, paste them at the start of a new chat, then add your material. Our suggestion
- Install it in Claude (web or desktop): download the .zip, then go to Customize › Skills › + › Create skill › Upload a skill. Code execution must be turned on. Claude help (opens in new tab)
- Install it in a coding agent such as Claude Code, GitHub Copilot or Codex: unzip the folder into the tool's skills folder. Folder locations
Show the full file
File name
SKILL.md, in a folder namedcustomer-feedback-synthesis. When to use it: Synthesises high-volume customer feedback from support tickets, survey comments, app or product reviews and sales call notes into themes, with every theme traced back to the original items and a spot-check of the summary against the source. Use when a product manager asks to summarise a large set of customer feedback, find recurring themes or pain points, prepare insight for roadmap or prioritisation discussions, or turn a pile of tickets and comments into evidence for a product decision. For moderated interviews or usability sessions, use the UX research synthesis instead.--- name: customer-feedback-synthesis description: "Synthesises high-volume customer feedback from support tickets, survey comments, app or product reviews and sales call notes into themes, with every theme traced back to the original items and a spot-check of the summary against the source. Use when a product manager asks to summarise a large set of customer feedback, find recurring themes or pain points, prepare insight for roadmap or prioritisation discussions, or turn a pile of tickets and comments into evidence for a product decision. For moderated interviews or usability sessions, use the UX research synthesis instead." metadata: title: "Customer feedback synthesis" summary: "Turns tickets, surveys, reviews and call notes into themes traced back to the source" --- # Customer Feedback Synthesis Turn scattered customer feedback into traceable themes a product manager can verify before acting on them. This skill is for feedback at volume, used for prioritisation. A handful of moderated interviews or usability sessions needs a qualitative research synthesis instead, where who said what matters more than counts. ## What to gather first Ask for anything missing before you start: - The feedback itself: support tickets, survey comments, reviews or sales call notes, with an identifier for each item. - The question the synthesis should answer (for example "why do trial users churn?"), not just "summarise this". - Who the feedback comes from: segment, plan, region or product area, and the time period it covers. - Whether the data is allowed to be processed here. Confirm the user has checked their company's AI policy for customer data, and ask them to remove personal details they do not need. - Any themes the team already believes in, so you can test them rather than repeat them. Ask for anything missing once. If the user can't provide it or asks you to go ahead, proceed and record every assumption. ## Steps 1. Restate the question and the scope (sources, segment, period) in one short paragraph, and confirm it with the user if anything is unclear. 2. Read every item. Give each an ID if it has none, and note its source type and segment. 3. Note the need or problem behind each item, not the feature the customer asked for. Keep the customer's own words next to your note. 4. Group notes into themes. A theme needs at least two independent items; keep single items in an "Unclustered" list instead of forcing them into a theme. 5. For each theme, list every supporting item ID, pick one or two short verbatim quotes, and describe who raised it (segments, source types). 6. Look for disagreement: items that contradict a theme, or segments that want opposite things. Record them under the theme. 7. Compare your themes with the beliefs the team already holds. Mark each belief as supported, contradicted or not covered by this data. 8. Spot-check your own work: pick at least three themes (or all themes if there are fewer), reopen their source items, and confirm each quote is verbatim and each item really supports the theme. Fix or drop anything that does not hold. 9. Describe how often something came up only in plain words tied to this dataset ("mentioned in 7 of the 40 tickets reviewed"). Counts are fine for large ticket or survey sets; for a small qualitative sample, describe who raised it instead. Never extrapolate to all customers. 10. List the open questions that this data cannot answer and suggest how the product manager could find out (for example a follow-up interview). ## Output format ```markdown # Feedback synthesis: <question> **Scope:** <sources, segment, period, number of items reviewed> **Prepared by:** AI draft for review ## Themes ### 1. <Theme name, phrased as a customer problem> - **What customers are trying to do:** <one or two sentences> - **Evidence:** <item IDs> - **Who raised it:** <segments, source types> - **In their words:** "<verbatim quote>" (<item ID>) - **Counter-evidence:** <item IDs and a short note, or "none found"> ## Existing beliefs checked | Belief | Supported / Contradicted / Not covered | Item IDs | | ------ | -------------------------------------- | -------- | ## Unclustered items - <item ID>: <one-line note> ## Spot-check log | Theme | Items reopened | Result | | ----- | -------------- | ------ | ## Open questions for further research - <question> — <suggested way to find out> ## Assumptions and open questions - <assumption or question, and who can confirm> ``` ## Watch out for - A fluent summary is not the same as a correct one. Every claim must point to item IDs a human can open. - Loud or repeated feedback from one account can look like a trend. Count distinct customers, not messages, when you can tell them apart. - Feature requests are not needs. Keep "they asked for X" separate from "they are struggling with Y". - The synthesis informs prioritisation; it does not decide it. Do not rank the roadmap or recommend what to build. - Do not invent segments, revenue impact or customer names that are not in the data. - Never reproduce secrets, credentials or personal data (names, emails, account details) in the output unless the user needs them; anonymise quotes by default. ## Before you finish - [ ] Every theme lists item IDs and at least one verbatim quote. - [ ] The spot-check log shows at least three themes (or all, if fewer) rechecked against the source. - [ ] Counter-evidence and unclustered items are included, not hidden. - [ ] No numbers extend beyond the dataset reviewed. - [ ] No recommendation on what to build is presented as decided. - [ ] Clearly flag your assumptions and anything a human must review or decide before this is shared or acted on.AI feature eval criteriaReviews real AI feature use to name failure modes and draft pass/fail quality criteria
How to use it
- In any AI chat, such as ChatGPT, Microsoft 365 Copilot or Claude: choose Copy instructions, paste them at the start of a new chat, then add your material. Our suggestion
- Install it in Claude (web or desktop): download the .zip, then go to Customize › Skills › + › Create skill › Upload a skill. Code execution must be turned on. Claude help (opens in new tab)
- Install it in a coding agent such as Claude Code, GitHub Copilot or Codex: unzip the folder into the tool's skills folder. Folder locations
Show the full file
File name
SKILL.md, in a folder namedai-feature-eval-criteria. When to use it: Helps a product manager define what good output looks like for an AI feature by reviewing real user interactions, naming failure modes and drafting binary pass/fail criteria to agree with engineering and QA. Use when defining what good output means for an AI feature from real user interactions (error analysis), before building an eval suite.--- name: ai-feature-eval-criteria description: "Helps a product manager define what good output looks like for an AI feature by reviewing real user interactions, naming failure modes and drafting binary pass/fail criteria to agree with engineering and QA. Use when defining what good output means for an AI feature from real user interactions (error analysis), before building an eval suite." metadata: title: "AI feature eval criteria" summary: "Reviews real AI feature use to name failure modes and draft pass/fail quality criteria" --- # AI Feature Eval Criteria Draft pass/fail criteria for an AI feature, grounded in how it actually fails on real interactions. This skill stops at the criteria. Building the eval dataset, grading and regression runs is covered by QA's eval plan (`llm-feature-eval-plan`). ## What to gather first Ask for anything missing before you start: - What the feature is for: the user, the task it helps with, and what a successful outcome means for that user. - A sample of real interactions (inputs and outputs), ideally from production or a realistic test group. If none exist, say that criteria written without them are provisional. - Confirmation that the sample may be used here under the company's AI and data policy, with personal details removed. - Any existing acceptance criteria, product rules, tone guidelines or policies the output must respect. - Who the principal domain expert is (often the product manager) and who in engineering or QA will build the evals. Ask for anything missing once. If the user can't provide it or asks you to go ahead, proceed and record every assumption. ## Steps 1. Summarise the feature's purpose and the user's goal in two or three sentences. Confirm it with the user. 2. Read each interaction in the sample. For each, write a pass or fail judgement and a one-sentence critique saying why. Do not skip the ones that look fine. 3. Mark every judgement you are unsure about as "needs expert review" rather than guessing. 4. Group the failure critiques into named failure modes (for example "invents a policy", "ignores the user's constraint", "wrong tone for an upset customer"). Keep the wording specific to this product. 5. For each failure mode, list the interaction IDs that show it and describe the context in which it happens. 6. Turn each failure mode into a binary criterion that a reviewer could apply consistently: "Pass if…, Fail if…". Avoid rating scales unless the user asks for them. 7. For each criterion, suggest how it could be checked: human review, a code-based check (for format, length, required fields) or an AI judge that a human calibrates first. Say which checks need a human. 8. Suggest which interactions QA could keep as starter test cases, including passes, failures and edge cases. Leave the dataset, grading and regression runs to QA's eval plan. 9. List what the sample did not cover (user types, languages, rare but risky situations) so the team can collect more. 10. Draft questions to agree with engineering, such as where the evals run and what result would block a release. Leave the thresholds for humans to set. ## Output format ```markdown # Eval criteria draft: <feature name> **Feature goal:** <who it helps and with what> **Sample reviewed:** <number of interactions, source, date range> **Status:** Draft for domain expert and engineering review ## Interaction review | ID | Pass/Fail/Needs expert review | Critique | | --- | ----------------------------- | -------- | ## Failure modes ### <Failure mode name> - **Seen in:** <interaction IDs> - **When it happens:** <context> - **Why it matters to the user:** <one sentence> ## Criteria | # | Criterion (Pass if… / Fail if…) | Failure mode | Suggested check | Human needed? | | --- | ------------------------------- | ------------ | --------------- | ------------- | ## Starter eval set - <interaction ID>: <why it is included> ## Gaps in the sample - <situation not covered> ## Questions to agree with engineering - <question> ## Assumptions and open questions - <assumption or question, and who can confirm> ``` ## Watch out for - Trying a few prompts by hand does not show how a feature fails. Base criteria on the real sample, and say plainly when the sample is thin. - Generic criteria like "helpful" or "accurate" cannot be applied consistently. Rewrite them until two reviewers would agree. - AI output can differ for the same input. A single pass on a test case is not proof it will always pass. - An AI judge needs to be checked against human judgements before anyone trusts it. - Do not decide release thresholds, and do not present your pass/fail calls as final. The domain expert makes those calls. - Never reproduce secrets, credentials or personal data (names, emails, account details) in the output unless the user needs them; anonymise quotes by default. ## Before you finish - [ ] Every interaction in the sample has a judgement and a critique. - [ ] Every criterion links to a failure mode seen in real interactions. - [ ] Uncertain judgements are marked for expert review. - [ ] Gaps in the sample are listed. - [ ] No release threshold or ship decision is presented as settled. - [ ] Clearly flag your assumptions and anything a human must review or decide before these criteria are used.
Prototype to product gapLists what a tested prototype still needs to become a shippable product
How to use it
- In any AI chat, such as ChatGPT, Microsoft 365 Copilot or Claude: choose Copy instructions, paste them at the start of a new chat, then add your material. Our suggestion
- Install it in Claude (web or desktop): download the .zip, then go to Customize › Skills › + › Create skill › Upload a skill. Code execution must be turned on. Claude help (opens in new tab)
- Install it in a coding agent such as Claude Code, GitHub Copilot or Codex: unzip the folder into the tool's skills folder. Folder locations
Show the full file
File name
SKILL.md, in a folder namedprototype-to-product-gap. When to use it: Reviews a validated prototype or demo and drafts a plain-language gap analysis of what is still needed to turn it into a shippable product, such as untested use cases, reliability, telemetry, performance, data security and compliance, plus open questions for engineering. Use when a product manager has an AI-built or throwaway prototype that tested well and needs to plan next steps, brief engineers, set expectations with stakeholders, or avoid treating a demo as nearly done.--- name: prototype-to-product-gap description: "Reviews a validated prototype or demo and drafts a plain-language gap analysis of what is still needed to turn it into a shippable product, such as untested use cases, reliability, telemetry, performance, data security and compliance, plus open questions for engineering. Use when a product manager has an AI-built or throwaway prototype that tested well and needs to plan next steps, brief engineers, set expectations with stakeholders, or avoid treating a demo as nearly done." metadata: title: "Prototype to product gap" summary: "Lists what a tested prototype still needs to become a shippable product" --- # Prototype to Product Gap Draft an honest list of what separates a learning prototype from a product customers can rely on, to discuss with engineering. ## What to gather first Ask for anything missing before you start: - What the prototype does: a description, screenshots, a walkthrough, or read access to its code if the user wants you to look. - What it was built to learn, and what customers or stakeholders actually said when they tried it. - The use cases the prototype covers, and the product area or existing system it would become part of. - Known constraints: target users and scale, data involved (especially personal or regulated data), platforms, and any company rules for AI-built code. - Who will read the result (engineering lead, stakeholders, leadership) and what decision it should support. Ask for anything missing once. If the user can't provide it or asks you to go ahead, proceed and record every assumption. ## Steps 1. Summarise what the prototype proved and what it did not try to prove. Separate evidence from customer sessions from the product manager's own impressions. 2. List the use cases the prototype covers. Then draft the use cases a real product would likely need (other user roles, empty and error states, edits, cancellations, permissions, migrations). Mark which are guesses for the team to confirm. 3. Walk through each product concern below and note what the prototype does today, what is unknown, and a question for engineering: - reliability and error handling - telemetry and analytics - performance at expected scale - data security and privacy - compliance and legal requirements - accessibility - integration with existing systems and data - support, operations and maintenance 4. If you were given code, note any shortcuts that are typical of prototypes (hardcoded data, missing authentication, no tests). Describe them as observations, not verdicts on quality. 5. Decide, with the user, which parts of the prototype are worth keeping as reference (flows, copy, layout) and which should be treated as throwaway. 6. Draft open questions for engineering and design. Do not produce effort estimates or dates; ask the team for them. 7. Write a short stakeholder summary that explains the gap without technical jargon and without promising a launch date. ## Output format ```markdown # From prototype to product: <idea name> **Prototype built to learn:** <question> **What we learned:** <evidence, with source of each point> **Status:** Draft for engineering and design review ## Use cases | Use case | In prototype? | Needed for product? (confirm) | | -------- | ------------- | ----------------------------- | ## Product concerns | Concern | Prototype today | Unknowns | Question for engineering | | ------- | --------------- | -------- | ------------------------ | ## Keep as reference vs throwaway - **Keep:** <flows, copy, patterns> - **Throwaway:** <parts not intended for production> ## Stakeholder summary <three to five plain sentences> ## Assumptions and open questions - <assumption or question, and who can confirm> ``` ## Watch out for - A polished prototype can hide how much work a real product takes. Never describe it as "almost done" or suggest the leap is easy. - Positive reactions in a demo are not proof of demand or willingness to pay. Keep the evidence and its limits visible. - Do not estimate effort, cost or timelines. Those belong to the engineering team. - Do not recommend shipping prototype code as-is, and do not deploy, merge or share it. - If the prototype used real customer data, flag that for a data policy check. - Never reproduce secrets, credentials or personal data (names, emails, account details) in the output unless the user needs them; anonymise quotes by default. - Prioritisation is the product manager's call. Present gaps, not a ranked plan. ## Before you finish - [ ] Every product concern in step 3 has an entry, even if it is "unknown". - [ ] Guessed use cases are marked for the team to confirm. - [ ] No effort, date or "nearly done" language appears. - [ ] The stakeholder summary matches the detailed sections. - [ ] Clearly flag your assumptions and anything a human must review or decide before this is shared.
Published skills you can reuse(3)From public skill catalogs. Check the license before use.
- doc-coauthoring(opens in new tab)anthropics/skillsNo license file
Co-writing PRDs, proposals and decision docs in a structured, iterative workflow.
- notion-spec-to-implementation(opens in new tab)openai/skillsOpen source
Turning a PRD in Notion into an implementation plan with tasks and progress tracking.
- pptx(opens in new tab)anthropics/skillsSource-available
Creating and editing slide decks for reviews and roadmap presentations.
Related roles
Related roles
Works closely with
Our suggestion- Business AnalystAI drafts requirements; you add context and catch subtle errors
- UX/UI DesignerAI speeds up drafts; design judgement and real research matter more
- QA Engineer / TesterAI can draft and repair tests; testers direct and check the work
- Data Engineer / AnalystAI drafts the SQL; you define meaning and check the numbers
- Scrum Master / Agile CoachFacilitate how the team uses AI and keep humans accountable
Sources (8)
4 research papers, 3 practitioner articles, 1 survey · 4 vendor-affiliated
Sources (8)
4 research papers, 3 practitioner articles, 1 survey · 4 vendor-affiliated
Each source is labelled by what the page is and whether its publisher sells in this space. How we label sources
- 1.The State of Product in 2026: Navigating Change, Challenge, and Opportunity(opens in new tab)
Atlassian · 3 September 2025
SurveyVendor-affiliated
“AI isn't yet helping with the complex, high-value work product teams crave, like prioritization, planning, and advanced analytics.”
- 2.Prototypes vs Products(opens in new tab)
Silicon Valley Product Group (Marty Cagan) · 7 November 2025
PractitionerVendor-affiliated
- 3.Building eval systems that improve your AI product(opens in new tab)
Lenny's Newsletter (Hamel Husain and Shreya Shankar) · 9 September 2025
PractitionerVendor-affiliated
“In many situations, the product manager is the principal domain expert.”
- 4.How to Get Through the Product Management Bottleneck(opens in new tab)
DeepLearning.AI, The Batch (Andrew Ng) · 16 July 2025
PractitionerVendor-affiliated
“I increasingly value product managers (PMs) who have very high user empathy and can make product decisions quickly, so the speed of product decision-making matches the speed of coding.”
- 5.Guardrails versus Gatekeepers: Understanding Product Managers' Ethical Decision-Making in Generative AI(opens in new tab)
arXiv (Smith, Luka, Osborne, Lattimore, Newman, Mittelstadt, Nonnecke; FAccT 2026) · 9 June 2026
Research paper
“We find that uncertainty around responsible AI and a sense of diffused responsibility constrain ethical action, while leadership commitment and organizational principles enable ethical action”
- 6.Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences(opens in new tab)
arXiv (Shankar, Zamfirescu-Pereira, Hartmann, Parameswaran, Arawjo; UIST 2024) · 18 April 2024
Research paper
“Yet LLM-generated evaluators simply inherit all the problems of the LLMs they evaluate, requiring further human validation.”
- 7.From Throw-Away to Takeaway: How GenAI and Vibe Coding Accelerate Prototyping Across Technical Skill Levels(opens in new tab)
ACM CHI 2026 (Kobiella, Breidenstein, Schmidt; CDTM and LMU Munich) · 13 April 2026
Research paper
“This shows that prototypes were not only used as internal design artifacts but also as persuasive tools, and, with GenAI, their unusually high fidelity at an early stage enabled participants to build credibility and secure buy-in from stakeholders much faster than with traditional methods such as wireframes or paper prototypes.”
- 8.From Online User Feedback to Requirements: Evaluating Large Language Models for Classification and Specification Tasks(opens in new tab)
arXiv (Mallya, Ferrari, Zadenoori, Dąbrowski; University of Limerick, UCD, University of Padova) · 27 October 2025
Research paper
“Generated specifications were generally complete and coherent but often verbose and sometimes included fabricated requirements.”