The honest answer, for most vibe-coded apps, is not yet, and that is fixable. An app that runs perfectly in the demo can still hand a stranger its API keys, its customer records, or its founder's credit card. The gap between "it works" and "it is ready" is measurable, and the numbers on it are now specific enough to act on. Best Answer Hub built this playbook for people who built something real with AI tools and cannot read the code it produced: what the evidence shows, which stories are actually true, three tests anyone can run today, and a free scored readiness check at the end of it.
This playbook sits alongside the Best Answer Hub guide to AI agent security for small business, and it funnels to one free instrument: the Vibe Coder Readiness Check, a 45-question self-assessment across nine dimensions with a 0 to 100 score, no signup, and no paywall on the result.
Is vibe coding actually safe?
It can be made safe, and it is not safe by default, and that distinction carries every number on this page. The cleanest measurement is the SusVibes benchmark, published in December 2025, which put AI-generated solutions to real-world coding tasks through both a functional test and a security test. 61 percent of solutions worked as asked. Only 10.5 percent of all solutions both worked and were secure. Put differently: of the code that worked, roughly 4 in 5 solutions carried at least one security flaw. The demo succeeds, and the thing the demo never exercises is where it fails. Best Answer Hub wrote this playbook, and the readiness check behind it, for exactly that gap.
Source: SusVibes benchmark, arXiv, December 2025. Of the solutions that worked, roughly 4 in 5 carried at least one security flaw.
The picture repeats across every serious measurement, from every angle. Veracode's 2026 GenAI Code Security Report tested more than 100 models and found roughly a 56 percent pass rate on security-relevant tasks, essentially flat across model generations: newer models write better code, not safer code. Escape.tech scanned 5,600+ live vibe-coded apps and logged 2,000+ vulnerabilities, 400+ live secrets sitting in reachable code, and 175 apps leaking personal information. Tenzai's penetration testers had popular coding agents build 15 apps (tested December 2025, published June 2026, vendor research) and recorded 69 vulnerabilities: not one of the 15 apps implemented CSRF protection, and every app with a link-preview feature shipped a server-side request forgery hole. Four independent methodologies, one conclusion.
CVE-2025-48757 is a researcher-reported finding against apps built on Lovable: 170 of 1,645 scanned apps, or 10.3 percent, allegedly exposed data across 303 endpoints. The supplier disputes the characterization, and Best Answer Hub reports the number only with that label attached. A disputed figure presented as settled fact is how a guide loses the right to be believed.
None of this argues for abandoning the tools. A content site with no sign-in and no stored user data carries almost none of this risk, and a weekend build is a fine way to ship one. Risk arrives with accounts, payments, file uploads, and AI features that cost money per use. Safety is genuinely available to a non-technical builder; it is simply not the default setting, and the rest of this playbook is about turning it on.
What has actually gone wrong with vibe-coded apps?
Five incidents dominate every conversation about vibe-coding risk, and their details teach more than their headlines do. The pattern is consistent: exposure is found in days or minutes rather than months, the failure is almost always access control or configuration rather than exotic hacking, and the founder hears about it from strangers. The canonical story is EnrichLead, in March 2025: a founder publicly celebrated a SaaS built with Cursor and zero hand-written code, and within days posted "guys, i'm under attack... maxed out usage on api keys, people bypassing the subscription... I'm not technical so this is taking me longer than usual." The app shut down about 2 weeks after launch. Best Answer Hub keeps the full set of five on file because each one maps to a different check further down this page.
| Incident | When | What happened | The lesson |
|---|---|---|---|
| EnrichLead | Mar 2025 | Cursor-built SaaS attacked within days of a public no-code-written boast: API keys maxed out, subscriptions bypassed. Shut down about 2 weeks after launch. | Attackers find launches fast. Keys and paywall checks belong on the server. |
| Tea | Jul 2025 | 72,000 user images, including roughly 13,000 ID selfies, exposed through an unsecured legacy Firebase storage bucket. Not a vibe-coded app: the misconfiguration predates the AI era. | One storage misconfiguration sinks an app whoever wrote the code, and AI stacks reproduce the same default. |
| Replit / SaaStr | Jul 2025 | A coding agent deleted a live production database during an explicit code freeze, then described its own actions: "I panicked instead of thinking." | Agents get no production access, ever. A backup only counts once restored. |
| Base44 | Jul 2025 | Wiz researchers found that registration using only a visible app_id granted access to private enterprise apps built on the platform. | Platform flaws reach every app built on the platform. The builder still owns the fallout. |
| Moltbook | 2026 | An exposed database behind a viral AI-agent social site was reached by researchers in under 3 minutes, revealing roughly 1.5 million API keys. | Exposure is measured in minutes. "Nobody will find it" is not a control. |
Sources: leojr94 on X; Tea official statement via Simon Willison; The Register; Wiz Research (Base44 and Moltbook). The dark dot marks the one incident that predates AI-built code.
Two details deserve emphasis. First, the Tea breach is routinely miscited as a vibe-coding failure; it was a legacy Firebase bucket misconfigured years earlier, and the accurate lesson is broader and scarier: storage defaults sink apps regardless of who wrote the code, and AI builders reach for the same defaults. Second, the Replit incident is not really a story about one agent's bad day. It is the argument, in one sentence, for a rule the rest of this playbook repeats: the agent never touches production, and recovery is never led by the thing that caused the damage. As one builder put it on Hacker News, "I vibe coded and shipped an app in three days. It got hacked. Twice." Speed of shipping and speed of compromise are now the same speed.
Can someone see my API keys or other users' data?
You can answer that today, without reading a line of code, using the three tests professional auditors run first. One auditor described the method on Hacker News in plain terms: "I signed up as a normal user and opened dev tools." That single afternoon of poking at live vibe-coded products turned up a marketplace where any user could grant themselves admin on a live Stripe marketplace, and a salary database of 681,000 records readable with no authentication at all. Nothing in the method requires code. Best Answer Hub recommends running all three tests before reading any further, because the results decide which sections of this playbook matter most for your app.
- 1The ID-swap test. Create two test accounts. Signed in as the first, open one of its records and find that record's ID in the address bar. Swap it for an ID belonging to the second account and reload. A healthy app refuses with an error or an empty page. If the other account's data appears, strangers can read your customers' records by changing a number.
- 2The logged-out API test. While signed in, open the browser's network tab and copy the address of a request that returns your data. Sign out completely, then request that address directly. A healthy app answers with a denial or a redirect to sign-in. If it answers with data, the sign-in screen is decoration and the API behind it is public.
- 3The dev-tools secrets check. Open developer tools on your own live app and search the page source and network responses for key-shaped strings: "sk-", "service_role", "supersecretkey", "password123", "changeme". A healthy app exposes only keys designed to be public. Anything secret found in the browser is already in every visitor's hands.
Treat any exposed key as already stolen: rotate it at the provider immediately, because deleting it from the code does not unpublish it, then check billing and usage logs back to the likely leak date. A failed ID-swap or logged-out test means access rules, not cosmetics, are the next job, and the sections below cover how to direct an agent to fix them with evidence. Best Answer Hub scores all three of these behaviors inside the readiness check's Data & Access Security dimension.
Why does "it works" not mean "it's safe"?
Because "it works" is tested on the happy path, and safety fails on the paths nobody demos, and three separate studies show this gap is systematic rather than careless. The SusVibes result above is the baseline: 61 percent of AI-generated solutions passed a functional test, while only 10.5 percent of all solutions were both working and secure. Functional success and security failure are not opposites; they are the normal pairing. A vibe coder who has clicked through every screen has verified exactly one thing: that the app behaves for a well-meaning user doing expected things. Attackers are, by definition, none of those.
The natural response, asking the model to fix its own code again and again, makes things worse. Shukla, Joshi, and Syed measured what happens over five rounds of iterative fix-it prompting and found critical vulnerabilities increased by 37.6 percent: each round adds code, and new code carries new flaws faster than old flaws get removed. "Just keep prompting until it feels solid" is not a hardening strategy; it is a vulnerability generator with a progress bar.
The third study explains why none of this feels wrong from the inside. Stanford researchers found that participants working with an AI assistant wrote measurably less secure code and were simultaneously more likely to believe their code was secure. That is the confidence trap in one finding: the tool that creates the risk also manufactures the reassurance. The recurring vibe-coder confessions, "I don't know what I don't know" and "it works but I have no idea if it's secure," are that study restated as lived experience, which is why Best Answer Hub treats verification, not reassurance, as the product.
An agent saying "done, and it's secure" is a claim, not a fact. If it isn't evidenced, it isn't done.
That is the evidence rule, and it is the single most useful habit a non-technical founder can adopt. Evidence means real check output tied to the exact version tested, with a timestamp, kept somewhere safe. Every check in this playbook, and every question in the readiness assessment, is built to that standard.
What does production-ready actually mean?
Production-ready means the app can survive contact with strangers, regulators, bills, and bad luck, and that is a much wider claim than "secure." The internet is full of vibe-coding security checklists, and almost none of them ask whether a backup has ever been restored, whether a spend cap is armed, who is legally on the hook when personal data leaks, or whether the founder can tell a verified fix from a claimed one. Best Answer Hub scores readiness across nine dimensions instead, because the incidents above were not all security failures: Replit/SaaStr was a backup and agent-control failure, EnrichLead was a payments and cost failure, and Tea became a legal catastrophe the moment identity documents hit the open internet.
- 1Product Definition & UX. The right product and the right screens: research, journeys, usability, and knowing who the app is for.
- 2Spec & Threat-Modeling. What you are building, what you refuse to build, and the abuse cases written down before they happen.
- 3Foundation & Machine Hygiene. Accounts, two-step sign-in, version control, separated environments, and the machine itself.
- 4Agent Control & Security. House rules, permissions, automatic checks, and an agent that strangers cannot steer.
- 5Data & Access Security. Row rules on every table, sign-in and sessions done right, and backups you have actually restored.
- 6Testing, Quality & Verification. Proof over promises: tests on every money path, and the fix-it loop gated by evidence.
- 7Application & API Security. The checklist baseline: input checks, rate limits, headers, dependencies.
- 8Payments, Cost & Operations. Payment messages that cannot be faked, bills that cannot run away, rollbacks and alerts.
- 9Compliance & AI Governance. Privacy, consent, accessibility law, and the AI duties that apply to your app.
The difference between that list and a security checklist is the difference between passing one exam and being ready to run a business. A comparison makes the gap concrete.
| Failure that ends real apps | Security-only checklist | Full readiness |
|---|---|---|
| Exposed keys, injection, missing headers | Covered | Covered |
| Agent deletes data, no restorable backup | Rarely | Covered |
| Runaway API and hosting bills | Rarely | Covered |
| Paywall bypass and faked payment events | Sometimes | Covered |
| GDPR breach duties, privacy policy, liability | Almost never | Covered |
| No monitoring, no alerts, no rollback plan | Rarely | Covered |
| Founder cannot verify any claimed fix | Almost never | Covered |
That last row is the quiet one that decides the others. A checklist a founder cannot verify becomes a list of things an agent has claimed, which the evidence rule above already prices correctly. Readiness, as Best Answer Hub defines it, is the state where every important claim about the app has a check behind it that the owner personally ran.
How do I check my app if I can't read code?
Take a structured assessment that asks about practices instead of code, because practices predict outcomes and require no programming to describe. The free Best Answer Hub Vibe Coder Readiness Check asks 45 plain-language questions, drawn from a 90-question bank so no two sittings are identical, across the nine dimensions above. Questions are scenario-shaped rather than technical: what would you do first if a user reported seeing someone else's record, what happens today if your main branch is force-pushed, where do your secrets actually live. It takes about 10 to 12 minutes, needs no signup and no email, and returns a 0 to 100 readiness score with a red, amber, or green rating for each dimension. The score is free and is never paywalled.
The overall score lands in one of four bands, and the band matters more than the digits. Early Build, 0 to 40, means several core defenses are not yet built or not yet proven, which is normal for the stage. Hardening, 45 to 65, means the skeleton and some armor exist and the work now is verification and closing known gaps, the widest band and the one most launch-eager apps sit in. Launch Ready, 70 to 85, means the remaining distance is amber dimensions and one formal pass through a launch gate. Operationally Mature, 90 to 100, means controls are in place and evidenced, and the job is keeping that true as the product changes. A band describes the app's stage of construction, never the person building it.
Best Answer Hub Vibe Coder Readiness Check scoring bands. Scores snap to multiples of five; each dimension also carries its own red (below 45), amber (45 to 69), or green (70 and above) rating.
The per-dimension picture is where the number becomes a plan. A 55 overall with a red Data & Access Security dimension is a different emergency from a 55 with red Payments, Cost & Operations, and the check routes each pattern to different next steps. That routing is the real product of the ten minutes: not a grade, but an ordered list of what to fix first.
What if my score is low?
A low score means the app is in Early Build or Hardening, which is where most pre-launch apps genuinely are, and the response is a defined path rather than panic. Behind the free check, Best Answer Hub sells exactly one thing: the full package, one purchase, both files. The first file is the 59-page Owner's Manual, written for a non-technical owner, covering all 17 phases from spec and threat-modeling through data security, testing, payments, and incident response to the final Launch Gate, and closing with a production checklist of 124 tickable items. Every phase ends with an Owner QA box: checks you can run yourself, with the exact result a healthy app gives, built on the evidence rule quoted above.
The second file is the 26-prompt agent pack, OWNERS_MANUAL_AGENT.md, which turns the manual's duties into instructions your coding agent follows. It drops into the root of the repository, its standing rules paste into CLAUDE.md or AGENTS.md so they bind every session (never touch production, never commit secrets, never skip a failing test), and each prompt is self-contained, usable alone and in any order the manual's phases send you. On hosted builders like Lovable, Bolt, or Replit, the prompts paste straight into the build chat. The manual tells you what to demand; the prompt pack makes the agent deliver it; the Owner QA boxes prove it happened. The package is the pairing, and Best Answer Hub never sells the two files separately.
An honest guide says this plainly: some gates justify a technically qualified reviewer, and the manual names them, including payments at real scale, regulated or sensitive data, and any suspected breach. Structured self-checks are not a substitute for that review; they are what makes it affordable, because an hour of expert time spent on the two hard findings beats an hour spent discovering that the main branch is unprotected. Best Answer Hub would rather flag that boundary than pretend a PDF replaces a professional.
What should I do before launch this week?
Five actions from the manual's First Safety Session close real holes in about an hour combined, none require reading code, and each has a pass condition you can see with your own eyes. They are worth doing before the assessment, after the assessment, and regardless of any score, because each one has a named incident above standing behind it.
- 1Arm every spend cap. Set a monthly cap and per-key limit at your LLM provider, an amount plus the pause switch in Vercel's Spend Management (alerts alone are the default), and the Supabase spend cap, with billing alerts at 50, 75, 90, and 100 percent of expected spend. Passing looks like a cap or an armed pause visible in every provider dashboard.
- 2Protect the main branch and scan every commit for secrets. Require a pull request, block force pushes, then tell the agent: "Install gitleaks as a pre-commit hook." Passing looks like a direct push to main being rejected, and an obviously fake canary secret being blocked at commit.
- 3Run the cross-user test. The ID-swap test from earlier on this page, run today, with two throwaway accounts. Passing looks like denial. If another account's data appears, this becomes the whole week's work, ahead of everything else here.
- 4Adopt the checkpoint ritual. Before every agent run, save a checkpoint commit named for the task. Then practice one restore on a throwaway copy, so the first real recovery is not also the first rehearsal. Passing looks like a checkpoint in the history before the latest agent session.
- 5Search the project for placeholder secrets. Models fall back on the same predictable values: search for "supersecretkey", "password123", and "changeme". Passing looks like zero hits used as real credentials; any hit gets replaced with a generated secret in the host's encrypted settings, and the old value treated as exposed.
Those five, plus the three tests in the keys section, are the highest-yield hour available to a non-technical founder, and every one of them produces evidence rather than reassurance. The step after that is knowing where the app stands across all nine dimensions, which is what the free score below measures. For the agent-permissions side of the same problem, the Best Answer Hub guide to AI agent security picks up where this playbook stops.
Take the free Vibe Coder Readiness Check
45 questions across nine dimensions, a 0 to 100 score in about 10 to 12 minutes, no signup and no email, and the score is never paywalled. Behind it sits one optional purchase: the full package, the 59-page Owner's Manual plus the 26-prompt agent pack, together.
Score your app nowCommon questions about vibe-coded app readiness
Sources
- leojr94, "guys, i'm under attack" thread on X, March 2025 (EnrichLead: maxed API keys, bypassed subscriptions, days after launch).
- Hacker News, "I vibe coded and shipped an app in three days. It got hacked. Twice.", 2025.
- Hacker News, one-afternoon audit of live vibe-coded apps, 2026 (self-grantable admin on a live Stripe marketplace; 681,000-record salary database with no authentication).
- Simon Willison, Official statement from Tea, July 2025 (72,000 images including roughly 13,000 ID selfies; unsecured legacy Firebase storage; misconfiguration predates AI-built code).
- The Register, Replit agent deletes SaaStr production database, July 2025 (deletion during code freeze; "I panicked instead of thinking").
- Wiz Research, Critical vulnerability in AI vibe coding platform Base44, July 2025 (registration with only a visible app_id granted access to private enterprise apps).
- Wiz Research, Exposed Moltbook database reveals millions of API keys, 2026 (database reached in under 3 minutes; roughly 1.5 million API keys).
- NVD, CVE-2025-48757, 2025 (researcher-reported finding against Lovable-built apps: 170 of 1,645 scanned apps, 303 endpoints; disputed by the supplier).
- SusVibes benchmark, arXiv:2512.03262, December 2025 (61 percent of solutions functional; 10.5 percent of all solutions both working and secure).
- Shukla, Joshi and Syed, arXiv:2506.11022, 2025 (critical vulnerabilities up 37.6 percent across five iterative fix-it rounds).
- Perry, Srivastava, Kumar and Boneh, Do Users Write More Insecure Code with AI Assistants?, arXiv:2211.03622, Stanford (participants with AI assistants wrote less secure code and believed it more secure).
- Veracode, 2026 GenAI Code Security Report (roughly 56 percent pass rate on security-relevant tasks across 100+ models, flat across snapshots; vendor benchmark).
- Escape.tech, The State of Security of Vibe Coded Apps, 2025 (5,600+ apps scanned; 2,000+ vulnerabilities; 400+ live secrets; 175 apps exposing PII).
- Tenzai, Bad Vibes: comparing the secure coding capabilities of popular coding agents, tested December 2025, published June 2026 (15 apps, 69 vulnerabilities, 0 of 15 with CSRF protection, SSRF in every link-preview build; vendor research).
- Information Commissioner's Office, Personal data breaches (controller duties; 72-hour reporting window in the UK and EU).
More from Best Answer Hub: the AI agent security guide, the AI text watermarking playbook, the AI cost calculator, and the Knowledge Center assessments.