Troubleshooting and FAQ for AI Pentests

This article answers the most common questions and issues that come up while running AI pentests on Strobes.

The wizard says I don't have enough AI credits

Top up under Settings → Billing → AI Credits, or ask your org admin. Smaller templates like Hello World use far fewer credits if you just want to try the platform.

The agent stalls on the login page of my target

Add proper credentials in the Scope step and describe the login flow in Custom Instructions (e.g., "Use the SSO button on the homepage; the email is in the credential field"). Then re-launch the assessment.

My target is behind a VPN or corporate network

Use a Connected Browser for web targets, or a Shell for network-internal targets. Both are set up once and reused across Workspaces:

• Connected Browser: AI → Connected Browsers.
• Shell: Settings → Shells (or AI → Shells).

Can I bring my own LLM?

Yes — your org admin can configure which models are available under Workspace Settings → AI Models. The wizard's Model dropdown surfaces what's enabled for your organization.

How do I share a Workspace or report with someone outside my org?

Generate a report from the Reports tab, then share the downloaded PDF. In-platform, Strobes RBAC means a Workspace is visible only to users in the same organization with appropriate roles.

The agent paused and is asking for approval

You're in Supervisor Mode = User. Open the Approvals tab and approve or reject the proposed step. To run end-to-end without approvals, switch Supervisor Mode to Auto in the Workspace Settings panel.

Where can I see what the agent did, step by step?

The Activity panel on the dashboard is the live feed. For a full audit trail, open:

• Tasks — sub-agent breakdown.
• Files — every artifact the agent produced.
• Chat — the entire chat thread between you and the agent.

Can I run multiple pentests in parallel?

Yes. Each Workspace runs independently. Just be aware that AI credits are shared across the organization, so concurrent runs draw from the same pool.

A scheduled run didn't fire

Check AI → Schedules. The schedule may be paused, blocked by insufficient AI credits, or set in a different timezone than you expected. Schedules that fail because of credits will resume on the next cadence once credits are topped up.

Where do I get help?

Reach out to your Strobes Customer Success contact, or use the Help icon in the platform's top bar.