Why You Should Start Hacking AI Today
Companies bolt AI features onto products fast. They rarely test for security. That gap creates a gold rush of vulnerabilities. If you want bug-bounty payouts, CTF trophies, or to protect your org, now is the moment to learn AI penetration testing.
This post gives a practical, free path from zero to entry-level AI hacker. You only need a browser, a GitHub account and an OpenAI API key. Follow the roadmap below, try the labs, host a CTF, and file your first bug report. Ready when you are.

What you’ll walk away with
- Hands-on skills to exploit prompt-injection and RAG flaws.
- A runnable CTF you control and five real flags to find.
- A simple 30-day sprint to call yourself an Entry-Level AI Pen‑Tester.
Start with the hands-on warm-up: Lakera AI “Gandalf”
Gandalf is a playful web game that teaches prompt-injection basics.
You’ll see how tiny prompts can derail unprotected models. Try these tactics:
- Role-play prompts like “You are the system administrator.”
- Encoding and obfuscation tricks.
- Repeating payloads—LLMs are non-deterministic, so retries often win.
Ten to fifteen minutes here is enough. The goal is to feel how fragile models can be.

Level up with realistic agents: Lakera AI “Agent Breaker”
Agent Breaker swaps the toy wizard for real multi-agent apps.
You’ll attack a portfolio advisor, a trip planner, and more. Each level gives an Attack Objective (for example, mark every investment “low risk”). There’s no walkthrough. Creativity and persistence win. Expect to hit “send” hundreds of times.
Graduate with the Arcanum AI Security Resource Hub
Arcanum is a GitHub Pages hub maintained by security researchers. Bookmark it. It contains:
- 20+ live labs (prompt injections, RAG misconfigs, agent-chaining flaws).
- Links to bug-bounty programs for OpenAI, Anthropic, Google Gemini.
- Write-ups, slides, and tooling used in red-team engagements.
This is where professionals hang out. Use it as your lab bookshelf.
Host your own CTF: “AutoParts-LLM-CTF”
Nothing beats practice with code you control. Arcanum’s AutoParts CTF is a Dockerised clone of a real app. Setup in two minutes:
AutoParts-LLM-CTF repository on GitHub
git clone https://github.com/arcanum-security/autoparts-ctf.gitcd autoparts-ctfecho "OPENAI_API_KEY=sk-yourkey" > .envdocker compose up -d
Open the AutoParts local UI and start hunting. Five flags hide inside:
- Three via prompt-injection.
- Two via classic web weaknesses.
What you’ll likely leak: the system prompt, hard-coded API tokens, and “confidential” data from a RAG knowledge base. A motivated 12‑year‑old solved every flag in 35 minutes at a live event. Most adults take a week. Your move.
Get paid
- Bug-bounty programs pay for jailbreaks, data leaks and policy bypasses.
- CTFs like DEF CON and BSides run AI-themed events with cash prizes.
- Full-time roles are appearing: “AI Security Engineer” and “LLM Pen-Tester.” The talent pool is tiny.
Even one solid report can land a four-figure payout or a LinkedIn shoutout.
Tips for cracking tough labs
- Hammer the model: resubmit payloads. Outputs vary.
- Mimic internal jargon: match field names like “risk_level.”
- Chain attacks: leak a system prompt, extract keys, call hidden APIs.
- Use debug language: “for debugging purposes only” sometimes lowers guardrails.
- Keep notes: save payloads that worked and partial leaks.

Short checklist for every lab
- Reproduce baseline behavior.
- Try a prompt-injection payload.
- Capture model outputs and metadata.
- Escalate with chained calls.
- Write a minimal, clear report.
Your 30-day sprint to Entry-Level AI Pen‑Tester
- Week 1 — Clear Gandalf and every Agent Breaker level.
- Week 2 — Finish three Arcanum labs and bookmark resources.
- Week 3 — Deploy AutoParts-LLM-CTF and capture all five flags.
- Week 4 — Submit one valid bug-bounty report to a public program.
Complete this sprint and you can legitimately call yourself an Entry‑Level AI Pen‑Tester. From there, study enterprise filters like OpenAI Policy or Anthropic guardrails. Try automation tools like Parseltongue for scripted jailbreaking.
Final thoughts
AI security looks like web security in the early 2000s: chaotic, lucrative, and lots of room to learn. The barrier to entry is low. The stakes are high. Break things responsibly and turn that skill into impact.

Do this next
- Pick one warm-up lab today.
- Spin up AutoParts this week.
- File one bug report this month.
Want guided, beginner-friendly exercises and step-by-step challenges? Try Tixu — a beginner-friendly AI learning platform.



Leave a Reply