TestFox 🦊

AI-Powered Comprehensive Testing for Every Programming Language

The Final Quality Gate in Your Software Development Lifecycle

🌟 What is TestFox?

TestFox is a comprehensive VS Code extension that automatically generates and executes tests across 20+ test categories for applications written in any programming language. It combines rule-based test generation with AI-powered intelligence to ensure your code is production-ready.

✨ Key Highlights

🌍 Multi-Language Support: JavaScript, TypeScript, Python, Java, C, C++, Rust, Go, .NET, PHP, Ruby
🤖 AI-Powered: Use FREE or PAID AI models from 15+ providers
🧪 20+ Test Categories: Smoke, Functional, Security, Performance, Accessibility, Backend, Payment, and more
💳 Payment Testing: Stripe, PayPal, Braintree integration tests
⚙️ Backend Testing: State Integrity, Concurrency, Reliability, Idempotency, Webhooks
📊 Interactive Reports: Beautiful web-based dashboard with real-time results
🔒 Security Testing: OWASP Top 10 vulnerability detection
♿ Accessibility: WCAG 2.1 compliance checking
⚡ Performance Optimized: Fast extension activation and instant UI loading

🚀 Supported Languages & Frameworks

TestFox automatically detects your project type and generates appropriate tests:

Language	Frameworks	Build Tools
JavaScript/TypeScript	React, Vue, Angular, Next.js, Express, NestJS, Fastify, Svelte	npm, yarn, pnpm
Python	Django, Flask, FastAPI	pip, poetry
Java	Spring, Spring Boot	Maven, Gradle
C	Any	Make, CMake
C++	Any	Make, CMake, Meson
Rust	Actix, Rocket, Axum	Cargo
Go	Gin, Echo, Fiber	go mod
.NET	ASP.NET Core, Blazor	dotnet
PHP	Laravel, Symfony	Composer
Ruby	Rails, Sinatra	Bundler
Kotlin	Spring, Ktor	Gradle

AI Providers & Models - Comprehensive Support

TestFox integrates with 8 AI providers, giving you access to 300+ AI models from major providers. Choose FREE models or paid options based on your needs.

Quick Setup

Provider	Setup Time	Authentication	Default URL
OpenRouter	2 minutes	API Key	https://openrouter.ai/api/v1
Google Gemini	1 minute	API Key	https://generativelanguage.googleapis.com
DeepSeek	1 minute	API Key	https://api.deepseek.com
Ollama	5 minutes	Local	http://localhost:11434
LM Studio	5 minutes	Local	http://localhost:1234
Nvidia NIM	5 minutes	API Key	http://localhost:8000
Amazon Nova	2 minutes	API Key / NOVA_API_KEY	https://api.nova.amazon.com/v1
BYO API	1 minute	API Key	Custom

Free AI Models (No Credit Card Required!)

OpenRouter Models (239+ Available)

Model	Provider	Best For
Gemini 2.0 Flash	Google	Recommended - Fast & powerful
DeepSeek R1	DeepSeek	Advanced reasoning
Llama 3.3 70B	Meta	Large context, open source
Qwen 2.5 72B	Alibaba	Excellent for code
Gemma 2 9B	Google	Lightweight & efficient
Mistral 7B	Mistral AI	Fast responses
Phi-3 Mini	Microsoft	Compact but capable

Direct Provider Models

Model	Provider	Best For
Gemini 2.0 Flash	Google	Recommended - Fast & powerful
Nova 2 Lite	Amazon	Fast and efficient from AWS

Local Models (Self-Hosted)

Model	Provider	Best For
Any Local Model	Ollama	Privacy & offline use
Any Local Model	LM Studio	Custom model hosting
Nvidia Models	Nvidia NIM	GPU-optimized inference

Premium AI Models

Model	Provider	Best For
GPT-4o	OpenAI	Best overall quality
Claude 3.5 Sonnet	Anthropic	Complex analysis
Grok Beta	xAI	Fast & versatile
Gemini Pro	Google	Production workloads
Command R+	Cohere	Enterprise features
DeepSeek Pro	DeepSeek	Advanced capabilities

Authentication Methods

API Key Authentication

OpenRouter: Get free key at OpenRouter.ai/keys
Google Gemini: Get key at Google AI Studio
DeepSeek: Get key at DeepSeek Platform
Amazon Nova: Get key at AWS Console OR use NOVA_API_KEY environment variable
Nvidia NIM: Get key from your Nvidia NIM deployment
BYO API: Use your custom OpenAI-compatible endpoint

Local Authentication

Ollama: No authentication required (local)
LM Studio: No authentication required (local)

Environment Variable Support

Variable	Provider	Usage
`NOVA_API_KEY`	Amazon Nova	Automatically used if API key not configured
`OPENAI_API_KEY`	BYO API	For custom OpenAI-compatible endpoints
`OLLAMA_HOST`	Ollama	Custom Ollama server URL

Getting Started with AI

Choose Your Provider: Select from 8 supported providers in TestFox settings
Free Models Available: OpenRouter, Google Gemini, DeepSeek offer free tiers
Local Options: Ollama, LM Studio for offline privacy
Enterprise Options: Amazon Nova, Nvidia NIM for corporate environments
Configure in TestFox: Click "AI Config" in Test Control Center
Select Model: Choose from 300+ available models
Start Generating: Begin AI-powered test creation immediately!

Provider Recommendations

Use Case	Recommended Provider	Reason
Beginners	OpenRouter	239+ models, free tier available
Enterprise	Amazon Nova	AWS integration, compliance, reliability
Privacy-Focused	Ollama	Local processing, no data sharing
High Performance	Nvidia NIM	GPU optimization, speed
Custom Integration	BYO API	Bring your own endpoint
Google Users	Google Gemini	Native Google integration
Budget Conscious	DeepSeek	Excellent free tier, powerful models

Test Categories (20+ Types)

TestFox covers the complete testing spectrum aligned with ISTQB standards:

🚦 Quick Validation

Category	Description	Status
Smoke Tests	Critical path verification	✅ Automated
Sanity Tests	Quick focused checks	✅ Automated
Regression Tests	Existing features still work	✅ Automated

⚙️ Functional Testing

Category	Description	Status
Functional Tests	Feature behavior validation	✅ Automated
API Tests	REST/GraphQL endpoints	✅ Automated
UI/E2E Tests	User interface journeys	✅ Automated
Integration Tests	Component interactions	✅ Automated
Database Tests	Data integrity & CRUD	✅ Automated

🛡️ Non-Functional Testing

Category	Description	Status
Security Tests	OWASP Top 10, XSS, SQLi	✅ Automated
Performance Tests	Response times, metrics	✅ Automated
Load Tests	Concurrent users	✅ Automated
Accessibility Tests	WCAG 2.1 compliance	✅ Automated

🔧 Backend Testing (10 Categories)

Category	Description	Status
Idempotency Tests	Duplicate request handling	✅ Automated
Webhook Tests	Async event ordering	✅ Automated
Concurrency Tests	Race condition detection	✅ Automated
State Integrity Tests	Data consistency validation	✅ Automated
Reliability Tests	Resilience & duplicate handling	✅ Automated
Failure Recovery Tests	Partial failure & self-healing	✅ Automated
API Contract Tests	Schema validation	✅ Automated
Stability Tests	Retry storm protection	✅ Automated
Compliance Tests	GDPR deletion propagation	✅ Automated
Observability Tests	PII leak detection	✅ Automated

💳 Payment Testing (4 Categories)

Category	Description	Status
Payment Flow Tests	Checkout & subscription flows	✅ Automated
Card Validation Tests	Luhn algorithm, expiry, CVC	✅ Automated
Security Tests	3D Secure, fraud detection	✅ Automated
Webhook Tests	Payment provider webhooks	✅ Automated

🎯 Edge Cases & Boundaries

Category	Description	Status
Negative Tests	Invalid inputs, errors	✅ Automated
Boundary Tests	Min/max values	✅ Automated
Edge Case Tests	Unusual scenarios	✅ Automated

👤 User Account Testing

Category	Description	Status
Account Creation	Registration flows	✅ Automated
Account Security	Session management	✅ Automated
Account Lifecycle	Full CRUD operations	✅ Automated

🛡️ Security Testing (OWASP Top 10)

TestFox performs comprehensive security analysis:

✅ SQL Injection - Detects database vulnerabilities
✅ Cross-Site Scripting (XSS) - Input/output sanitization
✅ CSRF Protection - Token verification
✅ Authentication Bypass - Login security
✅ Security Headers - CSP, HSTS, X-Frame-Options
✅ Sensitive Data Exposure - API key leaks, passwords
✅ Session Management - Cookie security
✅ Broken Access Control - Authorization checks

� Backend Testing Suite

Comprehensive backend validation for distributed systems and APIs:

Test Coverage

Test Type	Description	Example
Idempotency	Duplicate request handling	Same payment processed only once
Webhook Ordering	Async event sequencing	Order: `payment_intent.created` → `payment_intent.succeeded`
Concurrency	Race condition detection	Two users reserving last inventory item
State Integrity	Data consistency validation	Order cancellation releases stock
Reliability	Resilience testing	Duplicate webhook ignored with idempotency key
Failure Recovery	Partial failure handling	Retry with exponential backoff
API Contract	Schema validation	OpenAPI spec compliance
Stability	Retry storm protection	Circuit breaker pattern validation
Compliance	Regulatory requirements	GDPR deletion propagation
Observability	PII leak detection	No credit card numbers in logs

💳 Payment Testing Suite

Complete payment integration testing for e-commerce applications:

Supported Providers

Stripe - 3D Secure, webhooks, idempotency
PayPal - Checkout, subscriptions, disputes
Braintree - Hosted fields, vault, fraud protection

Test Coverage

Test Type	Description
Card Validation	Luhn algorithm, expiry dates, CVC verification
Fraud Detection	Velocity checks, AVS, geolocation
3D Secure	SCA compliance, challenge flows
Webhooks	Signature verification, event ordering
Idempotency	Duplicate prevention, key validation
Subscriptions	Trial periods, billing cycles, proration
Disputes	Chargeback handling, evidence submission

� Interactive Reports Dashboard

Generate beautiful, interactive web reports with:

📈 Real-time Progress - Live test execution updates
📊 Category Breakdown - Pie charts and statistics
🔴 Security Findings - Severity levels and recommendations
⚡ Performance Metrics - Response times visualization
🤖 AI Insights - Intelligent recommendations
📄 Export Options - HTML, PDF-ready printing

🔧 Quick Start

Installation

Open VS Code
Go to Extensions (Ctrl+Shift+X)
Search for "TestFox"
Click Install

First Run

1. Click the 🦊 TestFox icon in the Activity Bar
2. Click "AI Config" to set up your API key (optional)
3. Click "Analyze Project" to detect your project
4. Click "Generate Tests" to create test cases
5. Click "Run Tests" to execute
6. Click "View Report" for results

💻 Commands

Command	Description
`TestFox: Analyze Project`	Detect project type and structure
`TestFox: Generate Tests`	AI-powered test generation
`TestFox: Generate Test Category`	Generate specific category (Backend, Payment, etc.)
`TestFox: Run All Tests`	Execute all test categories
`TestFox: Run Test Category`	Run specific category
`TestFox: Generate Web Report`	Open interactive dashboard
`TestFox: Configure AI`	Set up AI provider and model
`TestFox: MCP Control`	Open MCP Server control panel
`TestFox: Install Browsers`	Install Playwright browsers
`TestFox: Open Test Control Center`	Open test execution dashboard
`TestFox: Pause/Resume/Stop Tests`	Test execution control

⚙️ Configuration

Configure TestFox in VS Code settings (Ctrl+,):

🤖 AI Provider Configuration

{
  "testfox.ai.enabled": true,
  "testfox.ai.provider": "openrouter",
  "testfox.ai.model": "google/gemini-2.0-flash-exp:free",
  "testfox.ai.apiKey": "",
  "testfox.ai.baseUrl": "https://openrouter.ai/api/v1"
}

📋 Available AI Providers

Provider	Value	Base URL	Authentication
OpenRouter	`openrouter`	https://openrouter.ai/api/v1	API Key
Google Gemini	`google-gemini`	https://generativelanguage.googleapis.com	API Key
DeepSeek	`deepseek`	https://api.deepseek.com	API Key
Ollama	`ollama`	http://localhost:11434	Local
LM Studio	`lmstudio`	http://localhost:1234	Local
Nvidia NIM	`nvidia-nim`	http://localhost:8000	API Key
Amazon Nova	`amazon-nova`	https://api.nova.amazon.com/v1	API Key / NOVA_API_KEY
BYO API	`byo-api`	Custom	API Key

🔧 Environment Variables

Variable	Provider	Description
`NOVA_API_KEY`	Amazon Nova	Auto-detects Amazon Nova API key
`OPENAI_API_KEY`	BYO API	For custom OpenAI-compatible endpoints
`OLLAMA_HOST`	Ollama	Custom Ollama server URL

🎯 Model Selection Examples

// OpenRouter (239+ models)
{
  "testfox.ai.provider": "openrouter",
  "testfox.ai.model": "google/gemini-2.0-flash-exp:free"
}

// Amazon Nova
{
  "testfox.ai.provider": "amazon-nova",
  "testfox.ai.baseUrl": "https://api.nova.amazon.com/v1",
  "testfox.ai.model": "nova-2-lite-v1"
}

// Local Ollama
{
  "testfox.ai.provider": "ollama",
  "testfox.ai.baseUrl": "http://localhost:11434",
  "testfox.ai.model": "llama3.1:8b"
}

🚪 Full Configuration Example

{
  "testfox.ai.enabled": true,
  "testfox.ai.provider": "openrouter",
  "testfox.ai.model": "google/gemini-2.0-flash-exp:free",
  "testfox.ai.apiKey": "your-api-key-here",
  "testfox.ai.baseUrl": "https://openrouter.ai/api/v1",
  "testfox.ai.fallbackModel": "meta-llama/llama-3.1-8b-instruct:free",
  "testfox.browserHeadless": true,
  "testfox.defaultTimeout": 30000,
  "testfox.securityTestLevel": "standard",
  "testfox.performanceThreshold": 3000,
  "testfox.automation.enabled": true,
  "testfox.automation.interval": "1h"
}

📚 ISTQB-Aligned Testing Techniques

TestFox implements industry-standard testing methodologies:

✅ Boundary Value Analysis (BVA)
✅ Equivalence Partitioning
✅ Decision Table Testing
✅ State Transition Testing
✅ Use Case Testing
✅ Error Guessing
✅ Exploratory Testing

🏗️ SDLC Integration

TestFox serves as the final quality gate before release:

┌─────────────────────────────────────────────────────────────────┐
│                    Software Development Lifecycle               │
├─────────────────────────────────────────────────────────────────┤
│                                                                 │
│  📋 Requirements → 💻 Development → 🧪 Unit Tests → 👀 Review │
│                                                                 │
│                            ↓                                    │
│  ┌────────────────────────────────────────────────────────────┐ │
│  │                                                            │ │
│  │              🦊 TestFox Quality Gate                      │ │
│  │                                                            │ │
│  │  ✓ Smoke → Functional → Security → Performance → UAT       │ │
│  │  ✓ Backend → Payment → AI-Powered Analysis                │ │
│  │  ✓ 20+ Test Categories    ✓ Multi-Language Support        │ │
│  │  ✓ MCP Servers            ✓ Interactive Reports            │ │
│  └────────────────────────────────────────────────────────────┘  │
│                            ↓                                     │
│                      🚀 Release                                 │
│                                                                 │
└─────────────────────────────────────────────────────────────────┘

🔌 MCP Servers (Model Context Protocol)

TestFox integrates with MCP Servers for AI-powered test automation:

Available MCP Servers

Server	Capabilities	Command
Playwright MCP	Browser automation, E2E tests, visual testing	`mcpPlaywright`
Fetch MCP	API testing, HTTP requests	`mcpFetch`
Chrome DevTools MCP	Performance analysis, network monitoring	`mcpChromeDevTools`
QA Use MCP	Comprehensive QA automation	`mcpQAUse`

MCP Features

🤖 AI-Powered Test Generation - Generate tests using natural language
🎭 Playwright Integration - Automated browser testing
📮 API Testing - REST/GraphQL endpoint validation
🔧 DevTools Analysis - Performance and network insights
🚀 One-Click Execution - Run all MCP tests from control panel

📋 Requirements

VS Code 1.85.0 or higher
Node.js 18+ (for test execution)
Internet (for AI features - optional)

🤝 Contributing

Contributions are welcome! Please visit our GitHub repository.

GitHub: github.com/senthazalravi/TestFox

👨‍💻 Author

Developed with ❤️ in Stockholm, Sweden

Twitter/X: @senthazalravi
Email: ravi.antone@gmail.com

🙏 Support the Project

⭐ Star us on GitHub
📝 Write a review on the VS Code Marketplace
💬 Share with your developer friends
💰 Sponsor our LLM credits and infrastructure

📄 License

MIT License - see LICENSE file for details.

TestFox 🦊 - The Final Quality Gate

Making software testing intelligent, comprehensive, and accessible to everyone.

Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
.github/workflows		.github/workflows
.vscode		.vscode
media		media
qa-use-mcp		qa-use-mcp
scripts		scripts
src		src
tests		tests
web-dashboard		web-dashboard
.eslintrc.json		.eslintrc.json
.gitignore		.gitignore
.vscodeignore		.vscodeignore
LICENSE		LICENSE
README.md		README.md
esbuild.js		esbuild.js
package-lock.json		package-lock.json
package.json		package.json
test-ai-config.sh		test-ai-config.sh
tsconfig.json		tsconfig.json

Folders and files

Latest commit

History

Repository files navigation

TestFox 🦊

🌟 What is TestFox?

✨ Key Highlights

🚀 Supported Languages & Frameworks

AI Providers & Models - Comprehensive Support

Quick Setup

Free AI Models (No Credit Card Required!)

OpenRouter Models (239+ Available)

Direct Provider Models

Local Models (Self-Hosted)

Premium AI Models

Authentication Methods

API Key Authentication

Local Authentication

Environment Variable Support

Getting Started with AI

Provider Recommendations

Test Categories (20+ Types)

🚦 Quick Validation

⚙️ Functional Testing

🛡️ Non-Functional Testing

🔧 Backend Testing (10 Categories)

💳 Payment Testing (4 Categories)

🎯 Edge Cases & Boundaries

👤 User Account Testing

🛡️ Security Testing (OWASP Top 10)

� Backend Testing Suite

Test Coverage

💳 Payment Testing Suite

Supported Providers

Test Coverage

� Interactive Reports Dashboard

🔧 Quick Start

Installation

First Run

💻 Commands

⚙️ Configuration

🤖 AI Provider Configuration

📋 Available AI Providers

🔧 Environment Variables

🎯 Model Selection Examples

🚪 Full Configuration Example

📚 ISTQB-Aligned Testing Techniques

🏗️ SDLC Integration

🔌 MCP Servers (Model Context Protocol)

Available MCP Servers

MCP Features

📋 Requirements

🤝 Contributing

👨‍💻 Author

🙏 Support the Project

📄 License

About

Resources

License

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Contributors

Uh oh!

Languages

Packages