A Streamlit-based web application that transforms product sketches into refined concept images, 3D models, and animated videos using AI. Perfect for product designers, concept artists, and creative professionals.
- 🖼️ AI-powered concept image generation from sketches
- 🧊 3D model generation from concept images
- 🎬 Video animation generation with customizable parameters
- 📊 Real-time generation statistics and cost tracking
- 💾 Download capabilities for all generated assets
- Python 3.8 or higher
- Streamlit
- API Keys for:
- Google AI (Gemini 2.0 Flash)
- Fal.ai
- (Store these in your .env file)
-
Clone the repository:
git clone https://github.com/yourusername/design-tool-simple.git cd design-tool-simple -
Create and activate the Conda environment:
conda env create -f environment.yml conda activate design-tool-simple
-
Set up your environment variables:
- Copy
.env.exampleto.env - Add your API keys to the
.envfile
- Copy
-
Start the Streamlit app:
streamlit run main.py
-
Navigate through the three main tabs:
- Generate Concept: Upload sketches and generate refined concept images
- Generate 3D: Convert concepts into 3D models
- Generate Video: Create animations from your concepts
-
Concept Generation:
- Upload a product sketch
- Get AI-generated prompt using Gemini 2.0 Flash
- Generate concept image using FAL.ai's fast-sdxl model
- Download the generated image
-
3D Model Creation:
- Use your generated concept
- Create an interactive 3D model using FAL.ai's hyper3d/rodin model
- Download in GLB format with PBR materials
-
Video Animation:
- Customize action, style, camera motion, and ambiance
- Choose aspect ratio and duration (5-8 seconds)
- Generate video using FAL.ai's veo2/image-to-video model
- Download the animated video
-
fast-sdxl
- Purpose: Concept image generation
- Features:
- Image strength: 0.95
- Guidance scale: 7.5
- Scheduler: DPM++ 2M
- 30 inference steps
-
hyper3d/rodin
- Purpose: 3D model generation
- Features:
- PBR material support
- GLB file format
- Texture generation
- Interactive viewer support
-
veo2/image-to-video
- Purpose: Video animation
- Features:
- Customizable duration (5-8s)
- Multiple aspect ratios
- Action and style prompting
- Camera motion control
- Gemini 2.0 Flash
- Purpose: Prompt generation and optimization
- Used for converting user inputs into effective generation prompts
Create a .env file with your API keys:
GOOGLE_API_KEY=your_google_api_key_here
FAL_KEY=your_fal_ai_key_here
product-concept-generator/
├── main.py # Streamlit application
├── .env # API keys (not tracked)
├── .env.example # Example environment file
├── environment.yml # Conda environment specification
├── .gitignore # Git ignore rules
└── README.md # Project documentation
Contributions are welcome! Please feel free to submit a Pull Request.
This project is licensed under the MIT License.