How to Run Stable Diffusion on Nebula Cloud: A Comprehensive Guide

How to Run Stable Diffusion on Nebula Cloud: A Comprehensive Guide

Artificial Intelligence Deep Tech Nebula Cloud Computer Vision AI Generative AI HPC

In recent years, generative AI models have transformed the creative landscape, allowing anyone to create stunning visuals from simple text descriptions. Stable Diffusion, one of the most popular models, excels in generating detailed images based on textual prompts. This guide will walk you through running Stable Diffusion on Nebula Cloud, Asia’s first fully managed HPC platform with hardware and software intelligence to automate and optimize engineering workloads.

Overview of Diffusion Models:

Text-to-Image Diffusion Models

- Stable Diffusion: Developed by Stability AI, this open-source model generates high-quality images from text descriptions and has a robust community for support and innovation.

- DALL-E 2 (OpenAI): While not fully open-source, it offers API access and has inspired many open-source projects.

- Imagen (Google): Similar to DALL-E, it's not open-source but influential in the development of related models.

- Midjourney: An AI service that generates high-quality images from text prompts, known for its artistic and unique outputs. It's not open-source but offers access through a subscription-based service.

Text-to-3D Diffusion Models:

- DreamFusion: Generates 3D models from text descriptions, leveraging text-to-image models like Stable Diffusion.

- Point-E: Creates 3D point clouds from textual prompts, representing a significant step in text-to-3D technology.

These models form the backbone of many creative and commercial applications, providing vast potential for research and development.

Stable Diffusion has quickly become a base for several commercial applications due to its flexibility and high-quality generative capabilities. Here are some popular commercial models and platforms that build on top of Stable Diffusion AI:

- DreamStudio by Stability AI - This is a commercial platform that offers access to Stable Diffusion for generating images. Users can create high-resolution images from text prompts, customize the AI outputs, and integrate the technology into their projects through an API.

- Artbreeder - Artbreeder blends images to create new ones using genetic algorithms, and it has incorporated Stable Diffusion to enhance its capabilities. It allows users to adjust and combine images extensively, exploring a vast landscape of potential designs and artworks.

- RunwayML - A platform that integrates machine learning tools into creative projects, RunwayML uses Stable Diffusion to offer powerful image generation capabilities. It's designed to be accessible to artists, designers, and creators without requiring deep technical knowledge.

- NightCafe Studio - NightCafe Studio is another art generation tool that utilizes Stable Diffusion among other models. It is popular for its ease of use and the quality of generated artworks, providing both novice users and professional artists a platform to create unique pieces.

- Lexica - Lexica is a specialized search engine for AI-generated art, heavily utilizing Stable Diffusion. It allows users to search for images based on specific prompts and themes, showcasing the versatility of Stable Diffusion in generating diverse and compelling images.

These platforms have harnessed the capabilities of Stable Diffusion to offer creative and commercial services that cater to a wide range of needs, from professional art creation to casual exploration of generative art.

Stable Diffusion on Nebula Cloud:

Nebula Cloud offers a ready-to-use platform for running Stable Diffusion with customizable GPU configurations and storage options. This setup eliminates the need for complex installations and configurations, allowing users to focus on creative and research work.

Key Features

- Virtual Workstations: Preconfigured Windows 10 Professional and Windows Server workstations with Stable Diffusion AI, NVIDIA Instant NeRF, Multimedia Software tools and Tesla T4 GPUs.

- Quick Setup: Start using Stable Diffusion AI within minutes.

- Data Migration Tools: Easy transfer of data between on-premises systems and the cloud.

- Scalability: Adjust hardware and storage based on project needs.

- In-built Storage: Up to 5TB of SSD for efficient data processing and HDD for archival purposes.

- NICE DCV Protocol: Secure remote desktop access with varying network conditions.

- Preconfigured Software: Includes WinSCP, Adobe Reader, and other essential tools.

- Cost Efficiency: Pay only for the cloud resources used, with free access to Stable Diffusion AI.

Supported Regions:

Currently available in India, Europe, and the USA, supported by AWS Cloud.

Getting Started

Prerequisites: Stable Diffusion requires GPU-enabled virtual machines. Recommended instance type: g4dn.xlarge (4 Core, 16GB RAM, 1 GPU with 16GB Memory) or higher.

Deployment Steps:

- Deploy the Virtual Machine: Follow the provided configurations to create a GPU-enabled virtual machine.

- Connect via RDP or NICE DCV: Use the login credentials to connect to the virtual machine using Remote Desktop Connection.

- Start Stable Diffusion: Double-click the SD - START icon on the desktop. This command shell will load the model and start the webserver.

- Access the GUI: After the model loads, the SD - GUI icon will open the user interface in Firefox.

Using the GUI: