[AI] Can we create Ghibli Style image Locally?

Not Yet, I would say. At least not for me yet. It might be my skill or open-source AI limitations. I installed all of UI and AI in my Windows 11 machine WLS Ubuntu 24.04. You will need Python 3.10 and Git. If your machine configuration is new, your machine probably have higher version of Python. Then, download Python 3.10 and test to see you you are running Python 3.10

sudo apt update
sudo apt install python3.10 python3.10-venv

python3.10 -m venv myenv
source myenv/bin/activate
python3 --version

You must see version 3.10 when you display Python 3 version. Also, create virtual environment for Python3.10. I wasted some time due to this.

Web Interface

Automatic1111(A1111) is a popular, free, and open-source web interface for generating images using Stable Diffusion. It can be downloaded from GitHub, https://github.com/AUTOMATIC1111/stable-diffusion-webui.

git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git
cd stable-diffusion-webui

It has instructions in README.md. The screenshot below shows some interfaces. After that, we need to download models to run with this interface. I found Stable Diffusion v1-5 is included in Automatic111. If not you can download it from below.

Models

Stable Diffusion v1-5 can be downloaded from Hugging Face, https://huggingface.co/stable-diffusion-v1-5/stable-diffusion-v1-5. After downloading it, copy .ckpt file under ./models/Stable-diffusion/

Ghibli LoRA can be downloaded from CivitAI, https://civitai.com/models/6526/studio-ghibli-style-lora. After downloading it, copy .safetensors file under ./models/Lora/

Launch the Web UI

You can run webui.sh script or python3.10 launch.py –xformers –listen to start web server.

webui.sh
python3.10 launch.py --xformers --listen

It will start at

http://127.0.0.1:7860

After setting up UI and Models, I asked to convert the left image and the result was not that close. It is somewhat creative and pretty but not I wanted.

On the contrary, I asked ChatGPT the same task, and the blow show the result. It shows huge difference.