Godot LLM's icon

Godot LLM 0.3 Tools 4.2 Community

Submitted by user Adriankhl; MIT; 2024-05-11

This plugin adds GdLlama, GDEmbedding, and GDLlava node which provides functionalities to generate text using large language model (LLM).

Feature:
* Simple text generation
* Enforce the format of text generation output by Json schema
* Instruct and interactive mode
* Sentence Embedding
* Multimodal: generate text from image or game screen

Currently only support Windows, Linux and Android

v0.2.2 -> v0.3 breaking change
* Rename GDLlama "generate_text" method to "generate_text_simple", you may also just call "generate_text(prompt, "", "") to achieve the same output
* Switch from cpu build to vulkan build because of an upstream bug that prevents embedding from working


View files Download Submit an issue Recent Edits