Skip to content

Samples showing how to build Java applications powered by Generative AI and LLMs using Spring AI and Spring Boot.

License

Notifications You must be signed in to change notification settings

ThomasVitale/llm-apps-java-spring-ai

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

LLM and AI-Infused Applications with Java & Spring AI

Samples showing how to build Java applications powered by Generative AI and Large Language Models (LLMs) using Spring AI.

๐Ÿ› ๏ธ Pre-Requisites

  • Java 23
  • Podman/Docker

๐Ÿ’ก Use Cases

๐Ÿง  Models

๐Ÿ’ฌ Chat Models

Chat completion with LLMs via different model providers:

๐Ÿ”ค Embedding Models

Vector transformation (embeddings) with LLMs via different model providers:

๐ŸŽจ Image Models

Image generation with LLMs via different model providers:

๐ŸŽต Audio Models

Speech generation with LLMs via different model providers:

Speech transcription with LLMs via different model providers:

๐Ÿ›ก๏ธ Moderation Models

Coming soon

๐Ÿ“ Patterns

๐Ÿ“ Prompts, Messages, and Templates

Prompting using simple text:

Prompting using structured messages and roles:

Prompting using templates:

๐Ÿ“Š Structured Output

Converting LLM output to structured JSON and Java objects:

๐ŸŽฏ Multimodality

Including various media in prompts with LLMs:

โš™๏ธ Function Calling/Tools

Function calling with LLMs via different model providers:

๐Ÿง  Memory

Coming soon

๐Ÿ“ฅ Data Ingestion

๐Ÿ“š Document Readers

Reading and vectorizing documents with LLMs via Ollama:

๐Ÿ”„ Document Transformers

Document transformation with LLMs via Ollama:

  • Metadata
    Enrich documents with keywords and summary metadata for enhanced retrieval.
  • Splitters
    Divide documents into chunks to fit the LLM context window.

๐Ÿ”ข Vector Stores

Coming soon

๐Ÿ”„ Retrieval Augmented Generation (RAG)

Question answering with documents using different RAG flows (with Ollama and PGVector):

โžก๏ธ Sequential RAG

๐ŸŒณ Branching RAG

๐Ÿ“Š Observability

๐Ÿง  LLM Observability

LLM Observability for different model providers:

๐Ÿ”ข Vector Store Observability

Vector Store Observability for different vector stores:

๐Ÿ“‹ Evaluation

Coming soon

๐Ÿค– Agents

Coming soon

๐Ÿ“š References and Additional Resources

๐ŸŽค Conferences

๐ŸŽฅ Videos

๐ŸŽฎ Demos

๐Ÿ“š Workshops

About

Samples showing how to build Java applications powered by Generative AI and LLMs using Spring AI and Spring Boot.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published