George LLM Kit

Integrate your own Large Language
Models (LLMs) easily with George LLM Kit

George LLM Kit brings the benefits of Large Language Models (LLMs) closer to where we already work every day and solves existing inefficiencies rather than creating new ways of doing things.

With the emergence of chatbots such as OpenAI’s ChatGPT, the underlying large language models (LLMs) are trained on vast amounts of generalised data, making them excellent at getting quick answers to questions you might have from multiple data sources throughout your busy workday.

Operationalised AI/ML to boost productivity

Sovereign-Safe for IRAP environments

Includes customised chatbot capabilities

George LLM Kit at a glance:

Integratable with popular chat tools (Mattermost, Slack, Discord)

  • Implement semantic understanding into your preferred internal chat app
  • Extend your internal chat service beyond the basic Q&A of its internal knowledge base
  • Ideal application for large, internal messaging systems
  • Summarise, daily, weekly or all-time conversations with a simple command
  • Perfect for project managers aiming to get a scope of activity

Summarise channel activity easily

  • Retrieving all messages sent to the channel in question within the last day from DynamoDB.
  • Collecting them into a prompt easily interpretable by an LLM and wrapping it with instructions on what we want it to do.
  • Querying the Bedrock API and
  • Posting the resulting summary to the channel.

Upload and chat with documents securely

  • Take an uploaded document (.pdf, .docx, .txt, …) and ask questions about its content
  • Uses a combination of the RAG and message history retrieval patterns
  • George LLM Kit will interpret all queries about the document
  • By entering a context mode, you can rapidly fire off questions about the document’s content without having to let George know each time where to look for the answers (eg. Search the document for the answer to…).

Future roadmap includes Google Drive integration

  • Expanding the capabilities of George LLM Kit even further