How it Works

Pryon Generative Engine

  • G-LLM orchestration and prompt engineering
  • Model evaluation
  • User feedback
  • Conversational, smoothed response

01

G-LLM orchestration and prompt engineering

Pryon Generative Engine gives developers the flexibility to choose a public, custom, or Pryon-developed LLM.

Pryon Generative Engine is further customizable, enabling developers to define when and how to use the retrieval and generative elements of the Pryon RAG Suite. For example, developers can prompt the LLMs with custom context and information to ensure high quality outputs.

02

Model evaluation

Pryon Generative Engine helps developers choose the LLM that best meets their needs. You can compare the performance of models across various measures, such as speed and accuracy.

03

User feedback

The best way to ensure users receive accurate, helpful, and relevant responses is to collect feedback. Pryon Generative Engine enables developers to let users rate a response with a simple and intuitive “thumbs up/thumbs down” reaction.

Content experts and subject matter experts (SMEs) can review these reactions and take appropriate action — for instance, by feeding new and updated content to the Ingestion Engine.

Pryon Retrieval Engine has out-of-domain detection, so it knows when a query is asking for irrelevant information. Pryon Generative Engine then intelligently tells the user that it can’t answer the question, instead of making up (hallucinating) a response.

FAQs

Can I use any generative LLM I want with Pryon Generative Engine?

Yes. Pryon Generative Engine is compatible with public, custom, and Pryon-developed LLMs. These include GPT-4, LLaMA 2, LLaMA 3, and Mistral.

To use Pryon Generative Engine, do I also need to use Pryon Ingestion Engine and Pryon Retrieval Engine?

Yes. Each component of Pryon RAG Suite is designed to work seamlessly together to provide a best-in-class RAG solution for developers.

What makes Pryon Generative Engine best in class?

Pryon Generative Engine offers a safe and trustworthy pathway to implement enterprise-grade generative AI. Since the Generative Engine prompts the LLMs to only produce output based on an organization’s trusted content, Pryon’s approach to RAG mitigates the security and hallucination risks of public generative tools. At the end of the generative process, users receive smooth, succinct, and trustworthy answers that point to source documents for verification.