How to use Arcana

In order to use an Arcana, you either need to set one up or use a publicly available Arcana. Once you have the Arcana ID in the respective field under the advanced options, you will be able to use it. You can see the Chat AI interface and for the currently selected model, the Meta Llama 3.1 8B RAG model, there is the option to set the Arcana ID.

The Chat AI window shows the open advanced options for a model that supports Arcanas, and the field Arcana ID is currently empty.

This field will be set automatically if you use a link to access an Arcana. Similarly, the System Prompt can also be adjusted using a Link. This is most likely the case for an important Arcana such study information or manuals since setting the system prompt will enhance the phrasing and clarity of the response.

Accessing the shared link

In order to interact with an Arcana, you need to use a model that supports the feature and put the ID into the field in the “Settings” tab. Once this is done, you can interact with the Material using normal prompting. There are a few important points to be kept in mind. The Material is index using the Docling process, and therefore it is very important for the prompt to contain keywords and phrases that are or might be present in the document. This is crucial to retrieving the correct information. Otherwise, the model has a higher likelihood of hallucinating.

Understanding the output of a query

Once the model has responded to a prompt, you can immediately see the information attached to your prompt by the index material as now present in the response. Additionally, the actual reference is attached to the output below the response. The reference is directly generated from the Material that is indexed with this Arcana. Originally, the information might have been in a PDF, which got converted into an annotated Markdown file as you can learn in the Docling process. Therefore, the response will contain the reference in the Markdown format, and it will also be rendered as Markdown by the Chat AI interface.

Integration with chat AI

Currently, only a few models can interact with the Arcana middle ware process. These are marked with a book icon.

Example queries and responses

We will now ask the chatbot a question:

• Prompt: What is ImageNet?
• Example Response: ImageNet is a large-scale ontology of images built upon the backbone of the WordNet structure. It aims to populate the majority of the 80,000 synsets of WordNet with an average of 500-1000 clean and full-resolution images, resulting in tens of millions of annotated images organized by the semantic hierarchy of WordNet.

The Chat AI window shows a selected Arcana for the ImageNet paper with an example prompt. In the screenshot you can also see the response contains references from the original document.