Ask GPT for a list of responses.


PREFIX llm: <> 

General forms:

?response llm:response ?prompt.
(?response ?node) llm:response ?prompt.

For example, the pattern

?response llm:response "list 10 US States". 

will bind ?response to ten string literals extracted from the OpenAI API JSON response.

The predicate binds an optional second parameter ?node with a unique IRI. For example

(?celebrity ?node) llm:response "write a list of 10 celebrities". 

binds the response ?node to a unique URI like 

A query may use this IRI to link the response to other resources and add properties:

?node :name ?celebrity.
(?celebrity ?node) llm:response "write a list of 10 celebrities".


You need an API key to utilize this predicate. You need an OpenAI API key to utilize this predicate. See for instructions on obtaining a key (start with the Quickstart Tutorial and follow the links there to get a key). There are three ways to configure your API key, as a query option prefix or in a couple of places in the Allegrograph configuration.

As a query option prefix, write:

PREFIX franzOption_openaiApiKey: <franz:sk-U01ABc2defGHIJKlmnOpQ3RstvVWxyZABcD4eFG5jiJKlmno> 

Syntax for config file:

QueryOption openaiApiKey=<franz:sk-U01ABc2defGHIJKlmnOpQ3RstvVWxyZABcD4eFG5jiJKlmno> 

In the file data/settings/default-query-options:

(("franzOption_openaiApiKey" "<franz:sk-U01ABc2defGHIJKlmnOpQ3RstvVWxyZABcD4eFG5jiJKlmno>")) 

API Options

The proprietary OpenAI API exposes many options and parameters for interaction with their LLM models. Currently the AllegroGraph magic predicates and functions take an opinionated approach and hide most of these options behind the scenes. Specifically, we set

API endpoint: 

Endpoint parameters:

best-of: openai-default-best-of
echo: openai-default-echo
logit-bias: openai-default-logit-bias
logprobs: openai-default-logprobs
max-tokens: openai-default-max-tokens
model: openai-default-ask-chat-model
n: openai-default-n
output-format: openai-default-output-format
presence-penalty: openai-default-presence-penalty
stop: openai-default-stop
suffix: openai-default-suffix
temperature: openai-default-temperature
timeout: openai-default-timeout
top-p: openai-default-top-p
user: openai-default-user
verbose: nil
"description":"function to list an array of specified items","parameters":
{"description":"the list of items",
function-call: {"name":"arrayofstrings"}

Additionally we impose an API timeout of 10 seconds.

Finally, when the OpenAI API times out, returns an error, or the magic predicate implementation fails to parse the response, or any other error occurs, the magic predicate displays an informative message in Webview. Please contact AllegroGraph Support if you require different API options or customization.


The following namespace abbreviations are used:

The SPARQL magic properties reference has additional information on using AllegroGraph magic properties and functions.