Skip to main content

Transformers

Available Transformers​

extra_metadata​

Add extra metadata to every document.

Options

  • metadata

filter_markdown_docs_no_content​

Filter out markdown-formatted documents that do not have any content (e.g. only whitespace/newline/headings).

keywords​

Let the LLM extract some keywords from the document content and add them to the metadata (field keywords).

Options

  • NumKeywords
  • LLM