agrag.chunking.chunker

The section chunker: one packer that serves every source format.

Classes:

• ChunkPlacement – Where one chunk hangs in the structure of its document.
• ChunkedDocument – The chunks of one document with where each chunk hangs.
• Chunker – Packs the sections of a Document into chunks.
• ChunkingError – A chunker could not split a document without changing its text.
• TextPiece – A piece of text that Chunker.split made.

Attributes:

• CHUNKER_NAME –
• DEFAULT_SIZE –
• DEFAULT_TOKENIZER –
• SPLITTER_VERSION –
• TABLE_RENDERING_VERSION –