10 v3 Ideas List
Trenton H edited this page 2026-03-30 13:46:05 -07:00

Whoosh Profiling Data

  Indexing documents... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1352/1352 0:01:41 0:00:00
/usr/local/lib/python3.12/site-packages/django/utils/connection.py:15: UserWarning: Limit for query logging exceeded, only the last 9000 queries will be returned.
  return getattr(self._connections[self._alias], item)

============================================================
  Profile: block
============================================================
  Wall time:    133.6874s
  Queries:      9000 (0.4350s)
  Memory delta: 11585.5 KiB
  Peak memory:  194369.8 KiB

  Top 5 allocations:
    /usr/local/lib/python3.12/site-packages/django/db/backends/sqlite3/operations.py:193: size=6721 KiB (+6721 KiB), count=8999 (+8999), average=765 B
    /usr/local/lib/python3.12/contextlib.py:105: size=815 KiB (+815 KiB), count=6956 (+6956), average=120 B
    /usr/local/lib/python3.12/site-packages/whoosh/codec/whoosh3.py:863: size=608 KiB (+608 KiB), count=6275 (+6275), average=99 B
    /usr/local/lib/python3.12/site-packages/django/db/backends/utils.py:146: size=562 KiB (+562 KiB), count=8999 (+8999), average=64 B
    <frozen importlib._bootstrap>:488: size=539 KiB (+539 KiB), count=4417 (+4417), average=125 B
============================================================

Tantivy

  Indexing documents... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1352/1352 0:00:32 0:00:00

============================================================
  Profile: block
============================================================
  Wall time:    32.7734s
  Queries:      2712 (0.2550s)
  Memory delta: 64837.9 KiB
  Peak memory:  66040.8 KiB

  Top 5 allocations:
    /usr/local/lib/python3.12/site-packages/django/db/utils.py:98: size=29.8 MiB (+29.8 MiB), count=28388 (+28388), average=1101 B
    /usr/src/paperless/src/documents/search/_backend.py:243: size=13.9 MiB (+13.9 MiB), count=1092 (+1092), average=13.0 KiB
    /usr/local/lib/python3.12/site-packages/django/db/models/sql/query.py:386: size=2282 KiB (+2282 KiB), count=6761 (+6761), average=346 B
    /usr/local/lib/python3.12/site-packages/django/db/backends/sqlite3/operations.py:193: size=1726 KiB (+1726 KiB), count=2708 (+2708), average=653 B
    /usr/local/lib/python3.12/site-packages/django/db/models/base.py:584: size=1469 KiB (+1469 KiB), count=13676 (+13676), average=110 B
============================================================