Skip to content

Sense Service

Bases: Service

Processes and analyzes documents to extract semantic content for the Engramic system.

This service listens for document submission events, initializes a scan process that parses the media resource, and notifies the system of newly created inputs. Currently only supports document-based inputs, with other formats planned for future releases.

Attributes:

Name Type Description
sense_initial_summary Plugin

Plugin for generating an initial summary of the document.
sense_scan_page Plugin

Plugin for scanning and interpreting document content.
sense_full_summary Plugin

Plugin for producing full document summaries.

Methods:

Name Description
init_async

Initializes the service asynchronously by calling the parent's init_async method.
start

Subscribes to the SUBMIT_DOCUMENT topic and starts the service.
on_document_submit

dict[Any, Any]) -> None: Extracts document and overwrite flag from message and submits the document for processing.
submit_document

Document, *, overwrite: bool = False) -> Document | None: Checks if document processing should proceed, updates mock data, sends async notification, and triggers document scanning. Returns None if document is already complete and overwrite is False.
on_document_created_sent

Future[Any]) -> None: Callback function that creates a Scan instance and initiates document parsing after the document creation notification is sent.
Source code in src/engramic/application/sense/sense_service.py 
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
class SenseService(Service):
    """
    Processes and analyzes documents to extract semantic content for the Engramic system.

    This service listens for document submission events, initializes a scan process that parses the media
    resource, and notifies the system of newly created inputs. Currently only supports document-based
    inputs, with other formats planned for future releases.

    Attributes:
        sense_initial_summary (Plugin): Plugin for generating an initial summary of the document.
        sense_scan_page (Plugin): Plugin for scanning and interpreting document content.
        sense_full_summary (Plugin): Plugin for producing full document summaries.

    Methods:
        init_async() -> None:
            Initializes the service asynchronously by calling the parent's init_async method.
        start() -> None:
            Subscribes to the SUBMIT_DOCUMENT topic and starts the service.
        on_document_submit(msg: dict[Any, Any]) -> None:
            Extracts document and overwrite flag from message and submits the document for processing.
        submit_document(document: Document, *, overwrite: bool = False) -> Document | None:
            Checks if document processing should proceed, updates mock data, sends async notification,
            and triggers document scanning. Returns None if document is already complete and overwrite is False.
        on_document_created_sent(ret: Future[Any]) -> None:
            Callback function that creates a Scan instance and initiates document parsing after
            the document creation notification is sent.
    """

    def __init__(self, host: Host) -> None:
        super().__init__(host)
        self.sense_initial_summary = host.plugin_manager.get_plugin('llm', 'sense_initial_summary')
        self.sense_scan_page = host.plugin_manager.get_plugin('llm', 'sense_scan')
        self.sense_full_summary = host.plugin_manager.get_plugin('llm', 'sense_full_summary')

    def init_async(self) -> None:
        return super().init_async()

    def start(self) -> None:
        self.subscribe(Service.Topic.SUBMIT_DOCUMENT, self.on_document_submit)
        super().start()

    def on_document_submit(self, msg: dict[Any, Any]) -> None:
        document = Document(**msg['document'])
        overwrite = False
        if 'overwrite' in msg:
            overwrite = msg['overwrite']

        self.submit_document(document, overwrite=overwrite)

    def submit_document(self, document: Document, *, overwrite: bool = False) -> Document | None:
        if document.percent_complete_document and document.percent_complete_document >= 1.0 and overwrite is False:
            return None

        self.host.update_mock_data_input(
            self,
            asdict(document),
        )

        async def send_message() -> Document:
            self.send_message_async(
                Service.Topic.DOCUMENT_CREATED,
                {'id': document.id, 'type': 'document', 'tracking_id': document.tracking_id},
            )
            return document

        future = self.run_task(send_message())
        future.add_done_callback(self.on_document_created_sent)
        return document

    def on_document_created_sent(self, ret: Future[Any]) -> None:
        document = ret.result()
        scan = Scan(self, document.repo_id, document.tracking_id)
        scan.parse_media_resource(document)