Prometh

Prometh Company has developed an sophisticated AI system that integrates multiple advanced technologies to process and analyze information. The system, currently at 25% production readiness, combines three core components – a Foundational Model, Storage Model, and Training Model – with specialized tools for memory management and data processing. While demonstrating promising capabilities in document analysis and user interaction, the technology faces significant challenges in areas like information retention across sessions and environmental flexibility. Through detailed analysis of the system's architecture, functionality, and ongoing development, this article explores how Prometh's AI platform aims to transform document processing and intelligent task execution.

Prometh Company's AI System Architecture

The system architecture consists of three key components:

1. Foundational Model (SM): This component forms the base of the AI system, responsible for extracting information from documents. Currently, it operates at 15% effectiveness.

2. Storage Model (STM): Acting as working memory, this layer processes and analyzes vector database data, evaluating significance and comparing results against user benchmarks. It employs attention modulators to support historical context, summaries, and additional document analysis.

3. Training Model (LTM): While present in the architecture, basic long-term memory capabilities are still under development. This component will enable the system to retain information across sessions and users.

The technology integrates with a suite of tools and services provided by Topoteretes UG, including Langchain (orchestration framework), Weaviate (vector database), Pinecone, ChromaDB, Haystack, Huggingface's New Agent System, and Milvus (vector database).

The system employs various memory types:

• Sensory Memory: Stores input buffer information from the command line interface

• STM (Working Memory): Combines vector store and working memory functions for processing and session/user context

• LTM (Long-Term Memory): Acts as the primary vector store for raw document storage

The vector database capabilities enable efficient storage, retrieval, and processing of high-dimensional data, making it suitable for applications like document search and user input analysis. The system also implements frequency and recency attention modulators to manage memory access patterns and improve data processing efficiency.

System Components and Functionality

The system integrates Langchain for orchestration and Weaviate for vector database management, enabling improved user conversations and prompt engineering capabilities. Production readiness stands at 25% as the company continues to address foundational technological challenges.

A primary limitation is the system's current lack of decoupling, portability, modularity, and extendability. The architecture, particularly in the memory management component, requires significant refinement to support more complex operations and multiple file types.

To enhance functionality, the company must implement several critical developments:

1. Complete the Long-Term Memory (LTM) component for information retention across sessions and users.

2. Develop an abstraction layer for managing Sensory Memory inputs and processing various file types.

These improvements are essential for scaling the system to support millions of concurrent users and diverse application requirements, as described in the company's ambitious engineering roadmap.

Development and Infrastructure

The company's development operations are managed by Topoteretes UG, a Berlin-based entity. The technical infrastructure relies on an ecosystem of specialized tools and services, including Langchain as the orchestration framework, Weaviate for vector database management, Pinecone and ChromaDB for additional vector database support, Haystack for further orchestration, Huggingface's New Agent System for agent management, and Milvus for vector database capabilities.

This integrated stack supports various operational requirements:

• Data integration and processing through multiple ingestion sources

• State management and context retention for chatbot applications

• Large language model output improvement through enhanced data integration

• Full lifecycle management from on-prem deployment to cloud hosting

• Customizable schema and ontology generation for diverse data types

The technology demonstrates significant potential for scaling:

• Over 28 standard ingestion sources support diverse data types including unstructured text, raw media files, PDFs, and tables

• Full control over data deployment across on-prem and cloud options

• Scalability demonstrated through successful implementation with Dynamo, a gaming company, which reported a 16% increase in answer relevancy and improved customer engagement

Current limitations include:

• Decoupling challenges that affect component independence and system flexibility

• Portability issues that restrict deployment across different environments

• Modularity constraints that limit system expandability

• Basic functionality for information retention across sessions and users

AI Processing and Memory Management

The memory layer manages information processing through two primary stores: Episodic and Semantic memory. This architecture enables the system to maintain contextual awareness while processing tasks.

At the core of this mechanism is the Memory Manager, which handles Create, Read, Update, and Delete (CRUD) operations across various business domains. It ensures that the system can learn from contextually relevant information and adapt its understanding over time, a crucial feature for tasks like consecutive document processing and information retrieval.

The attention modulators play a vital role in managing data access and processing efficiency. There are two primary modulators:

1. Frequency Modulator: This mechanism gives higher priority to information encountered more frequently. By treating frequently accessed data as more important, the system can optimize its processing to focus on the most relevant information first.

2. Recency Modulator: Recent information receives more attention than older data. This helps the system maintain a working memory that prioritizes the most current and relevant information, reducing the cognitive load for more complex operations.

Additional modulators available in the repository further refine data processing capabilities, allowing the system to adapt its attention patterns to specific task requirements.

This memory management framework supports the system's goal of processing complex tasks such as document retrieval, translation, and data structuring. For instance, in handling a query about a character's kidnapping from a book, the system would first retrieve relevant PDF information from the database, then translate the information into another language as requested.

The current implementation demonstrates promising capabilities, particularly in state management and context retention for chatbot applications. However, the system faces significant challenges in decoupling its components, making it difficult to scale and integrate with diverse applications. Future developments will focus on implementing the Long-Term Memory component and developing abstraction layers for handling varied file types, which will be crucial for extending the system's capabilities to support millions of concurrent users.

Application and Integration

The system deploys AI agents with a defined set of capabilities, including web browsing, application usage, file operations, and credit card payments. These agents execute tasks through a structured workflow managed by the Task Manager and Context Manager components.

At the core of task execution is the memory management framework, which organizes information processing through Episodic and Semantic memory stores. This architecture enables the system to maintain contextual awareness while handling complex operations. The memory manager implements CRUD operations across multiple business domains, supporting in-context learning and adaptive understanding.

The Context Manager processes and analyzes vector database data, evaluating significance and comparing results against user-defined benchmarks. Attention modulators, including frequency and recency mechanisms, support historical context, summaries, and additional document analysis. These modulators help the system maintain working memory that prioritizes current and relevant information, reducing cognitive load for complex operations.

The system demonstrates the ability to handle multiple file types and data structures through its memory layer. For example, processing a query about Buck's kidnapping from A Call of the Wild involves sequential steps: retrieving PDF information from the database and translating the information into German. This capability is crucial for scaling the system to support millions of concurrent users across diverse applications.

In its current implementation, the system demonstrates significant progress in state management and context retention for chatbot applications. However, several challenges remain, particularly in decoupling components for improved flexibility, portability, and modularity. Future developments will focus on implementing the Long-Term Memory component and developing abstraction layers for handling various file types, which will be essential for extending the system's capabilities.