{"id":61296,"date":"2026-10-13T12:25:02","date_gmt":"2026-10-13T12:25:02","guid":{"rendered":"https:\/\/parashift.ai\/?p=61296"},"modified":"2026-10-13T13:43:04","modified_gmt":"2026-10-13T13:43:04","slug":"language-models-specialised-models-validation-automation-layer","status":"publish","type":"post","link":"https:\/\/parashift.ai\/en\/language-models-specialised-models-validation-automation-layer\/","title":{"rendered":"Large language models, specialised models and the validation and automation layer in document processing"},"content":{"rendered":"<p>This article describes three components of automated document processing: the large language model, the highly specialised model and the validation and automation layer. The large language model and the specialised model read content from documents. The validation and automation layer checks the values read, routes them and logs the processing. The final section shows how Parashift covers the three components with its own products, including the measurements from September 2026.<\/p>\n<h2>Definitions<\/h2>\n<p>A large language model is a general purpose model that processes text and images and is accessed through a provider&#8217;s programming interface. It is not specialised in documents but is frequently used to extract fields from documents because it can be deployed without preparation.<\/p>\n<p>A highly specialised model is a model trained exclusively on business documents. It extracts fields, classifies documents, triages them and checks plausibility. Such models are considerably smaller than general purpose models and are typically operated on own hardware or in a private cloud.<\/p>\n<p>The validation and automation layer is not a model. It manages specifications per document type, evaluates a model&#8217;s output, checks it against rules, routes it and logs the processing. It is model independent and works with both model types.<\/p>\n<h2>Comparison of the three components<\/h2>\n<figure class=\"wp-block-table\">\n<table>\n<thead>\n<tr>\n<th><\/th>\n<th>Large language model<\/th>\n<th>Highly specialised model<\/th>\n<th>Validation and automation layer<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Category<\/td>\n<td>general purpose model<\/td>\n<td>model limited to business documents<\/td>\n<td>orchestration layer, model independent<\/td>\n<\/tr>\n<tr>\n<td>Task breadth<\/td>\n<td>very broad<\/td>\n<td>narrow<\/td>\n<td>not applicable<\/td>\n<\/tr>\n<tr>\n<td>Accuracy on document tasks<\/td>\n<td>high, depending on document type<\/td>\n<td>higher than general purpose models in measurements<\/td>\n<td>not applicable<\/td>\n<\/tr>\n<tr>\n<td>Throughput<\/td>\n<td>depends on provider and load<\/td>\n<td>predictable, depends on hardware<\/td>\n<td>not applicable<\/td>\n<\/tr>\n<tr>\n<td>Context budget<\/td>\n<td>large<\/td>\n<td>small, sized for the task<\/td>\n<td>not applicable<\/td>\n<\/tr>\n<tr>\n<td>Place of operation<\/td>\n<td>provider infrastructure<\/td>\n<td>own data centre or private cloud<\/td>\n<td>cloud or own data centre, depending on vendor<\/td>\n<\/tr>\n<tr>\n<td>Cost driver<\/td>\n<td>tokens and page count<\/td>\n<td>hardware<\/td>\n<td>documents processed<\/td>\n<\/tr>\n<tr>\n<td>Version control<\/td>\n<td>provider<\/td>\n<td>operator<\/td>\n<td>operator<\/td>\n<\/tr>\n<tr>\n<td>Confidence per field<\/td>\n<td>usually not exposed<\/td>\n<td>usually available<\/td>\n<td>evaluated against thresholds<\/td>\n<\/tr>\n<tr>\n<td>Data protection<\/td>\n<td>processing at the provider, third country transfer depending on location<\/td>\n<td>no transfer to third parties<\/td>\n<td>accountability evidence through audit trail<\/td>\n<\/tr>\n<tr>\n<td>Evidence under the EU AI Act<\/td>\n<td>not included<\/td>\n<td>not included<\/td>\n<td>logging, human oversight, documentation<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/figure>\n<p>Measured values for a specific specialised model and a specific validation and automation layer are given in the section on implementation at Parashift.<\/p>\n<h2>Limits of the models<\/h2>\n<p>The large language model and the specialised model return a value for every field. Neither model checks whether that value is consistent within the business case. A correctly read amount can deviate from the sum of line items, a correctly read invoice can already have been booked, and a high confidence score describes the model&#8217;s certainty in reading, not correctness in context.<\/p>\n<p>These checks, the routing of uncertain cases and the logging of processing are not part of the models. They are required in every production pipeline, regardless of which model is used.<\/p>\n<h2>Data protection and the EU AI Act<\/h2>\n<p>Business documents usually contain personal data. Under the GDPR and the Swiss FADP, purpose limitation, data processing agreements and the accountability principle apply, which requires processing to be demonstrable. With a large language model accessed through the interface of a provider outside the EU or Switzerland, third country transfer is added, which has to be secured contractually and technically. A specialised model in the own data centre processes documents without transfer to third parties.<\/p>\n<p>The EU AI Act classifies AI systems as high risk under Annex III when they feed into decisions on creditworthiness, life and health insurance or access to public services, among others. Document pipelines in banking, insurance and public administration can fall under this. For high risk systems the regulation requires technical documentation (Art. 11), automatic logging (Art. 12), human oversight (Art. 14) and accuracy and robustness (Art. 15).<\/p>\n<p>Logging, human oversight and documentation are not properties of a model. They are implemented in the validation and automation layer: audit trail per field, thresholds with routing into manual review, versioned specifications. The accuracy requirement concerns the model and is evidenced through measurements on defined datasets.<\/p>\n<h2>Functions of the validation and automation layer<\/h2>\n<p>The layer performs the following functions:<\/p>\n<ul>\n<li>Management of the specification per document type, with versioning<\/li>\n<li>Evaluation of confidence per field against thresholds set per field and per tenant<\/li>\n<li>Validation rules for totals, mandatory fields, duplicates, vendors and matching against purchase order, goods receipt and master data<\/li>\n<li>Routing into automatic further processing or into a validation interface in which only the flagged fields are handled<\/li>\n<li>Approval workflows with agent in the loop or human in the loop<\/li>\n<li>Feedback of corrections into the model<\/li>\n<li>Audit trail with value, confidence, location, specification version, rule applied, editor and time of release<\/li>\n<\/ul>\n<p>Because the layer is model independent, the model can be replaced without changing rules, thresholds or audit trail. Two models are then compared on the same metrics.<\/p>\n<h2>Use of large language models<\/h2>\n<p>Large language models are suited to tasks outside document processing, to document types without a specification and to proofs of concept. They can be used without infrastructure, and their performance improves with each model generation without any action by the user.<\/p>\n<p>In production three properties take effect: costs grow with page count and context length, the model version changes at the provider&#8217;s discretion, and documents are processed on the provider&#8217;s infrastructure. Data residency and evidence obligations have to be clarified separately in regulated environments.<\/p>\n<p>Within a validation and automation layer, large language models can be integrated as a second opinion when a threshold is breached or as a fallback for exceptions. They then work against the same thresholds and write to the same audit trail as a specialised model.<\/p>\n<h2>Implementation at Parashift<\/h2>\n<p><a href=\"https:\/\/parashift.ai\/en\/dokumentli\/\">Dokumentli<\/a> is Parashift&#8217;s specialised model. The <a href=\"https:\/\/parashift.ai\/en\/platform\/\">Parashift platform<\/a> is Parashift&#8217;s validation and automation layer. Large language models are integrated into the platform through \u00abbring your own model\u00bb, provided they conform to the OpenAI API specification.<\/p>\n<p><strong>Dokumentli<\/strong> is a vision language model for business documents with a context budget of 8,192 tokens. It runs in the own data centre on a GPU with 24 GB VRAM or in a private cloud. In the Parashift measurement of September 2026 across 3,365 documents in five benchmarks, metric cANLS at threshold 0.8, Dokumentli 5.3 reaches a mean of 89.1 percent against 85.3 percent for the best reference model and leads in each of the five datasets. Throughput is 1.14 documents per second against 0.60 for the most accurate reference model. Domain fine tuning is available as self service.<\/p>\n<figure class=\"wp-block-table\">\n<table>\n<thead>\n<tr>\n<th><\/th>\n<th>Dokumentli 5.3<\/th>\n<th>best reference model<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Accuracy cANLS@0.8, mean over five benchmarks<\/td>\n<td>89.1 %<\/td>\n<td>85.3 %<\/td>\n<\/tr>\n<tr>\n<td>Throughput<\/td>\n<td>1.14 doc\/s<\/td>\n<td>0.60 doc\/s<\/td>\n<\/tr>\n<tr>\n<td>Context budget<\/td>\n<td>8,192 tokens<\/td>\n<td>up to 32,768 tokens<\/td>\n<\/tr>\n<tr>\n<td>Place of operation<\/td>\n<td>own data centre or private cloud<\/td>\n<td>provider infrastructure<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/figure>\n<p>Source: <a href=\"https:\/\/parashift.ai\/en\/document-ai-benchmark\/\">Document AI Benchmark<\/a>, Parashift, September 2026.<\/p>\n<p><strong>The Parashift platform<\/strong> implements the functions of the validation and automation layer described above. Confidence scores are evaluated per field, thresholds are set per field and per tenant, validation rules cover format, mandatory fields, totals, duplicates, vendors and matching against connected systems. Flagged cases appear in an embedded validation interface, operated by the customer or by Parashift under an agreed turnaround time. OneTouchLearning\u00ae feeds corrections back into the model, and the audit trail logs every processing step. The platform is API first, multi tenant and offers more than 30 <a href=\"https:\/\/parashift.ai\/en\/erp-automation\/\">connectors<\/a>. It runs as a cloud service, while the Dokumentli node is operated in the own data centre.<\/p>\n<h2>Summary<\/h2>\n<p>The validation and automation layer is required in every production document pipeline. Consistency checks, routing of uncertain cases and evidence are not part of the models, and the GDPR, the FADP and the EU AI Act require exactly this evidence. The layer remains in place for years, while the model underneath is replaced several times.<\/p>\n<p>For document tasks a highly specialised model exceeds large language models in accuracy and throughput, with operation in the own data centre and costs independent of volume. Large language models remain usable for other tasks and as a complementary instance within the same layer. At Parashift these roles are filled by Dokumentli and the Parashift platform.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Three components of document processing compared: large language model, highly specialised model and validation and automation layer. Function, limits, data protection, EU AI Act and the implementation at Parashift.<\/p>\n","protected":false},"author":5,"featured_media":42128,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[145],"tags":[],"class_list":["post-61296","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-parashift-platform-2"],"_links":{"self":[{"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/posts\/61296","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/comments?post=61296"}],"version-history":[{"count":1,"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/posts\/61296\/revisions"}],"predecessor-version":[{"id":61299,"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/posts\/61296\/revisions\/61299"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/media\/42128"}],"wp:attachment":[{"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/media?parent=61296"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/categories?post=61296"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/parashift.ai\/en\/wp-json\/wp\/v2\/tags?post=61296"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}