was successfully added to your cart.

    Prompt Engineering for Visual Document Understanding in the No-Code Generative AI Lab

    Avatar photo
    Ph.D. in Computer Science – Head of Product

    Certain sectors, particularly healthcare and finance, face restrictions on sharing training or evaluation documents outside their organizational firewalls. Furthermore, some terms of use from LLM providers prohibit the use of their LLMs for training specialized models.

    The Generative AI Lab features zero-shot prompts and LLMs that can operate completely within an organization’s firewall. This setup eliminates the need for third-party APIs or internet access.

    The application expands automated annotation capabilities for Visual NER projects with added support for computer assisted using Prompts.

    Earlier versions of the Generative AI Lab supported prompt use solely for text-based projects. Now, this capability extends to PDF and image-based projects, allowing for prompt-driven pre-annotation without manual input.

    Setting Up Computer-Assisted Annotation with Prompts

    To configure your project for prompt-based pre-annotation, follow these steps:

    • Create a Visual NER Project.
    • Go to the Reuse-Resource Page and add the desired zero-shot prompts (note that relation prompts and external prompts are currently unsupported).
    • After saving your project configuration, begin pre-annotating tasks using the chosen prompts.

    Setting Up Computer-Assisted Annotation with Rules

    Previously, rules were limited to text-based projects. However, version 5.9 expands this to include Visual NER projects. This update allows for the use of rules in pre-annotating PDF and image-based projects, enhancing the flexibility and efficiency of annotation processes.

    To set up your project for rule-based pre-annotation, follow these straightforward steps:

    • Create a Visual NER Project.
    • Navigate to the Reuse-Resource Page and add the desired rules.
    • Once the project configuration is saved, start pre-annotating tasks using these rules.

    How useful was this post?

    Try The Generative AI Lab - No-Code Platform For Model Tuning & Validation

    See in action
    Avatar photo
    Ph.D. in Computer Science – Head of Product
    Our additional expert:
    Dia Trambitas is an AI Product Manager with deep expertise in Natural Language Processing and applied Generative AI. At John Snow Labs, Dia has led the development of the Generative AI Lab — a no-code platform for data annotation and model training — as well as the Medical Chatbot, a secure and domain-specific conversational AI assistant tailored for clinical environments. With a strong focus on practical deployments of cutting-edge AI, she has worked at the intersection of healthcare and technology, driving product innovation that empowers users to harness large language models safely and effectively. Passionate about transforming unstructured data into actionable insights, Dia brings a strategic and user-centered approach to building AI tools that are both powerful and accessible.

    Reliable and verified information compiled by our editorial and professional team. John Snow Labs' Editorial Policy.

    Generative AI Lab – No-Code Environment for Building Task-Specific AI Models with LLMs

    We are happy to announce the release of Generative AI Lab, marking the transition from the previous NLP Lab to a state-of-the-art...
    preloader