Implementation: designing and implementing a custom web portal powered by generative AIImplementation
N-iX designed the architecture for the internal web portal powered by generative AI. The platform helps employees to be faster and more efficient at performing various tasks, such as creating JIRA tickets with detailed descriptions, describing application features, and more.
We have used Single Sign-On based on MS Azure Active Directory to authenticate users. We have also used a custom .NET-based API Gateway as an entry point on the backend to aggregate user requests and orchestrate business workflows.
In addition, we have implemented an internal multi-tenant data storage. The data storage comprised all the information from the corporate website and other internal documents, such as an internal knowledge base, security manuals, Confluence, etc. This allows employees to receive quick and accurate answers to any company-related questions easily. Each time a user submits a question in the chatbot, the system receives the user's question and the context from the corporate knowledge database. The text files from the knowledge base are indexed and only the relevant ones to the question are selected. Finally, a custom generative AI API developed by N-iX processes the indexed context and sends a short and concise answer in a chatbot.
Furthermore, we incorporated MLOps practices, focusing on machine learning lifecycle management, and integrated support for Large Language Models (LLM) into the client’s operations.
To ensure data security, we implemented two levels of data protection through API requests to handle authentication and authorization and internal identity access management. We also implemented data encryption, a VPN connection, and a network firewall.
Finally, to reduce infrastructure expenses, N-iX has explored the best ways of using GPUs and analyzed multiple large language models that best fit the client’s solution.