APEX Data Aware AI Agents & Improved Conversation Experiences
With my last post on using GenAI fronting ODA to improve conversational experiences with Fusion - I got talking with Philipp Hartenfeller fellow Oracle ACE and APEX legend on how we could create new sample integrations with Agents without ODA that can enhance how users interact with data exposed via APEX to enhance productivity:
PS.. Be sure to follow Philipp -
We've teamed up and will be creating a couple of open-source projects this year 🤞 that help showcase the power of Agents and how you can effectively use them from within APEX that are context and data aware on the data that has been returned to the page as well as show how they can respond and interact with that data to help users be more productive from simple prompts such page interaction "Mark and check all datasets that are associated with DHL" to data summarisation and incorporating more advanced LLMs to provide insights to the data backing the data displayed.
Our plan will be first to create a simple chat interface component that you can drop into APEX and pass through information on the core data and interactive page elements and then looking into more of multi-modal approaches where chat such as voice interface can interact with other LLM components on the page to dynamically retrieve data and update elements of the UI on the fly instead of leaving a page the page transforms to show the information you want to see and analyse on the fly.
Philipp and I have created a shared a new Organisation over on github ACE Techs where we hope to be publishing our new projects - showing approaches to AI integrations via local browser models both with window.ai and also transformers.js for custom modals as-well as how you can look to use 23ai and third-party LLM services with APEX.
On-top of this we will be seeing if we can get this information up and into the Oracle LiveLabs for you to setup and follow:
- For example - Setup APEX, install template component & plug into Oracle Cohere RAG agent with 23ai.
By the end of the month - we hope to release our first AI integrated APEX chat component providing data/context aware conversations.
Be sure to signup and follow our adventures with Gen AI: