Transform your existing products with GenAI

@techcelerate

6 Followers

1 month ago 269

Tech #techcelerate #genai #genaitools #workshop

Transform your existing products with GenAI

@techcelerate1 month ago

Transform your existing products with GenAI

Rhys Jones

rhys@axonzeta.ai

â Background & Trends
â Building and Supporting Products
â Improving Product UX and Workflows
â Demos & Code
â Discussion

Transformers vs other paradigms in Foundation Models

stateof.ai 2024

Chunk of the internet,

~140GB file

6,000 GPUs for 12 days; ~S2M ~1e24 FLOPS

axonZeta

ANTHROPIC

2023

2024

Claude

Opus

Sonnet

Claude

60x drop!

Haiku

Claude=

stateof.ai 2024

Claude

Llama 3.1405B Human Evaluation

GenAI : NN Predicting Next Word

e.g. context of 4 words

predict next word

â Background & Trends
â Building and Supporting Products
â Improving Product UX and Workflows
â Demos & Code
â Discussion

Building and Supporting Products

â Software Engineering
â Support
â Sales
â Marketing

Spotlight: AIin Product & Engineering N=51

axonZeta

Spotlight: AIin IT N=50

axonZeta

Spotlight: AIin Sales N=36

axonZeta

Spotlight: AIin Marketing N=36

axonZeta

â Replit: AI Coding
â NotebookML : Research, Q&A,(Podcasts!)
â NapkinAI : Documentation, Diagrams
â
DifyAI : Custom Support Agents
â SciPhi : RAG Tools
â Synthesia : Product Video Generation
â BrainBox / ChatGPT : of courseâ¦

â Background & Trends
â Building and Supporting Products
â Improving Product UX and Workflows
â Demos & Code
â Discussion

Improving Product UX and Workflows

Backend Workflows

Optimize internal processes and systems.

Frontend UX

Improve how users find and access content.

Enhance the user interface and experience.

Improving Product UX and Workflows

â Semantic Search
â Vector Stores
â RAG : Retrieval Augmented Generation
â Chatbot Assistants for your Product

Discoverability & Search

axonZeta

Discoverability & Search

axonZeta

Discoverability & Search

how would | create a new space for a new account?# gmail

To create a new space for a new Gmail account in Wavebox, follow these steps:

1. Click on the plus button in the webdock, located just below the Spaces section:
2. This will prompt you to create a new space. Name the space accordingly; such as "New Gmail Account.
4. Add the Gmail account to this new space by either adding the Gmail app directly to the space or selecting the new space during the app setup process.

By creating a new space specifically for your new Gmail account, you can easily switch between different accounts without the need to sign in and out repeatedly.

axonZeta

Improving Product UX and Workflows

ChatGPT Interaction Cycle

ChatGPT Interaction

Agentic Approach : Platforms

Agentic Approach : LangChain

Agentic Structured Outputs

Agentic Approach

â Takes any unstructured data
â Applies GenAI task
â Outputs correctly
structured data

Safety and Security

â Function Calling by Agents
â How safe are inputs?
â Prompt Injection
â Restrict Function scopes
â Supervisor Agents
â Use JSON not Functions

â Background & Trends
â Building and Supporting Products
â Improving Product UX and Workflows
â Demos & Code
â Discussion

Transferring Tasks from Email to ToDo App

Al Agent enabled Magic 1 Paste Copy

Backend Workflows

Notifications Customized multiple Al Agents By

Backend Workflows

Multi Agent Systems

â Agents work well with other Agents
â Some Agents DO others DECIDE and ROUTE

Multi Agent System Example

Collaborative Content Creation

Critic

Multi-Agent Customer Booking Service

Multi Agent System Example

â Background & Trends
â Building and Supporting Products
â Improving Product UX and Workflows
â Demos & Code
â Discussion

Agenda

09:00 Registration and networking

09:30 Introduction to Techcelerate by Manoj

09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX (beyond just chatbots!) - by Rhys

10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their products - Rhys and facilitated by Manoj

11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for your Web Apps - by Rhys

11:30 Breaking the barriers in your tech startup journey - by Manoj

12:00 Networking

Agenda

09:00 Registration and networking

09:30 Introduction to Techcelerate by Manoj

09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX (beyond just chatbots!) - by Rhys

10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their products - Rhys and facilitated by Manoj

11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for your Web Apps - by Rhys

11:30 Breaking the barriers in your tech startup journey - by Manoj

12:00 Networking

Run your own AI with local SLMs

Google Chrome | AxonZeta

â Large Language Models
Â· Typically > 70B parameters
Â· GPT4 estimated to be 1,760B params
â Small Language Models
Â· Typically < 20B parameters
Â· Quantized to e.g. 4 Bits per param

Small Model Performance

Growth in Small Model Capabilities

Microsoft Phi SML Models 2023

axonZeta

Phi 3.5 3.8B parameters ~ 7.7GB memory

Quantized to 4 bits / param ~ 2GB memory

Laptop Performance

axonZeta

On-Device Small Models

On Device SML Benefits

â Local processing of Sensitive Data
â Snappy user experience
â Full control of AI Models
â Offline AI use
â Change in economic model
Â· User already has the resource
Â· No extra '$20/month for our AI!'

In-Browser AI

Google AI Studio

Google Vertex AI

â Development platform for On-Device SML AI
â Prompting & Training
â Evaluation & Monitoring
â Leverage multiple SLMs
â Works across all Browsers

â Add local AI Agents to web apps
â Test with different Small Models
â Promotes private, free, local AI
â User still in charge
â Combine with Hybrid on-cloud or on-prem

Run your own AI with local SLMs

Google Chrome | AxonZeta

Agenda

09:00 Registration and networking

09:30 Introduction to Techcelerate by Manoj

09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX (beyond just chatbots!) - by Rhys

10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their products - Rhys and facilitated by Manoj

11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for your Web Apps - by Rhys

11:30 Breaking the barriers in your tech startup journey - by Manoj

12:00 Networking