Jaunt Logo

    Transform your existing products with GenAI

    Transform your existing products with GenAI

    T
    @techcelerate
    6 Followers
    5 months ago 465

    Workshop run by Rhys Jones, Founder & CEO of AxonZeta (https://aibrow.ai/) to educate Techcelerate Tech Founder community on some of the options available for injecting AI into existing software products

    Transform your 
existing products 
with GenAI
Rhys Jones
rhys@axonzeta.ai
Monday 14th October 2024
    1/69
    GenAI
● Background & Trends
● Building and Supporting Products
● Improving Product UX and Workflows
● Demos & Code
● Discussion
    2/69
    GenAI Growth
    3/69
    GenAI Providers
Transformers vs other paradigms in Foundation Models
stateof.ai 2024
    4/69
    GenAI Training
Karpathy: https://www.youtube.com/watch?v=zjkBMFhNj_g
    5/69
    GenAI Performance
stateof.ai 2024
    6/69
    2023
100x drop!
2024
GenAI Costs
60x drop!
2023 2024
stateof.ai 2024
    7/69
    GenAI Open Models
stateof.ai 2024
    8/69
    GenAI : NN Predicting Next Word
Karpathy: https://www.youtube.com/watch?v=zjkBMFhNj_g
    9/69
    GenAI
● Background & Trends
● Building and Supporting Products
● Improving Product UX and Workflows
● Demos & Code
● Discussion
    10/69
    Building and Supporting Products
● Software Engineering
● Support 
● Sales
● Marketing
    11/69
    ICONIQ: State of AI 2024
    12/69
    ICONIQ: State of AI 2024
    13/69
    ICONIQ: State of AI 2024
    14/69
    ICONIQ: State of AI 2024
    15/69
    GenAI Tools
● Replit: AI Coding
● NotebookML : Research, Q&A,(Podcasts!)
● NapkinAI : Documentation, Diagrams 
● DifyAI : Custom Support Agents
● SciPhi : RAG Tools
● Synthesia : Product Video Generation
● BrainBox / ChatGPT : of course…
    16/69
    GenAI
● Background & Trends
● Building and Supporting Products
● Improving Product UX and Workflows
● Demos & Code
● Discussion
    17/69
    Improving Product UX and Workflows
    18/69
    Improving Product UX and Workflows
    19/69
    Discoverability & Search
● Semantic Search
● Vector Stores
● RAG : Retrieval Augmented Generation 
● Chatbot Assistants for your Product
    20/69
    Discoverability & Search
    21/69
    Discoverability & Search
    22/69
    Discoverability & Search
    23/69
    Discoverability & Search
    24/69
    Discoverability & Search
    25/69
    Improving Product UX and Workflows
    26/69
    ChatGPT Approach
    27/69
    Agentic Approach
    28/69
    Agentic Approach : Platforms
    29/69
    Agentic Approach : LangChain
    30/69
    Agentic Approach
    31/69
    Agentic Approach
    32/69
    Agentic Structured Outputs
    33/69
    Agentic Structured Outputs
    34/69
    Agentic Approach
● Takes any unstructured data
● Applies GenAI task
● Outputs correctly 
structured data
    35/69
    Agentic Approach
    36/69
    Safety and Security
● Function Calling by Agents
● How safe are inputs?
● Prompt Injection
● Restrict Function scopes
● Supervisor Agents
● Use JSON not Functions
    37/69
    GenAI
● Background & Trends
● Building and Supporting Products
● Improving Product UX and Workflows
● Demos & Code
● Discussion
    38/69
    Frontend UX
    39/69
    Frontend UX
    40/69
    Frontend UX
    41/69
    Frontend UX
    42/69
    Frontend UX https://py-todo-web-axonzeta.replit.app/
    43/69
    Backend Workflows
    44/69
    Backend Workflows
    45/69
    Backend Workflows https://ab-test-analyzer-axonzeta.replit.app/
    46/69
    Multi Agent Systems
● Agents work well with other Agents
● Some Agents DO others DECIDE and ROUTE
    47/69
    Multi Agent System Example
    48/69
    Multi Agent System Example
    49/69
    Multi Agent System Example
0161 524 9240
    50/69
    GenAI
● Background & Trends
● Building and Supporting Products
● Improving Product UX and Workflows
● Demos & Code
● Discussion
    51/69
     Agenda
 09:00 Registration and networking
09:30 Introduction to Techcelerate by Manoj
 09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX 
(beyond just chatbots!) - by Rhys
10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their 
products - Rhys and facilitated by Manoj
11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for 
your Web Apps - by Rhys
11:30 Breaking the barriers in your tech startup journey - by Manoj
12:00 Networking
    52/69
    Discussion
    53/69
     Agenda
 09:00 Registration and networking
09:30 Introduction to Techcelerate by Manoj
 09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX 
(beyond just chatbots!) - by Rhys
10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their 
products - Rhys and facilitated by Manoj
11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for 
your Web Apps - by Rhys
11:30 Breaking the barriers in your tech startup journey - by Manoj
12:00 Networking
    54/69
    Run your own AI
with local SLMs
Google Chrome | AxonZeta
    55/69
    LLMs and SLMs
● Large Language Models
○ Typically > 70B parameters
○ GPT4 estimated to be 1,760B params
● Small Language Models
○ Typically < 20B parameters
○ Quantized to e.g. 4 Bits per param
    56/69
    Small Model Performance
Phi 3.5
3.8B parameters
~ 7.7GB memory
Quantized
to 4 bits / param
~ 2GB memory
    57/69
    Laptop Performance
    58/69
    On-Device Small Models
    59/69
    ● Local processing of Sensitive Data
● Snappy user experience
● Full control of AI Models
● Offline AI use
● Change in economic model
○ User already has the resource
○ No extra “$20/month for our AI!”
On Device SML Benefits
    60/69
    In-Browser AI
    61/69
    In-Browser AI
Google AI Studio
Google Vertex AI
    62/69
    [AZ Product]
Cross Device
Custom Models
    63/69
    [AZ Product]
● Development platform for On-Device SML AI
● Prompting & Training
● Evaluation & Monitoring
● Leverage multiple SLMs
● Works across all Browsers
    64/69
    [AZ Product]
● Add local AI Agents to web apps
● Test with different Small Models 
● Promotes private, free, local AI
● User still in charge
● Combine with Hybrid on-cloud or on-prem
    65/69
    [AZ Product]
    66/69
    Run your own AI
with local SLMs
Google Chrome | AxonZeta
    67/69
     Agenda
 09:00 Registration and networking
09:30 Introduction to Techcelerate by Manoj
 09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX 
(beyond just chatbots!) - by Rhys
10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their 
products - Rhys and facilitated by Manoj
11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for 
your Web Apps - by Rhys
11:30 Breaking the barriers in your tech startup journey - by Manoj
12:00 Networking
    68/69
    Networking
    69/69

    Transform your existing products with GenAI

    • 1. Transform your existing products with GenAI Rhys Jones rhys@axonzeta.ai Monday 14th October 2024
    • 2. GenAI ● Background & Trends ● Building and Supporting Products ● Improving Product UX and Workflows ● Demos & Code ● Discussion
    • 3. GenAI Growth
    • 4. GenAI Providers Transformers vs other paradigms in Foundation Models stateof.ai 2024
    • 5. GenAI Training Karpathy: https://www.youtube.com/watch?v=zjkBMFhNj_g
    • 6. GenAI Performance stateof.ai 2024
    • 7. 2023 100x drop! 2024 GenAI Costs 60x drop! 2023 2024 stateof.ai 2024
    • 8. GenAI Open Models stateof.ai 2024
    • 9. GenAI : NN Predicting Next Word Karpathy: https://www.youtube.com/watch?v=zjkBMFhNj_g
    • 10. GenAI ● Background & Trends ● Building and Supporting Products ● Improving Product UX and Workflows ● Demos & Code ● Discussion
    • 11. Building and Supporting Products ● Software Engineering ● Support ● Sales ● Marketing
    • 12. ICONIQ: State of AI 2024
    • 13. ICONIQ: State of AI 2024
    • 14. ICONIQ: State of AI 2024
    • 15. ICONIQ: State of AI 2024
    • 16. GenAI Tools ● Replit: AI Coding ● NotebookML : Research, Q&A,(Podcasts!) ● NapkinAI : Documentation, Diagrams ● DifyAI : Custom Support Agents ● SciPhi : RAG Tools ● Synthesia : Product Video Generation ● BrainBox / ChatGPT : of course…
    • 17. GenAI ● Background & Trends ● Building and Supporting Products ● Improving Product UX and Workflows ● Demos & Code ● Discussion
    • 18. Improving Product UX and Workflows
    • 19. Improving Product UX and Workflows
    • 20. Discoverability & Search ● Semantic Search ● Vector Stores ● RAG : Retrieval Augmented Generation ● Chatbot Assistants for your Product
    • 21. Discoverability & Search
    • 22. Discoverability & Search
    • 23. Discoverability & Search
    • 24. Discoverability & Search
    • 25. Discoverability & Search
    • 26. Improving Product UX and Workflows
    • 27. ChatGPT Approach
    • 28. Agentic Approach
    • 29. Agentic Approach : Platforms
    • 30. Agentic Approach : LangChain
    • 31. Agentic Approach
    • 32. Agentic Approach
    • 33. Agentic Structured Outputs
    • 34. Agentic Structured Outputs
    • 35. Agentic Approach ● Takes any unstructured data ● Applies GenAI task ● Outputs correctly structured data
    • 36. Agentic Approach
    • 37. Safety and Security ● Function Calling by Agents ● How safe are inputs? ● Prompt Injection ● Restrict Function scopes ● Supervisor Agents ● Use JSON not Functions
    • 38. GenAI ● Background & Trends ● Building and Supporting Products ● Improving Product UX and Workflows ● Demos & Code ● Discussion
    • 39. Frontend UX
    • 40. Frontend UX
    • 41. Frontend UX
    • 42. Frontend UX
    • 43. Frontend UX https://py-todo-web-axonzeta.replit.app/
    • 44. Backend Workflows
    • 45. Backend Workflows
    • 46. Backend Workflows https://ab-test-analyzer-axonzeta.replit.app/
    • 47. Multi Agent Systems ● Agents work well with other Agents ● Some Agents DO others DECIDE and ROUTE
    • 48. Multi Agent System Example
    • 49. Multi Agent System Example
    • 50. Multi Agent System Example 0161 524 9240
    • 51. GenAI ● Background & Trends ● Building and Supporting Products ● Improving Product UX and Workflows ● Demos & Code ● Discussion
    • 52. Agenda 09:00 Registration and networking 09:30 Introduction to Techcelerate by Manoj 09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX (beyond just chatbots!) - by Rhys 10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their products - Rhys and facilitated by Manoj 11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for your Web Apps - by Rhys 11:30 Breaking the barriers in your tech startup journey - by Manoj 12:00 Networking
    • 53. Discussion
    • 54. Agenda 09:00 Registration and networking 09:30 Introduction to Techcelerate by Manoj 09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX (beyond just chatbots!) - by Rhys 10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their products - Rhys and facilitated by Manoj 11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for your Web Apps - by Rhys 11:30 Breaking the barriers in your tech startup journey - by Manoj 12:00 Networking
    • 55. Run your own AI with local SLMs Google Chrome | AxonZeta
    • 56. LLMs and SLMs ● Large Language Models ○ Typically > 70B parameters ○ GPT4 estimated to be 1,760B params ● Small Language Models ○ Typically < 20B parameters ○ Quantized to e.g. 4 Bits per param
    • 57. Small Model Performance Phi 3.5 3.8B parameters ~ 7.7GB memory Quantized to 4 bits / param ~ 2GB memory
    • 58. Laptop Performance
    • 59. On-Device Small Models
    • 60. ● Local processing of Sensitive Data ● Snappy user experience ● Full control of AI Models ● Offline AI use ● Change in economic model ○ User already has the resource ○ No extra “$20/month for our AI!” On Device SML Benefits
    • 61. In-Browser AI
    • 62. In-Browser AI Google AI Studio Google Vertex AI
    • 63. [AZ Product] Cross Device Custom Models
    • 64. [AZ Product] ● Development platform for On-Device SML AI ● Prompting & Training ● Evaluation & Monitoring ● Leverage multiple SLMs ● Works across all Browsers
    • 65. [AZ Product] ● Add local AI Agents to web apps ● Test with different Small Models ● Promotes private, free, local AI ● User still in charge ● Combine with Hybrid on-cloud or on-prem
    • 66. [AZ Product]
    • 67. Run your own AI with local SLMs Google Chrome | AxonZeta
    • 68. Agenda 09:00 Registration and networking 09:30 Introduction to Techcelerate by Manoj 09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX (beyond just chatbots!) - by Rhys 10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their products - Rhys and facilitated by Manoj 11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for your Web Apps - by Rhys 11:30 Breaking the barriers in your tech startup journey - by Manoj 12:00 Networking
    • 69. Networking


    • Previous
    • Next
    • f Fullscreen
    • esc Exit Fullscreen