Transform your existing products with GenAI

Transform your existing products with GenAI

• 1. Transform your existing products with GenAI Rhys Jones rhys@axonzeta.ai Monday 14th October 2024

• 2. GenAI ● Background & Trends ● Building and Supporting Products ● Improving Product UX and Workflows ● Demos & Code ● Discussion

• 3. GenAI Growth

• 4. GenAI Providers Transformers vs other paradigms in Foundation Models stateof.ai 2024

• 5. GenAI Training Karpathy: https://www.youtube.com/watch?v=zjkBMFhNj_g

• 6. GenAI Performance stateof.ai 2024

• 7. 2023 100x drop! 2024 GenAI Costs 60x drop! 2023 2024 stateof.ai 2024

• 8. GenAI Open Models stateof.ai 2024

• 9. GenAI : NN Predicting Next Word Karpathy: https://www.youtube.com/watch?v=zjkBMFhNj_g

• 10. GenAI ● Background & Trends ● Building and Supporting Products ● Improving Product UX and Workflows ● Demos & Code ● Discussion

• 11. Building and Supporting Products ● Software Engineering ● Support ● Sales ● Marketing

• 12. ICONIQ: State of AI 2024

• 13. ICONIQ: State of AI 2024

• 14. ICONIQ: State of AI 2024

• 15. ICONIQ: State of AI 2024

• 16. GenAI Tools ● Replit: AI Coding ● NotebookML : Research, Q&A,(Podcasts!) ● NapkinAI : Documentation, Diagrams ● DifyAI : Custom Support Agents ● SciPhi : RAG Tools ● Synthesia : Product Video Generation ● BrainBox / ChatGPT : of course…

• 17. GenAI ● Background & Trends ● Building and Supporting Products ● Improving Product UX and Workflows ● Demos & Code ● Discussion

• 18. Improving Product UX and Workflows

• 19. Improving Product UX and Workflows

• 20. Discoverability & Search ● Semantic Search ● Vector Stores ● RAG : Retrieval Augmented Generation ● Chatbot Assistants for your Product

• 21. Discoverability & Search

• 22. Discoverability & Search

• 23. Discoverability & Search

• 24. Discoverability & Search

• 25. Discoverability & Search

• 26. Improving Product UX and Workflows

• 27. ChatGPT Approach

• 28. Agentic Approach

• 29. Agentic Approach : Platforms

• 30. Agentic Approach : LangChain

• 31. Agentic Approach

• 32. Agentic Approach

• 33. Agentic Structured Outputs

• 34. Agentic Structured Outputs

• 35. Agentic Approach ● Takes any unstructured data ● Applies GenAI task ● Outputs correctly structured data

• 36. Agentic Approach

• 37. Safety and Security ● Function Calling by Agents ● How safe are inputs? ● Prompt Injection ● Restrict Function scopes ● Supervisor Agents ● Use JSON not Functions

• 38. GenAI ● Background & Trends ● Building and Supporting Products ● Improving Product UX and Workflows ● Demos & Code ● Discussion

• 39. Frontend UX

• 40. Frontend UX

• 41. Frontend UX

• 42. Frontend UX

• 43. Frontend UX https://py-todo-web-axonzeta.replit.app/

• 44. Backend Workflows

• 45. Backend Workflows

• 46. Backend Workflows https://ab-test-analyzer-axonzeta.replit.app/

• 47. Multi Agent Systems ● Agents work well with other Agents ● Some Agents DO others DECIDE and ROUTE

• 48. Multi Agent System Example

• 49. Multi Agent System Example

• 50. Multi Agent System Example 0161 524 9240

• 51. GenAI ● Background & Trends ● Building and Supporting Products ● Improving Product UX and Workflows ● Demos & Code ● Discussion

• 52. Agenda 09:00 Registration and networking 09:30 Introduction to Techcelerate by Manoj 09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX (beyond just chatbots!) - by Rhys 10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their products - Rhys and facilitated by Manoj 11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for your Web Apps - by Rhys 11:30 Breaking the barriers in your tech startup journey - by Manoj 12:00 Networking

• 53. Discussion

• 54. Agenda 09:00 Registration and networking 09:30 Introduction to Techcelerate by Manoj 09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX (beyond just chatbots!) - by Rhys 10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their products - Rhys and facilitated by Manoj 11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for your Web Apps - by Rhys 11:30 Breaking the barriers in your tech startup journey - by Manoj 12:00 Networking

• 55. Run your own AI with local SLMs Google Chrome | AxonZeta

• 56. LLMs and SLMs ● Large Language Models ○ Typically > 70B parameters ○ GPT4 estimated to be 1,760B params ● Small Language Models ○ Typically < 20B parameters ○ Quantized to e.g. 4 Bits per param

• 57. Small Model Performance Phi 3.5 3.8B parameters ~ 7.7GB memory Quantized to 4 bits / param ~ 2GB memory

• 58. Laptop Performance

• 59. On-Device Small Models

• 60. ● Local processing of Sensitive Data ● Snappy user experience ● Full control of AI Models ● Offline AI use ● Change in economic model ○ User already has the resource ○ No extra “$20/month for our AI!” On Device SML Benefits

• 61. In-Browser AI

• 62. In-Browser AI Google AI Studio Google Vertex AI

• 63. [AZ Product] Cross Device Custom Models

• 64. [AZ Product] ● Development platform for On-Device SML AI ● Prompting & Training ● Evaluation & Monitoring ● Leverage multiple SLMs ● Works across all Browsers

• 65. [AZ Product] ● Add local AI Agents to web apps ● Test with different Small Models ● Promotes private, free, local AI ● User still in charge ● Combine with Hybrid on-cloud or on-prem

• 66. [AZ Product]

• 67. Run your own AI with local SLMs Google Chrome | AxonZeta

• 68. Agenda 09:00 Registration and networking 09:30 Introduction to Techcelerate by Manoj 09:45 Transform your existing product by adding GenAI to automate user workflows, improve features and enhance UX (beyond just chatbots!) - by Rhys 10:30 Interactive discussion with Techcelerate companies to understand and explore how they plan on adding AI to their products - Rhys and facilitated by Manoj 11:00 Learn about AxonZeta and Google Chrome's new on-device AI, giving you a cost-free, easy-to-use LLM runtime for your Web Apps - by Rhys 11:30 Breaking the barriers in your tech startup journey - by Manoj 12:00 Networking

• 69. Networking