Benjamin Gleitzman

Check out our latest post on Clappy.ai, "Leverage Layout-Aware RAG for More Accurate Retrieval of Knowledge from Documents." Discover how to harness the power of Retrieval-Augmented Generation (RAG) for documents in PDF, Doc, and Markdown formats. Dive into the specifics of implementation and explore our reference repository to get started with advanced RAG for your knowledge base. Don't miss out on this essential read! Continue reading here for all the details: The Power of Hierarchical Indexing with RAG. (https://lnkd.in/gbiVHfcH)

2

This is a quick way (Bill came in below his 4 minute limit!) to learn more about what we're building with Prak.

5

A good read on building with LLMs https://applied-llms.org/

11

This new little product demo is awesome! Our new Rev AI Transcript Assistant will save you TONS of time. Easily pull out nuggets of info from your transcripts, making valuable content more accessible than ever. https://lnkd.in/gzzFpcDa #transcription #asr #accessibility #transcript #summarization #ai #assistant

31

2 Comments

Anthropic Raises the Bar with Claude 3.5 Sonnet: A New Era for AI and Data? As someone who's passionate about data and AI services, I'm always on the lookout for advancements that push the boundaries of AI and its real-world applications. Today, Anthropic's launch of Claude 3.5 Sonnet has definitely caught my attention. Here's what's got me excited: Powerhouse Performance: Claude 3.5 Sonnet reportedly surpasses many benchmarks in reasoning, coding, and even visual comprehension. This could be a game-changer for complex data analysis and model development. State-of-the-Art Vision: Improved image analysis and text transcription capabilities have huge potential for automating data extraction from documents and images, streamlining processes for many industries. "Artifacts" Feature: Anthropic's new interface for displaying generated content (code, documents, etc.) seems incredibly user-friendly, promoting easier collaboration and review within teams. Here's where I see the potential impact for data services: Data Science and Analysis: With its ability to navigate unstructured data and leverage internal tools and APIs, Claude 3.5 Sonnet can generate high-quality visualizations, actionable predictions, and valuable insights. This has massive potential for accelerating research in fields like healthcare and education. Streamlined Processes: Improved automation in tasks like data extraction and code generation could improve efficiency and reduce costs. New Service Opportunities: We might explore offering services specifically around the unique capabilities of Claude 3.5 Sonnet, tailoring solutions to clients' needs. I'm eager to hear your thoughts on Claude 3.5 Sonnet, especially from those of you working in AI and data services. How do you see this fitting into the current AI model landscape? What are the potential implications for our industry? Let's discuss! #AI #DataScience #Anthropic #Claude3.5Sonnet #ArtificialIntelligence #Innovation #QuadrantAI

88

Anthropic just launched Claude 3.5 Sonnet, which beats both OpenAI GPT-4o and Anthropic’s previous paid model Claude 3 Opus on most benchmarks. Claude 3.5 Sonnet can execute and debug code, and has improved image understanding capabilities, including text transcription. A new feature called “Artifacts” enables users to view generated code, documents and websites in a separate window next to the chat. Claude 3.5 Sonnet is available for free to all users, but paid users get higher usage caps. Did Anthropic just take the lead back from OpenAI? It seems that ChatGPT’s Code Interpreter tool, which used to be one its main advantages, has finally met its match, but ChatGPT still has the advantages of real-time Internet access and custom GPTs which Claude lacks… What do you think? https://lnkd.in/d_hk86cf

10

3 Comments

At Valence Vibrations, we’re constantly asked what methods we use to detect emotion. Some companies offer facial recognition or NLP sentiment analysis, while we’re focused on tonal audio analysis. In our experience, audio data offers the most emotional nuance and the most applicability to different situations. Check out my blog for a run down of each method of emotion classification, and why we feel our audio methods and models are the best bet for highly accurate and accessible emotion AI. 

45

4 Comments

That's a good summary Manny Bernabe - Reflecting on an insightful article from O'Reilly about LLMs, I was struck by this point: "LLMs are also broadly accessible, allowing everyone, not just ML engineers and scientists, to build intelligence into their products. While the barrier to entry for building AI products has been lowered, creating those effective beyond a demo remains a deceptively difficult endeavor." This democratization reminds me of the printing press's impact on biblical texts, which expanded access but also introduced new interpretive challenges. As we navigate these advancements, it's crucial to balance accessibility with responsible use. At Ushur, we've been at the forefront of leveraging LLMs in our backend/knowledge work automation as well as carefully introducing them on the conversational side via our Chatbots and other modes. More will be coming out on that. Read more here: O'Reilly Article #AI #LLM #Technology #Innovation #History #Democratization #ResponsibleAI #Ushur

10

1 Comment

Anthropic has launched Claude 3.5 Sonnet, the inaugural release in their upcoming Claude 3.5 model family. This new AI model sets unprecedented industry benchmarks for intelligence, outperforming competitor models and even Anthropic's own Claude 3 Opus across a wide range of evaluations, including graduate-level reasoning, undergraduate-level knowledge, and coding proficiency. Claude 3.5 Sonnet demonstrates significant improvements in understanding nuance, humor, and complex instructions, while excelling at producing high-quality content with a natural, relatable tone. ➜ Check the news at: https://lnkd.in/dbKMKPm7 ➜ Vendorvise's official Instagram: https://lnkd.in/ebK2KQ2C ➜ Vendorvise's Linktree: https://lnkd.in/dQdbMdth 🤖 If you enjoy reading my posts about AI and tech news, hit that like button and share with your friends to support my content! #ai #artificialintelligence #ainews #aipowered #news #blog #claude3 #sonnet #anthropic #generativeai #llms #tokens #aitools #aitech #tech #technology #hardware #content #socialmedia #future #new #launch #business #techtrends #innovation #success #markets #people #industry

2

This is a good article on using LLMs in the real world. It covers many aspects that we learned at Nurish over the last few months and more. Using LLMs is an inexact science, but has its own needs in processes and tools. While most of the attention has been on the LLMS, their capabilities, and RAG, there are mundane issues that need to be taken care of, issues where the solutions for pre-LLM development are not that well-suited. These include version management, integration, testing, data management, quality assessment, and more. This article covers many of those practical aspects. Eugene Yan, Bryan Bischof, Charles Frye & more https://applied-llms.org/

9

New Mindset Needed for Large Language Models - https://buff.ly/3XbN4vp #AI #ML #LLMs #genAI

The Open Medical LLM Leaderboard on Hugging Face dropped last Friday (thanks Geoff Kwitko for the heads up), and it aims to track, rank and evaluate the performance of large language models (LLMs) on medical question answering tasks (see link below). It evaluates LLMs across a diverse array of medical datasets, including MedQA (USMLE), PubMedQA, MedMCQA, and subsets of MMLU related to medicine and biology. The leaderboard offers a comprehensive assessment of each model's medical knowledge and question answering capabilities. The datasets cover various aspects of medicine such as general medical knowledge, clinical knowledge, anatomy, genetics, and more. They contain multiple-choice and open-ended questions that require medical reasoning and understanding. More details on the datasets can be found in the "LLM Benchmarks Details" section in the link. Ps. Good to know that the GPT-4 model is leading the way (it is what I use on the Medical Coding and Documentation agent). Digital Human Assistants #llmhealthcare

8

Our paper, "QGen: On the Ability to Generalize in Quantization Aware Training," (https://lnkd.in/gXXvS_9Q) is now available on Arxiv. This research delved into the generalization capabilities of quantized models, a relatively unexplored domain, examining them through the lens of sharpness in the loss landscape during optimization. I found the experiments and mathematical proofs particularly fulfilling. We're hopeful for acceptance at the conference to which it's been submitted. 🤞

47

𝐀𝐠𝐞𝐧𝐭𝐢𝐜 𝐖𝐨𝐫𝐤𝐟𝐥𝐨𝐰: 𝐏𝐢𝐨𝐧𝐞𝐞𝐫𝐢𝐧𝐠 𝐭𝐡𝐞 𝐅𝐮𝐭𝐮𝐫𝐞 Recently I happened to see this nice video ( 𝘩𝘵𝘵𝘱𝘴://𝘸𝘸𝘸.𝘺𝘰𝘶𝘵𝘶𝘣𝘦.𝘤𝘰𝘮/𝘸𝘢𝘵𝘤𝘩?𝘷=𝘴𝘢𝘭78𝘈𝘊𝘵𝘎𝘛𝘤 ) by Andrew Ng in which he talks about Agentic workflows. In Language Model (LLM) development, we provide a zero-shot prompt and receive an answer. We may review it and add more prompts to get it to a desired shape. This is exactly what the agentic workflow does. Basically, 𝘢 𝒃𝒖𝒏𝒄𝒉 𝒐𝒇 𝑨𝑰 𝒂𝒈𝒆𝒏𝒕𝒔 𝒘𝒐𝒓𝒌 𝒕𝒐𝒈𝒆𝒕𝒉𝒆𝒓 𝒊𝒏 𝒂𝒏 𝒊𝒕𝒆𝒓𝒂𝒕𝒊𝒗𝒆 𝒘𝒂𝒚 𝒕𝒐 𝒑𝒓𝒐𝒅𝒖𝒄𝒆 𝒂 𝒅𝒆𝒔𝒊𝒓𝒆𝒅 𝒐𝒖𝒕𝒑𝒖𝒕. Moreover, he even claims the output produced by agentic workflow is much better than the output produced single LLM which might sound obvious but what surprised me was, as per the “𝑯𝒖𝒎𝒂𝒏𝑬𝒗𝒂𝒍” coding benchmark, agents-based approach beating plain LLM by quite a margin (see the picture below). The plain 𝐆𝐏𝐓 3.5 was at 48% but 𝑳𝑫𝑩+𝑹𝒆𝒇𝒍𝒆𝒄𝒕𝒊𝒐𝒏 (𝘈 𝘓𝘢𝘳𝘨𝘦 𝘓𝘢𝘯𝘨𝘶𝘢𝘨𝘦 𝘔𝘰𝘥𝘦𝘭 𝘋𝘦𝘣𝘶𝘨𝘨𝘦𝘳 𝘷𝘪𝘢 𝘝𝘦𝘳𝘪𝘧𝘺𝘪𝘯𝘨 𝘙𝘶𝘯𝘵𝘪𝘮𝘦 𝘌𝘹𝘦𝘤𝘶𝘵𝘪𝘰𝘯 𝘚𝘵𝘦𝘱-𝘣𝘺-𝘴𝘵𝘦𝘱) fared at impressive 95.1% with the same GPT 3.5. The plain 𝐆𝐏𝐓 4 was at 67% but 𝑨𝒈𝒆𝒏𝒕𝑪𝒐𝒅𝒆𝒓 (𝘔𝘶𝘭𝘵𝘪-𝘈𝘨𝘦𝘯𝘵-𝘣𝘢𝘴𝘦𝘥 𝘊𝘰𝘥𝘦 𝘎𝘦𝘯𝘦𝘳𝘢𝘵𝘪𝘰𝘯 𝘸𝘪𝘵𝘩 𝘐𝘵𝘦𝘳𝘢𝘵𝘪𝘷𝘦 𝘛𝘦𝘴𝘵𝘪𝘯𝘨 𝘢𝘯𝘥 𝘖𝘱𝘵𝘪𝘮𝘪𝘴𝘢𝘵𝘪𝘰𝘯) fared at whooping 96.3% with the same GPT 4.  You can get more information about the evaluation and the models at 𝘩𝘵𝘵𝘱𝘴://𝘱𝘢𝘱𝘦𝘳𝘴𝘸𝘪𝘵𝘩𝘤𝘰𝘥𝘦.𝘤𝘰𝘮/𝘴𝘰𝘵𝘢/𝘤𝘰𝘥𝘦-𝘨𝘦𝘯𝘦𝘳𝘢𝘵𝘪𝘰𝘯-𝘰𝘯-𝘩𝘶𝘮𝘢𝘯𝘦𝘷𝘢𝘭. He also mentioned the following are the 4 design patterns that are emerging in the agentic workflow. 1.    Reflection 2.    Tool use 3.    Planning 4.    Multi-agent collaboration If you are interested in learning more, instead of me explaining each of these patterns, I would encourage watching the video :) #ai #agent #agenticworkflow #gpt

22

#RAG DOES NOT REDUCE HALLUCINATIONS IN #LLMS: Think I've called this out a few times, but the validation is nice - https://lnkd.in/eAi6zxW2. The article makes two well established points: 1) "Hallucination is a problem of reasoning and not relevance! Any amount of relevant text fed through RAG to a machine will retain the original perplexity and entropy in the system to hallucinate independent of the text"; and 2) "The initial challenge arises from the retrieval phase’s reliance on semantic similarity, which is quantified by inner product spaces or cosine similarities. This metric, while capturing semantic closeness, does not differentiate between factually accurate and inaccurate information." This should be clear to everyone, but the industry still shills flimsy RAG scaffolding anyway (shovels to gold miners).

104

34 Comments