James Raybould’s Post

This is the "Must Wacth" video! Mark Russinovich, Azure CTO, talks about the AI supercomputer infrastructure built to run ChatGPT! Get an inside look at the AI supercomputer infrastructure built to run ChatGPT and other large language models, and see how to leverage it for your workloads in Azure, at any scale. Go behind the scenes: -For how we collaborated with NVIDIA to deliver purpose-built AI infrastructure with NVIDIA GPUs -How Project Forge checkpointing works to restore job states if a long training job fails or needs to be migrated -How we used LoRA fine-tuning to update a fraction of the base model for more training throughput and smaller checkpoints -How UK-based company, Wayve, is using Azure's AI supercomputer infrastructure for self-driving cars -And how Confidential Computing works with Azure AI to combine datasets without sharing personally identifiable information for secure multiparty collaborations. https://lnkd.in/gmfWRC22

AI Reading for Tuesday, March 19, 2024! Nvidia announces latest chips, says they offer 2.5x raw performance increase over current generation, or as much 25x with bigger clusters with fast interconnects training trillion-parameter models - VentureBeat https://lnkd.in/e4qn8rCe Nvidia's quantum infrastructure initiative linking GPUs to third-party quantum hardware. - VentureBeat Sam Altman interviewed by Lex Fridman, talks about the ‘blip’, Ilya Sutskever, Elon Musk, open versus closed, Q* and future models. - Lex Fridman Humans are good at projecting lifelike illusions on AI, the Eliza effect anthropomorphizing it, all the more as AI gets better - The New Yorker Testing Google's Search Generative Experience suggests more searches might be answered directly without the user clicking through to third-party sites, changing the nature of search and the Web - Business Insider Perplexity CEO says he can't match what xAI is paying. - Business Insider Grok-1 release: 'PartlyOpenAI' . - The Register. Epic uses ChatGPT to suggest how doctors should code medical diagnoses and procedures - Forbes Goldman Sachs chief economist talks about AI's impact on jobs. - CNN YouTube says realistic-looking AI content must be labeled as AI - Engadget

Get an inside look at the #AI supercomputer infrastructure built to run ChatGPT and other large language models, and see how to leverage it for your workloads in #Azure, at any scale. Go behind the scenes: - For how #Microsoft collaborated with #NVIDIA to deliver purpose-built AI infrastructure with NVIDIA GPUs - How Project Forge checkpointing works to restore job states if a long training job fails or needs to be migrated - How they used LoRA fine-tuning to update a fraction of the base model for more training throughput and smaller checkpoints -How UK-based company, Wayve, is using Azure's AI supercomputer infrastructure for #selfdriving cars - And how Confidential Computing works with Azure AI to combine datasets without sharing personally identifiable information for secure multiparty collaborations, https://lnkd.in/eX8mDDXq Please, also check the article "What Does AI Bring to Your Quality Management System?", https://lnkd.in/eYakFG4m BPA Solutions has explored different AI tools and their usage for #quality management, such as chatbots, #objectdetection, and prediction, https://lnkd.in/eUUXPhXw

Apple did a masterclass when they announced their next plan around AI - they downplayed the technology and focused on the benefits, the experiences, the ease of use. Products are there to solve problems and to alleviate pain. And that’s why they’ve refrained from using “AI” so far and were very conservative with its use in the keynote. When delivering a user focused message, the technology (the how) needs to take a backseat so the experience and benefit (the why) can take prime time. And they focused that section of the keynote very strongly on delivering that message. The SOTUs dived deeper and were even more incredibly impressive. Here, they focused more on the How. However, I wish they didn’t dilute their message with the silly “integration” to ChatGPT. That’s just a fancy API call and is just some eye candy on top - nothing very different to having the ChatGPT app anyway. It was unnecessary and it’s confused some folks who didn’t catch that NONE of the Apple Intelligence architecture, systems and interfaces have anything to do with OpenAI. That’s all Apple and as a bonus - running entirely on Apple Silicon and not nVidia. p/s: I have nothing against nVidia, rather I am impressed at Apple's continued ability to execute on their strategy of being in control of the h/w and s/w of their prime offerings.

Get an inside look at the AI supercomputer infrastructure built to run ChatGPT and other large language models, and see how to leverage it for your workloads in Azure, at any scale. Go behind the scenes: -For how we collaborated with NVIDIA to deliver purpose-built AI infrastructure with NVIDIA GPUs -How Project Forge checkpointing works to restore job states if a long training job fails or needs to be migrated -How we used LoRA fine-tuning to update a fraction of the base model for more training throughput and smaller checkpoints -How UK-based company, Wayve, is using Azure's AI supercomputer infrastructure for self-driving cars -And how Confidential Computing works with Azure AI to combine datasets without sharing personally identifiable information for secure multiparty collaborations. Mark Russinovich, Azure CTO, joins Jeremy Chapman to break it down. ► QUICK LINKS: 00:00 - Introduction 01:15 - AI innovation building specialized hardware and software 04:22 - Optimizing hardware 05:40 - Improved throughput 06:17 - Project Forge 08:01 - Project Forge checkpointing demo 10:02 - LoRA fine tuning 11:29 - Use AI supercomputer infrastructure for your workloads 12:34 - How Wayve is leveraging AI supercomputer infrastructure 13:47 - How Confidential Computing works with Azure AI 15:21 - Wrap up https://lnkd.in/enWpTpGW

𝗔𝗜 𝗠𝗼𝗱𝗲𝗹𝘀 𝗗𝗼𝘄𝗻: 𝗠𝗶𝗹𝗹𝗶𝗼𝗻𝘀 𝗙𝗼𝗿𝗰𝗲𝗱 𝘁𝗼 𝗪𝗼𝗿𝗸 𝗶𝗻 𝗔𝗻𝗮𝗹𝗼𝗴 Uh oh, we have to use our brains!!! ChatGPT, Claude, and Perplexity all decided to take a simultaneous coffee break, leaving users wondering if the machines are finally taking over. ╭┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈╮ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ 𝙇𝙚𝙖𝙧𝙣 𝙝𝙤𝙬 𝙩𝙤 𝙘𝙧𝙚𝙖𝙩𝙚 𝙮𝙤𝙪𝙧 𝙤𝙬𝙣 𝙣𝙚𝙬𝙨𝙡𝙚𝙩𝙩𝙚𝙧 ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎ ‎https://lnkd.in/gwanTWDY ╰┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈╯ Here's what you need to know: ✦ ChatGPT, Claude, and Perplexity all faced outages on Tuesday morning, with ChatGPT’s issues lasting several hours. ✦ The simultaneous outages suggest a potential broader infrastructure issue or internet-scale problem affecting multiple AI providers. ✦ While the cause remains unclear, the outages highlight the need for improved reliability and resilience in AI systems. -ˋˏ✄┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈ Other stories covered in today's addition: → Microsoft uses AI to enhance D-Day archives → Google launches “Google Developer Program” → Intel announces AI chips to rival Nvidia’s dominance -ˋˏ✄┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈┈ If you don’t want 𝗲𝘅𝗰𝗹𝘂𝘀𝗶𝘃𝗲 𝗰𝗼𝗻𝘁𝗲𝗻𝘁 then don’t click this link ⤷ https://lnkd.in/gXeQbzSj 𝟑𝟎𝟎+ 𝗔𝗜 𝗲𝗻𝘁𝗵𝘂𝘀𝗶𝗮𝘀𝘁𝘀 get early AI updates using this link ⤷ bit.ly/aiplusyou-LinkedIn

The ‘Dean of Valuation’ doesn’t buy the AI hype… With AI news being all the rage, the markets have pronounced Microsoft and Nvidia as the kings of the new age. Nvidia stock is up 55% in the last 6 months driven largely by expectations of growth in their AI and Automotive positions. Microsoft on the other hand have produced more modest results with a 26% jump in the last 6 months. The growth of this tech giant has been slightly more veiled due to competition and anti-trust laws however, it is no secret that their alliance with OpenAI (the creators of ChatGPT) has a lot to do with it. However, Aswath Damodaran, Finance Professor at NYU Stern and largely proclaimed on Wall Street as the Dean of Valuation, has come out and shared that he has halved his holding in Nvidia over last summer and is planning to halve it again. Through his valuation methods he pins Nvidia to be overvalued by up to 40% even after pricing in its tremendous growth prospects, and for someone who is prepping the minds of the next generation of financiers, I’d say his opinion is to be taken as the closest thing to a crystal ball. What do you think? Are you jumping on the AI hype train or is it going off the rails in the near future?

ChatGPT is all the rage in 2023. But there's nothing artificial about the returns for many tech stocks and ETFs with skin in the AI game so far this year. But be wary of valuations and competition. My latest Substack post. #chatgpt #nvidia #google #bard #microsoft #ai https://lnkd.in/egPSavJz

ChaGPT can now remember things 🧠 Plus Huge developments from OpenAI, Google, Apple, Nvidia and Samsung AI Trends of the Day 👇 Glimpse: + Sam Altman’s $7T plan + Apple Buys iWork Domain + ChaGPT can now remember things 🧠 + 🤖 NVIDIA launches demo ChatGPT rival + Google Pumping $27M Into AI Training + 📈 Nvidia briefly beats Amazon amid AI hype + 45% OF MEN WILL USE AI TO EXPRESS V-DAY LOVE 💘 + Stability AI and Midjourney may be defeated in the copyright battle. --- P.S. Did you enjoy this post? Then you'll love my free newsletter! Sign Up and Get $299 worth of AI goodies. Join Here: https://lnkd.in/ezuqAaFH -- Feel free to repost it for your audience, too ♻️

🚀 Exciting Times in Gen AI ! Meet Grok, xAI‘s chatbot. It’s the funny, sassy, sarcastic cousin of the straight laced OpenAI ChatGPT and the oracle of polite wisdom Google’s Bard 🔮 👉 Grok boasts real-time data wizardry from X ( aka Twitter) data utilizing the power of its social media & the thousands of NVIDIA A100 GPUs which have been the AI industry standard and in very short supply. ⛓️🚀The next gen NVIDIA H200 GPU promises to be twice as fast and half the cost resulting in more models trained faster with less AI chips. This could be a potential geopolitical technology supply chain game-changer. X has a potential strategic advantage over ChatGPT or Bard in that all breaking news info usually appears on its site before any other platforms meaning it can likely have the most up-to-date models among the three. 🤔 💬But hold your chat bubbles! While Grok's charm shines, I’m cautiously optimistic about it referencing off the X platform. You know quality, bias and security and stuff. More to come but if it works the way it’s intended, this may might be worth the billions 💰💰💰Musk shelled out for the blue bird 🐦! Follow me and to go deep on this topic contact me for your next speaking engagement! #GrokTalksAI #AIInnovation #chatbotrevolution