Rajeev T.

Google's $1 billion investment in Pacific connectivity is a major milestone in bridging the digital divide and fostering a more connected world. This initiative not only strengthens infrastructure but also holds the promise of transforming lives and economies across the Pacific region. As we move towards an increasingly digital future, investments like these are crucial in ensuring that everyone can benefit from the opportunities that connectivity brings. “In partnership with Governor Green’s administration, Hawaii's Connect Kakou initiative is working to ensure people from all walks of life have reliable and affordable access to high-speed Internet. The Pacific Connect initiative perfectly complements our planned efforts, and will significantly enhance our future connections from Hawaii to the continental U.S. and Japan as well as ensure communities across the Pacific have equitable and reliable access to digital services." - Sylvia Luke, Lieutenant Governor, State of Hawaii https://lnkd.in/gp849ihX https://lnkd.in/gcUwbJs7 Amanda Stange Jen Stanley Reymund Dumlao Jamar Thomas Sandeep Togrikar Steve Lujan Christopher Hein

38

Great read on our journey to securing your AI investments from Steph Hay and Umesh Shankar #1 - AI opens up a world of possibilities. Be proactive in securing your AI investments - data, models, applications, and infrastructure. #2 - Make Google part of your security team, and Security Command Center - Enterprise as your default platform to help secure your AI investments. #3 - New capabilities in Notebook Scanner (private preview) and Model Armor (previewing soon) to secure your AI investments. Shout out to Amit Patil, Bharath Chandrasekhar, Matt Driscoll, Bhaskar Annadata, Cfir Cohen, Rahul Venkatraj and many more for these new capabilities.

67

For those of you building RAG: next week (May 21) we're hosting a webinar with MongoDB that will help optimize those apps--

14

At Google Cloud India, we don't just build teams; we cultivate communities of collaboration, creativity, and inclusivity. Our teams are not simply engineers or product managers; we're problem solvers, dreamers, and innovators. From startups to large enterprises, our cloud solutions are more than just tools; they're catalysts for real, tangible change in the lives of our clients, empowering them to reach new heights and achieve their goals. In the ever-evolving landscape of cloud computing, Google Cloud isn't content with just keeping up. We're setting the pace, leading the charge with cutting-edge technologies like AI, machine learning, and data analytics. We're not just meeting industry standards; we're surpassing them, rewriting the rulebook and establishing new benchmarks for excellence. Join us as we continue to push boundaries, break barriers, and unlock new avenues for growth and innovation, shaping a future where the impossible becomes possible. Be a part of Google Cloud India, where together, we can change the world. Click here to know more:  https://lnkd.in/gCiYtDwj #GoogleCloud #Buildforeveryone

802

12 Comments

🚀 Reflecting on Kafka Summit: Transforming Data Streams into Business Value Kafka Summit Bangalore 2024 was not only enlightening but also provided a delightful reunion with Jay Kreps, co-founder and CEO at Confluent, and my former colleague at NexTag. It's inspiring to see how Confluent is shaping the future of Streaming with Apache Kafka & Apache Flink Unified for the Data Streaming Era (Two(2) big communities coming together) Here are some pivotal learnings from the summit that resonate deeply with our objectives at MakeMyTrip and the broader trends within the tech industry: 1.  𝐒𝐢𝐦𝐩𝐥𝐢𝐟𝐢𝐜𝐚𝐭𝐢𝐨𝐧 𝐚𝐧𝐝 𝐀𝐜𝐜𝐞𝐥𝐞𝐫𝐚𝐭𝐢𝐨𝐧 𝐨𝐟 𝐃𝐚𝐭𝐚 𝐎𝐩𝐞𝐫𝐚𝐭𝐢𝐨𝐧𝐬: Confluent is focused on making it easier for users to process data streams more quickly and efficiently than before, emphasizing the importance of moving beyond mere data movement to achieve transformative business impacts while Addressing Data Infrastructure Complexity. 2. 𝐔𝐧𝐢𝐯𝐞𝐫𝐬𝐚𝐥 𝐃𝐚𝐭𝐚 𝐏𝐫𝐨𝐝𝐮𝐜𝐭𝐬: Confluent aims to transition from a model where data consumers pull data from systems, to a model where producers present well-formed data that multiple downstream subscribers can use. This approach is embodied in their concept of "data products," which are well-curated, reusable data sets with a clear ownership and governance structure. 3. 𝐒𝐭𝐫𝐞𝐚𝐦𝐢𝐧𝐠 𝐏𝐥𝐚𝐭𝐟𝐨𝐫𝐦 𝐄𝐧𝐡𝐚𝐧𝐜𝐞𝐦𝐞𝐧𝐭𝐬: The new features in Confluent’s streaming platform are designed to federate data effectively across operational and analytical domains. The platform’s capabilities are extended to ensure data is not only real-time but also reusable, governed, and securely connected across all systems. 4. 𝐈𝐧𝐭𝐞𝐠𝐫𝐚𝐭𝐢𝐨𝐧 𝐨𝐟 𝐎𝐩𝐞𝐫𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐚𝐧𝐝 𝐀𝐧𝐚𝐥𝐲𝐭𝐢𝐜𝐚𝐥 𝐃𝐚𝐭𝐚 𝐄𝐬𝐭𝐚𝐭𝐞𝐬: Confluent team introduced a significant development called "TableFlow," which seamlessly integrates streaming data with analytical systems. This integration aims to make real-time data available in data lakes or warehouses instantly, supporting both operational responsiveness and analytical depth. Confluent added support for Iceberg to Confluent Cloud, allowing customers to convert Kafka topics, schemas, and metadata into Iceberg tables seamlessly. 5. 𝐅𝐮𝐭𝐮𝐫𝐞 𝐕𝐢𝐬𝐢𝐨𝐧 𝐟𝐨𝐫 𝐃𝐚𝐭𝐚 𝐒𝐭𝐫𝐞𝐚𝐦𝐢𝐧𝐠: The overarching theme was the strategic shift towards a holistic view of data management, where streaming is not just a method of transporting data but a fundamental aspect of how data is structured, processed, and consumed across businesses. While they might not be explicitly calling it Kappa architecture, their focus on data streams suggests they're on a similar path. 📸 Here’s a snapshot of Jay Kreps, me, Aditya & Confluent team at the event. Looking forward to many more such reunions and fruitful collaborations! #KafkaSummit #DataStreaming #Personalization #Confluent #MakeMyTrip

189

1 Comment

Read the case study on how Oracle Globally Distributed Database helps fintech companies to fill their need for scalable #AI and ML-driven business through hyper-scalable infrastructure. Read: https://lnkd.in/gE6kAMZA

1

I have a love hate relationship with #observability space. The hate is mostly all self-inflicted, e.g. misreading docs, misreading configurations, debugging polyglot services and dealing with idiosyncrasies of otel sdks in multiple languages. It’s mostly love though! It’s powerful when it works! I think community is coming along way when it comes to documentation and resources. It still feels early. You have to be very self sufficient and be comfortable ditching/trying/demoing/hacking on many different tools in various languages and various environments. All in all, despite its warts and problems, it’s mostly all gravy! #opentelemetry is one of the best things to have happened in tech that gets under appreciated! Embracing it allows you to be a lot more freer than just to be tied to a single vendor. That being said…love and proud customer (across multiple companies) of honeycomb.io ! Not only are they great vanguards of #opentelemetry, their product (at least for tracing) is till my favorite across all oss/commercial products..and I’ve tried most all of them!

81

6 Comments

Exactly one month ago, Intuit's Kalyan Kolachala (Director, Product Development), gave a Lightning Talk: Federated Search Over Distributed Observability Data at #ArgoCon | #KubeCon EU. In this talk, he gives insight into the use of technologies like, #OpenTelemetry, #ApacheArrow and #ApachePresto and how it can be used to improve speed, performance and significantly bring down Observability costs (for compute, networking and storage) and illustrates the same using a case study from Intuit. https://lnkd.in/gnv3vESJ #Intuit #IntuitOpenSource #OpenSourceCommunity #Observability #OpenSource #CloudNativeCon

15

Creating an EKS cluster can be done with (relatively) simple AWS CLI commands. There are a lot of commands to run, and while they can be wrapped in a script and parameterized - it's still not a very good solution. https://hubs.la/Q02s3Gg_0 #eks #kubernetes #k8s #aws #sre

4

Use our Open-Source Linux SDK to collect and store data that your devices produce, on cloud! Seamlessly manage your entire fleet with Metadata, Customisable from cloud. Update your on-field device firmware and configuration parameters with just a few clicks. Visualize sensor data and create fleet dashboards with widget based panels. Create and send customised commands from cloud to your devices like- Turn on, Turn off, Lock, Unlock, or any other.. Debug remotely with complete access- Retrieve device logs and login to linux device terminal from cloud! Create alerts based on custom rules or conditions. Get notified via Email, Slack, Whatsapp or even phone call.. Only with Bytebeam

41

It's fantastic when the team leverages platform goodness for our customers! I love how I'm able to follow along the IPL match even when I'm on the go! As with most things we do, we had to scale what came out of the box to make this work for our customer base. Read on for practical tips on how we got there.

200

2 Comments

𝗘𝘅𝗰𝗶𝘁𝗲𝗱 𝘁𝗼 𝘀𝗵𝗮𝗿𝗲 𝗺𝘆 𝗳𝗶𝗿𝘀𝘁 𝗯𝗹𝗼𝗴 𝗽𝗼𝘀𝘁! 🎉 We encountered 502 errors during deployments on AWS EKS with AWS ALB and Argo Rollouts. After extensive analysis and adjustments, we found a solution that significantly reduced these errors. Curious about the journey and insights? Check out the full blog post #AWS #Kubernetes #DevOps #FirstBlog #ArgoRollouts #AWSALB

18

A few thoughts on #LLM usage in the small, prompted by my toying with #llama3 and #phi-3 on consumer hardware.

5

vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention Ramya Prabhu, Ajay Nayak, Jayashree Mohan, Ramachandran Ramjee, Ashish Panwar Abstract Efficient use of GPU memory is essential for high throughput LLM inference. Prior systems reserved memory for the KV-cache ahead-of-time, resulting in wasted capacity due to internal fragmentation. Inspired by OS-based virtual memory systems, vLLM proposed PagedAttention to enable dynamic memory allocation for KV-cache. This approach eliminates fragmentation, enabling high-throughput LLM serving with larger batch sizes. However, to be able to allocate physical memory dynamically, PagedAttention changes the layout of KV-cache from contiguous virtual memory to non-contiguous virtual memory. This change requires attention kernels to be rewritten to support paging, and serving framework to implement a memory manager. Thus, the PagedAttention model leads to software complexity, portability issues, redundancy and inefficiency. In this paper, we propose vAttention for dynamic KV-cache memory management. In contrast to PagedAttention, vAttention retains KV-cache in contiguous virtual memory and leverages low-level system support for demand paging, that already exists, to enable on-demand physical memory allocation. Thus, vAttention unburdens the attention kernel developer from having to explicitly support paging and avoids re-implementation of memory management in the serving framework. We show that vAttention enables seamless dynamic memory management for unchanged implementations of various attention kernels. vAttention also generates tokens up to 1.97x faster than vLLM, while processing input prompts up to 3.92x and 1.45x faster than the PagedAttention variants of FlashAttention and FlashInfer. 👉 https://lnkd.in/dDJKrsea #machinelearning

1

"The good news is that we are at #AnsibleFest" -- asserted Sathish Balakrishnan, VP & GM of the Ansible Business Unit at Red Hat during his keynote today. Full House at the keynote where Balakrishnan explained how #Automation has come a long way and the critical role that #Ansible has played in that journey -- making automation more consumable with ease of use. "Automation is no longer a nice-to-have. Automation is mission critical" continued Balakrishnan. Looking ahead to the future, building upon what we heard from Matt Hicks at the Red Hat Summit keynote, Balakrishnan asserted that "#AI is a natural progression of automation!" How is your AI strategy coming along? But, wait, where are you with your Automation Strategy? These are the questions that we can address at this event and beyond. Kaete Piccirilli :: Moez Dharani :: Erich Morisse https://lnkd.in/gdwYQbGs

27

If you are attending DEVCON24 - Please connect with Adithya K. to understand how Skyserve can help deliver spatial intelligence for your application!

10