TL;DR summary of stories on the internet
S-LoRA is a system designed for scalable serving of many LoRA adapters, which are derived from a base model using the parameter-efficient fine-tuning method called Low-Rank Adaptation (LoRA). S-LoRA stores all adapters in main memory and fetches the ones needed for currently running queries to GPU memory. It introduces Unified Paging, a mechanism that manages […]
Read more »
Last year, the author experienced burnout in their software industry career. They decided to take a break, quit their job, and started therapy. They also disconnected from social media, including Twitter. During this time, they read a book called How to Do Nothing, which led them to discover Mastodon, an alternative online community. After trying […]
In this technical report by Jürgen Schmidhuber, he addresses the issue of plagiarism in the field of Artificial Intelligence (AI). He claims that three Turing Awardees for deep learning failed to credit his team for their key methods and ideas. Schmidhuber highlights several priority disputes with these researchers, citing specific instances where they republished his […]
Dropbox has received criticism for its new AI features that involve sending user data to OpenAI for training. Concerns have been raised about the privacy of users’ files and whether Dropbox is using customer data without consent. Despite Dropbox’s denial, many believe that their private data is being funneled into the OpenAI training process. Similarly, […]
In this project, I aimed to create a visual aid that goes beyond teaching players how to play Tekken and helps them understand the game mechanics on a deeper level. I designed cards that break down fighting moves into smaller components, allowing players to compare and analyze them. This was my first time designing something […]
In this post, the author, a seasoned DevOps engineer, discusses the shortcomings of Helm, a popular Kubernetes deployment tool, and why they believe there is a need for a more modern deployment solution. The author provides a brief history of Helm and highlights the issues with it, including the lack of a mechanism for upgrading […]
The Barcelona Supercomputing Center (BSC) has unveiled the new Sargantana chip, the third generation of open source processors designed entirely at the BSC. This chip represents an important advance in achieving European technological sovereignty and reducing dependence on large multinational corporations. Named after the lizard in Aragonese and Catalan, Sargantana is one of the most […]
Researchers from the Paris Brain Institute have gained new insights into the neurological process of dying. They found that during oxygen deprivation, the brain undergoes a series of changes, including a surge in gamma and beta waves that are potentially linked to near-death experiences. This is followed by a “wave of death” that marks the […]
The author presents a novel approach to the problem of Kalman Filtering using Transformers, which are autoregressive deep learning architectures. Transformers have recently demonstrated impressive performance in various tasks, including vision, language, and robotics. In this study, the author shows that Transformers can approximate the Kalman Filter with high accuracy. They introduce a causally-masked Transformer, […]
OKRs (Objectives and Key Results) are a widely used goal-setting framework that helps companies track progress and ensure alignment towards specific objectives. However, in my experience, OKRs can sometimes become rigid and frustrating due to their heavy focus on metrics and constant measurement. As a team manager, I have also felt pressure to continuously monitor […]