Login

Recent searches

No recent searches

Search options

Only available when logged in.
fosstodon.org is one of the many independent Mastodon servers you can use to participate in the fediverse.
Fosstodon is an invite only Mastodon instance that is open to those who are interested in technology; particularly free & open source software. If you wish to join, contact us for an invite.

Administered by:

Server stats:

11K
active users

fosstodon.org: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.4

#scaling

4 posts4 participants0 posts today
Public
Team Topologies

Ever wondered how to structure your teams for optimal performance? Or perhaps you're navigating the complexities of #scaling your ##organization? Look no further! The @TeamTopologies Academy is your one-stop destination for all things team design, organization dynamics, and effective collaboration strategies.

The Academy provides online, on-demand, video-based training courses available 24h across all timezones.

Public
Habr

Теперь готовлю только так: перенос Drupal 8 в Kubernetes

В новой статье делимся опытом переноса пачки новостных сайтов на Drupal 8 в Kubernetes. Узнайте, почему просто перенести Drupal в Kubernetes — плохая идея. И как избежать переплаты за ресурсы. Мы также расскажем, как werf помогла автоматизировать сборку Docker-образов и упростить CI/CD, как правильно организовать CronJobs в Kubernetes, чтобы они не влияли на работоспособность системы, и поделимся секретами кэширования Redis и nginx для увеличения производительности Drupal 8 в разы.

habr.com/ru/companies/oleg-bun

ХабрТеперь готовлю только так: перенос Drupal 8 в KubernetesПривет, Хабр! Я — Алексей Демьянов, тимлид DevOps-команды во «Фланте». В этой статье расскажу, как мы перевели пачку высоконагруженных новостных сайтов клиента на базе Drupal 8 в Kubernetes в облаке....
#drupal#кубернетис#производительность
Public
N-gated Hacker News

🧐 Welcome to the thrilling world of "#DeepSeek," where they unleash their groundbreaking #FP8 #GEMM #Kernels, as if these buzzwords mean anything to normal humans. 🤖✨ Now you too can revel in the #excitement of "#fine-grained #scaling," because who doesn't dream of spending their weekends scaling kernels? 🎉 #GitHub's #navigation menu is undoubtedly the real star here, stealing the show with its riveting toggle action. 🚀
github.com/deepseek-ai/DeepGEMM #tech #HackerNews #ngated

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling - deepseek-ai/DeepGEMM
GitHubGitHub - deepseek-ai/DeepGEMM: DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scalingDeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling - deepseek-ai/DeepGEMM
Public
💧🌏 Greg Cocks

Scaling In Branch Thickness And The Fractal Aesthetic Of Trees [In Art From Da Vinci To Mondrian]
--
academic.oup.com/pnasnexus/art <-- shared paper
--
[not my usual fare, but love the spatial mathematical components, although the maths is way over my head!]
#spatial #maths #mathematics #art #painting #representation #daVinci #LeonardodaVinci #MurraysLaw #tree #vegetation #fractal #fractals #α #biology #artwork #radiusscalingexponent #branches #branching #nature #naturalpatterns #proportions #physiology #Mondrian #aesthetic #aesthetics #scale #scaling

a) da Vinci’s sketch of a tree illustrates the principle that combined thickness is preserved at different stages of ramification. b) Transects A and B have the same combined thickness and so limbs a and b together must have the same thickness as c. This has been taken to imply that c) combined cross-sectional area (⁠πR²⁠) is preserved across branching. Likewise, d) such transects can count the number of branches n that have radius approximately r to derive a fractal scaling relationship. Source: (a) from Institut de France Manuscript M, p. 78v.
sketch from one of Leonardo da Vinci's notebooks illustrating his original rules of trees
The scaling exponent α (a) determines the amount of detail at a given resolution and (b) proportions among adjoining boughs.
Trees in artwork across centuries, cultures, and styles exhibit fractal scaling. a) carved stone window screen of Sidi Saiyyed Mosque, Ahmedabad, Gujarat, India (1573 CE). b) Cherry Blossoms, Matsumura Goshun (1752–1811), ink on paper. c) L’Arbre de Vie (Tree of life), Gustav Klimt (1909), oil on canvas. d) data and inference of α±95% CI in two replicate measurements for each work along with simulated and living trees. Dotted vertical lines indicate the cutoff for excluding small-scale effects. Diameters from simulated and living trees are divided by this minimum value and therefore the horizontal axis is unitless.
Public
:rss: Hacker News

How to scale your model: A systems view of LLMs on TPUs
jax-ml.github.io/scaling-book/
#ycombinator #scaling #jax #llms #transformers #tpus #google #deepmind #parallelism #pallas

jax-ml.github.ioHow To Scale Your ModelTraining LLMs often feels like alchemy, but understanding and optimizing the performance of your models doesn't have to. This book aims to demystify the science of scaling language models on TPUs: how TPUs work and how they communicate with each other, how LLMs run on real hardware, and how to parallelize your models during training and inference so they run efficiently at massive scale. If you've ever wondered “how expensive should this LLM be to train” or “how much memory do I need to serve this model myself” or “what's an AllGather”, we hope this will be useful to you.
Public
:rss: Hacker News

How to Scale Your Model: A Systems View of LLMs on TPUs
jax-ml.github.io/scaling-book/
#ycombinator #scaling #jax #llms #transformers #tpus #google #deepmind #parallelism #pallas

jax-ml.github.ioHow To Scale Your ModelTraining LLMs often feels like alchemy, but understanding and optimizing the performance of your models doesn't have to. This book aims to demystify the science of scaling language models on TPUs: how TPUs work and how they communicate with each other, how LLMs run on real hardware, and how to parallelize your models during training and inference so they run efficiently at massive scale. If you've ever wondered “how expensive should this LLM be to train” or “how much memory do I need to serve this model myself” or “what's an AllGather”, we hope this will be useful to you.
Replied in thread
Public
Kent Pitman

@climatebrad

It feels to me like "build more housing" can't be the answer. You almost might as well say "make more land". It's not a durable solution. And it doesn't address the many other aspects of society that need to be addressed. Jobs food commerce in general, schools, the nature and flow of community itself.

A favorite quote comes to mind.

"Better implies different."
--Amar Bose, at an MIT Enterprise Forum event

(He was trying to explain to sales people at stores that would sell Bose speakers why they had to make changes in how they set them up. "Couldn't they just do what they'd always done?" The people would ask. They were used to that and did not want to change. He was trying to explain succinctly why you can't just radically improve something and leave it the same at the same time. So he, explained, that slogan had emerged.)

Surely higher population density at some point means using existing resources differently. I'm not pushing an agenda here, but I am observing that higher density feels less compatible within every person for themselves and traditional-ownership / rent-taking-for-profit model. Surely that brings a 2-tiered citizenship and breeds discontent/danger as inequality simmers.

In computer science, we talk about building systems that scale, planning for higher traffic. This could really be done in a system that did not plan for scale without the architecting the system entirely, and I've even seen some of pine that every factor of 10 in scale requires a redesign.

Sometimes the architectural plan is indeed to just add servers, but that has to be planned in, and there has to be a source of servers, and the system architecture has to be structured such that in the new model, all the necessary flows will happen correctly and resources won't be cut off from each other or too hard to access or too expensive.

"Build more housing." does not sound like the kind of answer I could give in a job interview and expect to be hired, with the hiring manager saying "this person has clearly demonstrated their understanding of operating at scale". The answer is not of a shape that seems right to me, nor does it offer sufficient detail.

A lot of capitalism seems to operate on a theory that you just twist some knobs and everything will just happen right without coordination. I think this is less and less true as either populations grow larger or resources grow smaller or resources become more stressed.

I did not write the accompanying article specifically to address this issue, and yet I feel like it says some important additional things I might say here if I were to ramble on. It is not a complete discussion of scale, but more discussion of why I don't think the traditional ways of thinking about just turning a few knobs is likely to keep working.

Losing Ground in the Environment
netsettlement.blogspot.com/201

It also just not addressed the issue of urgency, and the way in which urgency materially changes the set of usable solutions. I did try to address that issue here:

The Politics of Delay
netsettlement.blogspot.com/202

netsettlement.blogspot.comLosing Ground in the EnvironmentKent Pitman's blog. Independent, progressive views on Society, Technology, Social Justice and Climate, or sometimes poetry, philosophy, or history.
#climate#ClimateMigration#SystemsThinking
ExploreLive feeds
About