TWIL 0006 | 24w42
TWIL ~ This week I learned, read or wanted to publicly save
Fair source licence
Sentry came up with a new licencing category - Fair source. Base on techcrunch news main reason is: “Users can self-host and modify the code without paying the creator a dime. They just can’t commercialize the product as a competing service.”
Artist’s analogy on AI
To the point what an artist can feel in the world of Gen AI. I love it. Follow Kyle on X.
Dragi’s report on state of EU
Late to the party but must read for everyone in EU who cares.
AWS Bedrock in Europe
Public quotas for Bedrock Anthropic models in EU datacenters are not good.
Anthropic contextual retrieval
Anthropic has noticably poor PR but in the rest of the categories rocks. Informative publishing, research, codes, cookbooks. Very nice. Just examples:
Ultraspeaking
Sometimes I need to talk in front of people and this was an interesting podcast. Many thoughts and ideas that come from different POV - let the ideas flow and don’t be afraid of outside additions (great games included), accordion for preparing talks and distilling the main idea by time pressure. Tristan de Montebello definitely tries something new.
Imbue built a 70B training cluster
I still don’t understand how to distribute and orchestrate the training itself, is there some magic library? How to put together 511 servers is also unimanigable, but they try to describe it in detail.
Another Transformer viz
source: J. Ferrer on X
Terraform
Very nice tutorial, very hands-on. 30 minutes worthy of my time so I can better understand my colleagues working with Terraform.
# GPUs H100 fell down to insanely cheap prices
AMD (MX300) and Intel (Gaudi 3) finally offers worthy opponents. Not much companies training foundation models anymore (just fine-tunings of open-weight ones). A lot of companies trying to get value from the last mile -integration into corporate systems.
Well, this is exactly what Palantir is doing - fixing the last mile problem, aiming to be the platform from which every enterprise builds every single application. What does that tell you? (WhatsHot in Enterprise IT/VC)
Investment into H100 can be unprofitable. Stunning. Vast.ai offers GPU compute