#33
Anthropic π€ TPUs, Samsung's Gauss, AI Pin, Global South, GitHub & OpenAI launches, RIP Omegle, We-Didnt-Work, Randoma11y, TravelWeatherMap, NewPipe and more
ππ» hey, you! welcome back.
Itβs 33 (yes, the same as the number of deities in the Vedic Religion).
πͺ Wishing you a happy Deepavali!
A lot happened, but this weekend is busy so weβll cover some important bits.
New here? Donβt forget to ππ»
π§ Podcast version of this edition is available here β #33 | Recast
Whatβs happening π°
β¨ OpenAI Dev Day happened on Nov 6th.
π GPT-4 Turbo & GPT-4 Turbo 128k are released; these are longer, cheaper, faster, stronger variants of GPT-4 (btw 128k is as big as a 300-page book, and hereβs some pressure testing it to see how good it is)
Assistants API and Threads - now you can build custom assistants on the dashboard and every conversation can be a thread, keeping context from old chat to mimic RAG.
GPTs, Builder, and GPT Store. Yes, ChatGPT+ users can now build and submit their own GPTs, in fact, Nibbler P built some.
GPT-5 is rumored to be a multimodal (w/ videos) model codenamed βGobiβ (cauliflower finally getting the recognition it deserves π)
you might have guessed at this point that every time OpenAI announces something it kills a lot of undefendable startups (as Dharmesh Shah pointed out in his newsletter).
π GitHub Universe happened on Nov 8 & 9. In short, the event was just like the Windows 95 launch, but instead of saying βDEVELOPERSβ, imagine Steve Balmer chanting βCOPILOT!!β.
Copilot Chatβs general availability in December and future support for JetBrains IDEs
Copilot enterprise plan that lets companies finetune the model for their codebase at $39/month expected in February 2024
Copilot Partner Program with third-party integrations and much more
β‘οΈ Anthropic to Use Google Chips (TPU v5e) in Expanded Partnership. Google has been building TPUs for a while, specially designed to do ML tasks at speed. If this goes well, who knows maybe Anthropic can do more with less.
πHumane released The AI Pin, another wearable AI-powered gadget. It will cost ~$700 and can more or less replace your smartphones. It can take voice commands capture photos, send SMS search the web, or ask AI for you. Oh! and yes it can also project the content over to your palm and you can control that using hand gestures. (just like Pranav Mistryβs Sixth Sense from 14 years ago. Thanks, Tanmay for reminding us of this.)
πͺ¦ Omegle 2009-2023, itβs very less probable that you may not have heard of it. Leif K-Brooks the founder of Omegle, posted a long note on how it started and how they lost the battle to keep it alive. Also, it becomes unsustainable to run projects like this over time. Even Wikimedia bugs us for money, doesnβt it?
π Amazon finally catching up with old friends, they are reportedly working on an AI Model with the codename βOlympusβ, an LLM with 2T params (at this point we all know quoting just the parameters doesn't tell much so letβs see of ).
π€ OpenAI also announced Data Partnerships as a call to partner with organizations to produce public and private datasets for training AI models.
π₯ YouTube is not holding back on AI anymore, the product is going to leverage generative AI (yes, Gemini). Two of such features are already in testing now:
Comment topics summarized by AI
An AI conversation tool on Video.
π€³ Samsung just threw its hat into the LLM ring at the companyβs AI Forum, teasing a new generative model called βGaussβ, which boasts language, coding, and image generation capabilities.
π angular.dev is the new home for angular devs. With their latest announcement of the Angular v17, they released this new developer site that would house the updated docs, the angular tutorials, and a new playground with the help of webcontainers. (As somebody who worked with Angular in the past months, I am so glad to see the new control flow and loop statements in v17. Iβm also very excited about the lazy loading and build time improvements.)
What brings us to awe π³
π Through the Ages: Apple CPU Architecture - With the M3 benchmarks making rounds with mixed reactions, it seems like a good time to see how far we have come, revisit how CPUs work, and discover Appleβs underrated competitive advantage.
π WeWork filed for bankruptcy, yes the same company that was valued close to $50 Billion. It doesnβt bring us to awe, but omg, people need to use the money wisely.
π» Drunk Post: Things I've learned as a Sr. Engineer. A gem. You donβt want to miss reading this.
β οΈ Cloudflare had a 37-minute outage on 30th October, their Workers KV services became unavailable in prod and folks were getting 401 on their own servers.
Today I(we) Learnt π
π¬ Ever wondered what AWSβs Python SDK βboto3β means? βbotoβ is the common name of a freshwater dolphin, which is native to the Amazon River [comment by the creator]. The β3β in βboto3β signifies the version of the library, indicating itβs the third major version of the boto library. We still do not know why the AWS SDK in other languages besides Python has so boring names.
π‘ Git Tip: Rebasing is hard and it becomes harder if you have to resolve the same merge conflicts again and again. Git actually has a flag
rerere
and it stands for Reuse recorded resolution of conflicted merges. You can enable it in your repo by usinggit config rerere.enabled true
.
Found this while reading this banger from Julia Evans.γ°οΈ There is a buzzing word in news headlines called βGlobal Southβ and Finshots covered it in detail here. But, what is it you ask? Itβs an imaginary divide between all the well-off countries and countries less developed. Some folks drew that line in the 1980s & called it the Brandt Line.
πΊοΈ Why does unsafe multithreaded use of
std::unordered_map
crash more often than unsafe multithreaded use of astd::map
? Hint: Think about how these two maps are implemented. [LINK]
π€ You have read ~50% of Nibble, the following section brings tools out from the wild.
What we have been trying π
πΊοΈ TravelWeatherMap - Seasonal weather at a glance for the globe. (really useful for travel enthusiasts)
ποΈ The Complete Guide of Mistral AI - A guide to the several fine-tuned models of the Mistral-7B
π¨ Randoma11y - AI-powered color pallets in compliance with a11y.
π Reading βIt Doesn't Have to Be Crazy at Workβ by DHH & Jason Fried from Signal37.
Itβs a nice (somewhat too good to be true) read on how to keep your startups sane and work like the EU.
Buildersβ Nest π οΈ
πͺ ladder: a self-hostable alternative to 12ft.io. Bypass paywalls with a proxy ladder and remove CORS headers from any URL
π€ YC Application GPT: A GPT1 that fills in your YC application automatically based on your pitch deck.
πΉ NewPipe: The lightweight YouTube experience for Android. (from the last Nibble you might know that YouTube is fighting against AdBlockers and mod apps, may this solve it all.)
π Yi - A series of large language models trained from scratch by developers 01.ai (shit expensive domain). They released the 6B and 34B models trained on Chinese and English data and outperformed several larger models released previously.
πͺ Reactime - Developer tool for time travel debugging and performance monitoring in React applications. A developer tool for time travel debugging and performance monitoring in React applications.
Meme of the week π
Off-topic reads/watches π§
π§π» Negative visualization in practice by DHH, be stoic basically.
πΌ How to boss without being bossy by Jeff, he discusses tons of stuff but I donβt think if you are looking for a single answer this post will help, but itβll compare the options.
π Identify by Paul G (from 2009). Itβs a relatively small read w.r.t how much Paul writes and he ends it with something to remember, βThe more labels you have for yourself, the dumber they make you.β
Wisdom Bits π
"If you spend too much time looking in the rear-view mirror, you will crash your car."
β Late Matthew Perry
If you liked what you just read, recommend us to a friend whoβd love this too ππ»
Weekly Standup π«‘
Nibbler A & Nibbler P both worked hard full week and are most probably busy with πͺ Diwali festive chores & poojas while you are reading this.
In case you think, we donβt know what a GPT is, jokes on you. OpenAI launched a marketplace and they are calling all these plugins now βGPTβ
Thank you for writing this. Got to know some fun new stuff π